Instructions

 

  1. Complete this checklist for Java users as well as Android users. The larger the set of users in both groups, the better it would be for drawing conclusions and identifying patterns. Please exercise caution is drawing conclusions from a small set of users. FLW refers to Field Level Workers.

 

  1. The results of this checklist may be used to:

 

(a)           Identify areas where the Android phone may be better suited to this project in terms of the usability for the end-user and engagement with the beneficiary,

(b)           Identify areas where the Java phone may be better suited to this project in terms of the usability for the end-user and engagement with the beneficiary,

(c)            Identify areas that end-users require reinforcement in, irrespective of the type of phone.

 

  1. These questions should not be asked to the frontline worker. Answers must be based purely on observations made by field supervisors of these workers.

 

Preliminary Information

Supervisor’s name:

FLW’s name:

Date:

Type of Phone (circle one below):

  1. Android
  2. Java

In all questions below, please circle the appropriate choices based on your observations

1. CommCare Navigation

 

  1. Can the FLW seamlessly move to the next question in a form?
    1. Yes
    2. No

 

  1. Can the FLW seamlessly return to the previous question in a form?
    1. Yes
    2. No

 

  1. Can the FLW tell by simply looking at a question on the phone’s screen – which questions are single-choice and which ones are multiple-choice?
    1. Yes
    2. No

 

  1. How easy is it for the FLW to correctly type in the beneficiary’s name in the registration form?
    1. Easy – needs no guidance
    2. Manages with some guidance
    3. Cannot do it without handholding

 

Android Only

 

  1. While inside a form, how often does the FLW press the back key on the phone (that is, the right selection key)?
    1. Often
    2. On a few occasions only
    3. Never

 

If the answer to the above question is often or on a few occasions only , only then answer the following question:

 

  1. If the FLW pressed the back key in error and does not want to exit the form, does she know what to do?
    1. Yes (select “Cancel”)
    2. No

 

  1. Does the FLW know how to switch between the numeric and alphabetic keypads on the Android?
    1. Yes
    2. No

 

 

Java Only

 

  1. In decimal input questions (for example, recording the baby’s weight), does the FLW know how to type in the decimal point?
    1. Yes (press the * key)
    2. No

 

  1. While inside the application, how often does the FLW press the power button on the phone?
    1. Often
    2. On a few occasions only
    3. Never

 

If the answer to the above question is often or on a few occasions only , only then answer the following question:

 

  1.                 If the FLW pressed the power button in error and was sent to the home screen of the phone, does she know how to return to the application ?
    1. Yes
    2. No

 

 

 

 

 

2. Beneficiary Engagement with Multimedia

Please skip the following questions if your application does not have any audio .

 

  1.                 How often does the FLW play the audio associated with relevant questions during a visit? [Please note that the audio for the questions is separate from the audio for the choices].
    1. Always
    2. Sometimes
    3. Never

 

If the answer to the above question is always or sometimes , only then answer the following questions:

 

 

  1.                 Are the audio messages audible to the FLW?
    1. Yes
    2. No

 

 

  1.                 Are the audio messages audible to the beneficiary?
    1. Yes
    2. No

 

 

  1.                 Does the beneficiary respond to the audio in any way (for example, does she say something or nod her head in acknowledgement when the audio is played?)
    1. Yes
    2. No

 

  1.                 Does the FLW hold the phone close to the beneficiary while playing the audio?
    1. Yes
    2. No

 

 

Please skip the following questions if your application does not have any images .

 

  1.                 Does the FLW show images associated with relevant questions to the beneficiary?
    1. Yes
    2. No

 

If the answer to the above question is yes , only then answer the following question:

 

 

  1.                 Does the beneficiary respond in any way when she is shown the image (for example, does she say something or nod her head in acknowledgement when the image is shown?)
    1. Yes
    2. No

 

 

Please skip the following questions if your application does not have any videos .

 

  1.                 Does the FLW show videos associated with relevant questions to the beneficiary?
    1. Yes
    2. No

 

If the answer to the above question is yes , only then answer the following question:

 

 

  1. Does the beneficiary respond in any way when she is shown the video (for example, does she say something or nod her head in acknowledgement when the image is shown?)
    1. Yes
    2. No