Directions on how to implement the standard CommCare Pre Training Assessment and Post Training Evaluation
I PRE-TRAINING ASSESSMENT (PTA)
The PTA is a short assessment of 14 mostly Yes/No questions. The PTA is administered at the very start of the user training or even before the user training. The goal of the PTA is to assess what level the users are at as a group, as well as individually. The trainers can prepare for the training accordingly and identify who needs more attention and help, and which users could potentially be helping fellow users. Furthermore, results can be used by the data team to analyze correlation between starter level and CommCare uptake/adoption.
As most users start to learn on the first day how to navigate a phone, the PTA is taken on paper and entered later on the phone by either FM, supervisor/trainer, or user itself after getting comfortable with the phone.
Part 1. Paper based PTA
Download the PreTrainingAssessment.doc
Print enough for all users (print 1 or 2 extra)
Ask users to fill out individually and collect PTAs
Write on every PTA what the CommCare username is for the user
Part 2. Enter PTA data through the CommCare app
To enter this data into the system, you'll need to enter it into the app.
- Follow instructions from part I and II of the PTE below for copy/pasting the form into your domain.
- Decide if users will fill out their own PTA at the end of the training from paper or if supervisor/trainer or FM is doing that.
**Remember to login as the user who took the test each time!**
Part 3. Discuss the results with the partner or trainers
With the paper or electronic results, discuss the findings with the partner team. Identify if any trainees will need extra support, and if so, how to provide it. You can also identify the level that the group is at and if you need to readjust plans for the overall schedule. (speed of sessions, more coverage on certain topics, etc).
II POST TRAINING EVALUATION (PTE)
The PTE consists of 14 questions to evaluate the training and app as well as 8 phone/app knowledge questions. The PTE is administered at the end of the user training. The goal of the PTE is to evaluate the training and identifies to trainers which part should be more focussed on. It is recommended to prime users that the goal is to evaluate the training and trainers and not the individual users! Results can be used by the data team as well on aggregate level.
The PTE is taken directly on the phone through the app.
Part 1. Copy the PTE
Go to the trainingsurveys domain (internal) or download "version 1 of PTA and PTE" from the CommCare Exchange (external)
Click on the form “Post Training Evaluation”
Go to “Advanced”
Download the XForm
Go to “Multimedia”
Click on “Download ZIP”
Part 2. Paste the PTE into your app
Go to the domain of your own application
Click on the ‘+’ to add a Form
Name the form “Post Training Evaluation” and hit “Save”
Go to “Advanced”
Upload the XForm that you just downloaded
Go to “Multimedia”
Click on “Multimedia Reference Checker”
Click on “Go to Bulk Upload”
Click “Select Files”
Select the MM file that you downloaded in part I above and click “Begin Upload”
Go do some burpees, it might take a while
Optional: Add a language/translations in case the users don’t understand any of the existing translations in the app
Deploy a new build and download it on to the phones
Let all users submit their PTE and check through the form export if everyone did so.
Delete the PTA and PTE from the app, deploy and update all phones (This is optional, if you think it will be useful to keep it there to use for future trainings and it won’t confuse the users, you don’t need to do this last step).
Part 3. Review results and discuss with the partner
After training, either before you've left site or upon your first check-in call, discuss the results of the PTE. Highlight individuals who may need extra support and any overall trends for the group's uptake of the app. Walk the partner through any potential plans for addressing needs in the coming months.