Directions on how to implement the standard CommCare Pre Training Assessment and Post Training Evaluation
I PRE-TRAINING ASSESSMENT (PTA)
The PTA is a short assessment of 14 mostly Yes/No questions. The PTA is administered at the very start of the user training or even before the user training. The goal of the PTA is to assess what level the users are at as a group, as well as individually. The trainers can prepare for the training accordingly and identify who needs more attention and help, and which users could potentially be helping fellow users. Furthermore, results can be used by the data team to analyze correlation between starter level and CommCare uptake/adoption.
As most users start to learn on the first day how to navigate a phone, the PTA is taken on paper and entered later on the phone by either FM, supervisor/trainer, or user itself after getting comfortable with the phone.
Part 1. Paper based PTA
Download the PreTrainingAssessment.doc, for the French version: fr_PreTrainingAssessment.doc.
Print enough for all users (print 1 or 2 extra)
Ask users to fill out individually and collect PTAs
Write on every PTA what the CommCare username is for the user
To enter this data into the system, you'll need to enter it into the app.
**Remember to login as the user who took the test each time!**
With the paper or electronic results, discuss the findings with the partner team. Identify if any trainees will need extra support, and if so, how to provide it. You can also identify the level that the group is at and if you need to readjust plans for the overall schedule. (speed of sessions, more coverage on certain topics, etc).
The PTE consists of 14 questions to evaluate the training and app as well as 8 phone/app knowledge questions. The PTE is administered at the end of the user training. The goal of the PTE is to evaluate the training and identifies to trainers which part should be more focussed on. It is recommended to prime users that the goal is to evaluate the training and trainers and not the individual users! Results can be used by the data team as well on aggregate level.
The PTE is taken directly on the phone through the app.
Download "version 1 of PTA and PTE" from the CommCare Exchange (Dimagi Staff: Go to the trainingsurveys project space)
Click on the form “Post Training Evaluation”
Go to “Advanced”
Download the XForm
Go to “Multimedia”
Click on “Download ZIP”
Go to the domain of your own application
Click on the ‘+’ to add a Module
Click on the ‘+’ to add a Form
Name the form “Post Training Evaluation” and hit “Save”
Go to “Advanced”
Upload the XForm that you just downloaded
Go to “Multimedia”
Click on “Multimedia Reference Checker”
Click on “Go to Bulk Upload”
Click “Select Files”
Select the MM file that you downloaded in part I above and click “Begin Upload”
Go do some burpees, it might take a while
Optional: Add a language/translations in case the users don’t understand any of the existing translations in the app (current translations are English, French, and Nyanja - for the Exchange only English)
Deploy a new build and download it on to the phones
Let all users submit their PTE and check through the form export or submission by form report if everyone did so.
Make sure you have module filtering set to 'on' under feature preview. Go to your project settings (click the orange button in the top right that has your project space name)
Go to "Feature Previews"
Tick the box for "module filtering"
Go back to your application in the application builder
Click on the "PTA PTE" module
Part 4. Review results and discuss with the partner
After training, either before you've left site or upon your first check-in call, discuss the results of the PTE. Highlight individuals who may need extra support and any overall trends for the group's uptake of the app. Walk the partner through any potential plans for addressing needs in the coming months.