The objectives of PHO’s process implementation evaluation are:
- To assess the extent to which the Healthy Kids Community Challenge (HKCC) program is:
- reaching its target audience within and across HKCC communities
- adopted as planned within and across HKCC communities
- implemented as planned within and across HKCC communities
- maintained over the course of the intervention, including plans to sustain these initiatives in the long-term
- To understand multi-level factors contributing to HKCC program implementation at the program, community and provincial levels.
The process implementation evaluation includes five data collection activities that seek to answer the above questions. A separate evaluation is being planned for the six Aboriginal Stream HKCC communities. (See Evaluation of the HKCC in Aboriginal Stream Communities).
Outcomes Evaluation Activities
1. Theme-based Action Plans and Project Activity Reports
In order to evaluate the progress of HKCC intervention implementation at the community-level (i.e., program adoption), theme-based action plans will be assessed approximately every 9 months, and project activity reports will be assessed semi-annually after the program launch.
2. Local Project Manager Training Survey
A paper-and-pen survey will be administered to Local Project Managers (LPMs) before and after in-person training sessions held by the Ministry of Health and Long-Term Care. The purpose of this survey is to understand the usefulness of training sessions provided to LPMs, and the level of knowledge or skills acquired during training.
3. Local Steering Committee Survey
An online survey will be distributed to Local Steering Committee (LSC) members via Local Project Managers (LPMs) annually after the program launch. This survey aims to explore key stakeholders’ knowledge, attitudes and practices as they relate to the intervention, and perceptions of the implementation process.
4. Local Steering Committee Interviews
A sample of Local Steering Committee (LSC) members will be interviewed by either face-to-face or telephone interviews, depending on feasibility. The purpose of these interviews is to provide a deeper understanding of the results from the LSC Survey regarding implementation of the HKCC program.