This final report is the sixth report on Allen and Clarke’s evaluation of the Child Health Check Initiative (CHCI) and the Expanding Health Service Delivery Initiative (EHSDI). This full report is accompanied by a summary report. The evaluation has been undertaken independently and the interpretations, conclusions and recommendations in this report are those of the authors.
Previous reports include:
- the Evaluation Design Report (September 2009) that set out how we planned to address the evaluation objectives for the CHCI and the EHSDI, and proposed the methodology and process for the project as a whole3
- a Report on Workshop 1 (December 2009) that reported on the main issues and ideas that participants identified and discussed at the first workshop on the formative evaluation of the EHSDI
- the Report on Case Study Design (April 2010) that set out our plans for collecting, analysing and reporting on the case study element of the evaluation
- a Report on Workshop 2 (June 2010) that reported on the main issues and ideas that participants identified and discussed at the second workshop on the formative evaluation of the EHSDI
- a Summary of Feedback in Phase 7 report (January 2011) that includes the main comments and feedback received from key stakeholders during a series of meetings and presentations on the draft evaluation findings.
The remainder of this final evaluation report is structured as follows:
- Section 2 sets out our approach to the evaluation, and identifies the main evaluation questions, information sources and methods for collecting and analysing information. It also notes a number of strengths and limitations of the evaluation design.
- Section 3 sets the context for the evaluation by showing how the CHCI and the EHSDI sit within the wider Northern Territory (NT) primary health care (PHC) system.
- Sections 4 and 5 cover the main evaluation findings. They include both quantitative and qualitative findings (such as results of data analyses and evaluation of participants’ views and perceptions), and our interpretation of these findings. These sections answer the evaluation questions about the CHCI and EHSDI program activities or components.
- Section 6 draws together the main findings about the evaluation objectives of effectiveness, efficiency and appropriateness and the main issues affecting the sustainability of any future child wellness programs and the EHSDI reforms.
- Section 7 provides a synthesis of our evaluation findings, drawing out significant conclusions and recommendations. It includes some theoretical models designed to support future development, monitoring and evaluation of child wellness check programs and the ongoing program of reform of the NT PHC system.
- The Appendices provide further background details on the CHCI and EHSDI programs and our evaluation methodology.
Each one was used as a basis for information sharing and consultation with specific audiences. The purpose
of this was to:
- test and validate the findings against wider stakeholder perspectives
- increase understanding of the evaluation and the use of the findings
- improve the accuracy and use of the evaluation report
- review and refine any future evaluation plans.
1.1.1 Impact of the evaluation approach on this reportThe approach taken for evaluating the two programs differed. The CHCI was largely completed at the time of this evaluation; therefore the approach taken was summative. The EHSDI, on the other hand, was at an early stage of implementation and was an emergent program so we took a formative approach to its evaluation. The choice of evaluation approaches has not only affected the way we designed the evaluation, but also the way we have reported on it. We are able to report on the CHCI program, its effectiveness and impacts. For the EHSDI, we are reporting to the program to support continuous improvement in its ongoing implementation.
Box 1: Drafting process for this final evaluation reportThere have been three drafts of this final evaluation report:
- Draft 1 (August 2010) was disseminated to the Memorandum of Understanding (MoU) Management Committee and discussed with the evaluation partners, the Indigenous Advisory Group (IAG), the Northern Territory Aboriginal Health Forum (NT AHF), the Primary Health Reform Group (PHRG), regional PHC organisations and groups in the NT (such as regional steering committees (RSCs)), members of the Department of Health and Ageing (DoHA) senior executive and other relevant Australian Government departments.
- Draft 2 (January 2011) was disseminated to the MoU Management Committee.
- This report (March 2011) is the final version. It will be disseminated more widely and, subject to approval, made publicly available.
3 - Available at: http://www.allenandclarke.co.nz/assets/Reports/EDR-doc.pdfTop of page