The overall objective of the Evaluation was to inform the evidence base for future policy direction and implementation of suicide prevention activity, and to put in place a comprehensive evaluation framework for ongoing use. This Report provides an analysis of the appropriateness, effectiveness and efficiency of NSPP-funded projects from 2006 to 2013.
The initial retrospective evaluation of the projects encountered many data limitations that were addressed through obtaining more comprehensive data about project activities from the MDS (Chapter 6 and Appendix C) and through in-depth consultations with key stakeholders. Direct engagement with funded organisations has been one of the strengths of the current Evaluation and differentiates it from prior evaluations where such engagement was not possible.
As a result, this Evaluation represents the most extensive evaluation of NSPP-funded activities to date, and provides government with a solid foundation upon which to base future program-related decisions. Data derived from the MDS has been particularly valuable in this regard. Prior to the implementation of the MDS, existing project data could only be used to generate a broad overview of project activities. While areas of activity could be established, the scale of this activity was absent. Likewise, a refined analysis of activities could not be undertaken including participant demographics, target groups, and referral pathways, for example.
This Report is based on MDS data for only a six month period (October 2012-March 2013), however the 16,222 individual client contacts/activities and 2,428 group activities recorded for that period provides an essential baseline for future measures. The Department's decision to extend MDS data collection for a further 12 months to May 2014 means that comparable data on NSPP-funded activities will ultimately be available for a 20-month period.
Despite these achievements and advances, information gaps still remain. This is particularly true in relation to outcome measurement. While the MDS has contributed greatly to the process evaluation of the NSPP, outcome measurement represents the next major frontier for NSPP evaluations. Without outcome measurement, the question of 'what works for whom in what circumstances, in what respects, and how' remains unanswered. So too do questions of economic efficiency.
Consequently, at this time it is not possible to assess whether alternative configurations of suicide prevention activities funded under the NSPP would be beneficial. This Evaluation found that the current community-based approach appears to be responsive to local need. However the absence of outcome measurement has impeded comparison of this approach with potential alternative future strategies, such as:
- Smaller number of larger programs
- Different mix of larger and smaller programs
- Delivering services and influencing behaviour through online mediums, including social media.
Such a task is beyond the remit of individual funded organisations. Although this would represent an additional cost to government, the returns in terms of national consistency in measurement and comparability across projects would be great. Importantly, it would provide the information on which to base decisions about which projects should be continued, expanded upon, refined or eliminated; something which this current evaluation lacks the outcome data to do. Incorporation of appropriate outcome measurement would also enable learnings from the NSPP to inform the international evidence base.
Nonetheless, despite these information gaps at project level, this Evaluation provides important insights for decision makers. Recent evidence of what works is summarised and consolidated in the literature reviews, while the extent of community support for NSPP projects serves as a strong indicator of the perceived appropriateness of suicide prevention activities at local level.
1.7.1 Concluding observations
The social and environmental factors related to suicide are complex and dynamic. As a result, outcome measurement will need to evolve as new risk and protective factors are identified and new programs and initiatives are implemented in response. Key emerging areas include the impact of social media and the internet on suicide and self-harm risk. These impacts may be negative (eg, through exposure to methods of self-harm or suicide) or positive (as a medium for service provision for some groups). Age appropriateness of social media and the internet as modes of service delivery will need to be considered, particularly where older age cohorts are involved.Policy and funding changes also add to the dynamic landscape of suicide prevention in Australia. The introduction of Australia’s first National Aboriginal and Torres Strait Islander Suicide Prevention Strategy is one such example. With this development comes the question of whether projects targeting Aboriginal and Torres Strait Islander populations are now more appropriately the domain of the new Strategy rather than the NSPP. This highlights the need to regularly review the range of projects that remain under the NSPP, as policy and funding changes occur.
Going forward, organisations funded to undertake suicide prevention activities, the government funding these activities and ultimately those at risk of suicide, can mutually benefit from the opportunities for program improvement identified in this report.