Measuring Service Activity and Consumer Outcomes

Consumer Outcomes
Consumer outcomes are indicators of an individual’s or family’s health or well-being. Outcomes are measured by statements or observed characteristics of a consumer and/or family – not by characteristics of the service system. Outcomes evaluation is conducted with methods similar to research, but its primary purpose is to improve the effectiveness or the impact of services being delivered (Reference: Ohio Mental Health Consumer Outcomes, 2010)


Announcements
The original intention of the Ministry was to develop a suite of outcome measures under MH-SMART that reflected a range of consumer outcomes for different sub-groups of the population. To date, much of the work has been focused on the implementation of the Health of the Nation Outcomes Scale (HoNOS) into DHB clinical services.
Dr Janice Wilson, Deputy Director Population Health, Ministry of Health released a letter to the sector in May 2010 advising of some refinements to this approach. Refocused activity is based on sector feedback regarding implementation issues as well as the recommendations of an expert outcomes advisory group that was convened by Te Pou. The main point of interest for NGO providers is that the Ministry is no longer considering implementing a mandatory outcome measure for all NGOs and, is instead, emphasising the importance of NGOs improving their evaluative practice (with or without the use of outcome tools). (Link here to letter)
 

Outcome Measures
The community sector has for some years now raised questions about the way we understand and measure progress and effectiveness of services. How do we find ways to make visible and measurable the things that are essential to the quality of life and well being?

"How do you measure community activity?" - A paper presented to the Australia New Zealand Third Sector Research Conference Auckland November 2008

NZ National Outcome Measures still under consideration by the Ministry of Health:

  • Hua Oranga, a measure for Maori (currently being validated under the auspices of Te Rau Matatini)
  • ADOM, an alcohol and other drug outcome measure (still subject to further testing)

Other outcome measures that have been developed under the NZ National Mental Health Research and Development Strategy which are now available for general use:

  • Taku Reo Taku Mauri Ora – a consumer self assessment measure (available via Te Pou)
  • A Pacific people's measure

Other resources about outcome measurement:
NGO Outcomes Forum - Te Pou hosted a forum called ‘Are We There Yet? Destination Information Sharing – The NGO-DHB Experience'. February 2009. The forum profiled a number of NGOs that are already collecting outcome based information and featured significant NGO discussion about how we measure our community contributions (refer to the following link  http://www.tepou.co.nz/page/635-Outcome-forums+National-Outcomes-Forum-2009

Te Pou is the agency that runs a programme responsible for the development of strategies that will support local services (including NGOs) to manage and maintain ongoing training and skill development in the use of mental health information. (refer to. http://www.tepou.co.nz/page/612-non-government-organisations-ngos