ºÚÁÏÕýÄÜÁ¿ Note: This great article summarizes what many providers in NY are going through now, particularly with all the talk of moving to an outcome-oriented managed care system for behavioral health services. As Monica Oss points out, systemic fixes to the problem of measurement fatigue may be essential, but we cannot wait for them. Not only that, but that set of recommendations hinges on a policy environment that would have to compliment each of the reforms in turn before meaningful reform could bear change in practice. Sometimes, the easiest way to simplify the measurement strategy of your agency, is by grabbing that old fashioned pencil and paper and sketching out your capacity and your needs.
Ìý
Are You Suffering From Measurement Fatigue?
Open Minds; Monica E. Oss, 3/20/2015
Developed by OPEN MINDS, 163 York Street, Gettysburg PA 17325, .Ìý All rights reserved.Ìý
You may not alter, transform, or build upon this work. You may not use this work for commercial purposes without written permission from OPEN MINDS.
Ìý
Measurement fatigue. That’s the phrase used in , a recent article in The New England Journal Of Medicine (NEJM) to describe the proliferation of measures in the health and human service field.
What does this proliferation look like? There are well over 1,600 federal quality measures spread out over 33 programs – and an untold number of state, local and private health plan measures – according toÌýÌýthat appeared in a recent issue of The Wall Street Journal. No wonder managers are looking a bit perplexed.
What are these measures? Here are just a short list of some of the organizations that either gather heath care performance measures or recommend them:
- National Committee For Quality Assurance (NCQA) – see and and
- National Quality Forum (NQF) – see and
- Centers for Medicare and Medicaid Services (CMS) Five Start Rating System – see ,, and
- CMS Medicare Accountable Care Organization (ACO) Shared Savings Program – see , , and
- Agency for Healthcare Research and Quality (AHRQ) – see and .
No wonder there is measurement fatigue. The NEJM article succinctly summarized the problem:
The current measurement paradigm…does not live up to its potential. Many observers fear that a proliferation of measures is leading to measurement fatigue without commensurate results. An analysis of 48 state and regional measure sets found that they included more than 500 different measures, only 20% of which were used by more than one program… Similarly, a study of 29 private health plans identified approximately 550 distinct measures, which overlapped little with the measures used by public programs… Beyond the problem of too many measures, there is concern that programs are not using the right ones.
As a solution, the New England Journal Of Medicine authors outline how stakeholders can help reshape the measurement framework in health and human services:
- Clinicians – Develop and implement measures relevant to your practice, explore data to find opportunities for improving care, and build the necessary data-collection infrastructure.
- Consumers – Call for transparent quality measurement and reporting, and participate in efforts to collect patient-reported outcomes information.
- Payers – Align with other payers on a smaller required set of high-impact and outcome-oriented measures.
- Tech vendors – Establish the electronic building blocks for measures (rather than constructing and specifying measures one by one).
- Measure developers – Accelerate the development and endorsement of measures to fill critical gaps, and in high-priority areas, allow for rapid feedback and adaptation to respond to any unintended consequences or changing evidence.
- Hospitals and health systems – Invest measuring and understanding health at the population and community levels, with a focus on metrics that may stretch beyond the clinical encounter within the health system walls.
- Researchers – Produce the next generation of research in the science of measurement development and implementation, including risk adjustment, attribution methods, and defining episodes of care; monitor for unintended consequences and adjust measures accordingly.
- Employers and purchasers – Purchase health care on the basis of meaningful, actionable quality and cost measures, focused on outcomes and team- and system-level performance.
That’s great advice, but what to do in the meantime?Ìý I have some very simple (but hard to execute) advice for managers of health and human service organizations:
- Start with aÌýblank sheet of paper and forget about whatÌýyou are measuring nowÌýand how.
- Separate your compliance measurement requirements (what funder orÌýregulators require you to measure), from your performance management measurement needs.
- Create a grid of your compliance measurement requirements, and figure out how to measure those items in the most inexpensive way (you should also create an estimate of the cost of those measurements – which should be incorporated in your future costing and pricing models).
- For your team’sÌýperformance measurement needs, use a structured approach to mapping out what you need and how make that information available to your team.ÌýStart with the performance measurements you need at each level/business unit of the organization; for each, determine whether they are a leading/actionable performance measurement indicators and whether they are currently automated in your system.
- From an implementation perspective, leading indicators that are currently automated are high priority.ÌýAnd, leading indicators that are not automated need an ROI analysis.
For a very cool tool to compare the many measurement sets, check out NQF’sÌý,Ìýa new tool that provides insight to those interested in starting or expanding measurement and reporting efforts in ways that align with others and key national programs.
We have great resources on the development of key performance indicators – see and . For more, join me on October 26 for the executive development workshop, , before The 2015 OPEN MINDS Technology & Informatics Institute.
Ìý