The good indicators guide - NHS England

1 The Good indicators guide :Understanding how to use and choose indicatorsDAVID PENCHEON PageForeword21. Introduction32. indicators : some useful background53. The anatomy of an indicator94. Understanding variation135. Changing hearts and minds186. Frequently asked questions217. Criteria for good indicators and good indicator sets238. Ten myths about indicators289. Glossary3010. Further reading33 Appendix A: Full anatomy of an indicator351 Contents2 ForewordAs leaders, we have a responsibility toknow the essential data andinformation better than anyone need our teams and organisationsto be able to capture, interpret andcommunicate the essence of anysituation in order to make the rightdecisions at the right time.

2 Theindicators we use and choose thereforeneed to be carefully designed to bepractical, complete, valid and robust sowe can concentrate on those areas thatneed further investigation. In short, weneed to sort the wheat from the chaffin the information overload world wenow live in. This short guide focuses onthe key principles behind developing,understanding and using indicators . It is designed to be an essential andreadable guide to those in seniorpositions who may not always feelentirely comfortable with this importantarea in healthcare CrumpChief ExecutiveNHS Institute for Innovation andImprovement31.

3 What is this guidedesigned to do?This guide is intended to be a short,practical resource for anyone in anyhealth system who is responsible forusing indicators to monitor andimprove performance, systems oroutcomes. A guide this size can t giveall the answers to indicators . However,it can help you ask the if you are working with imposedmandatory indicators , you needto be sure that your measured performance isn t falling short ofwhat is really true, either becauseyou don t understand them orhow to make the best of them if you have a choice over whichindicator to use, or anopportunity to introduce a newindicator to your organisation you need to be competent inchoosing the ones that willgenuinely help you measure localsystems, services and reading this guide .

4 You should beable to assess the validity of theindicators you are working with,allowing you to exert more controlover the way your organisation isproperly judged, regulated, and all this is the reality thatanyone working in a health system isworking in a complex and politicalenvironment. This guide aims tobalance what is desirable in terms ofusing indicators in the most correctand most rigorous way, with what ispractical and achievable in Why focus on indicators ?Why devote a whole guide to justindicators? They are, after all, just onevery specific tool for measurement andimprovement (see definitions in theGlossary on page 30).

5 The answer is that we all love indicatorswhen they seem to summarise and bringsummary/simplicity, but not when theyjudge us, or something dear to us. It is then that we realise that people and organisations can be unfairlyIndicators are a fact of life for every NHS local authority, and socialcare organisation. For the most part, you will have little or no choiceover the indicators that are used to measure performance in yourorganisation. If you don t fully understand the indicators you have towork with; if you think they paint an inaccurate picture of howthings really are on the ground.

6 Or suspect they are fundamentallyflawed in some way you can find yourself locked into an unhappyrelationship with a performance measurement tool that you canneither challenge nor and rewarded on the basis ofindicators that may tell a wrong orincomplete think of it like this: of all thecomments from new non-executivedirectors that join the boards of healthorganisations, one of the mostcommon seems to How to use the guideThis brief guide is NOT the last word onindicators; nor is it designed to provideoff-the-shelf indicators for anyparticular service or Good indicators Guideshould beused alongside other related resourcesoffered by the National Health ServiceInstitute for Innovation andImprovement ( ),and the Association of Public HealthObservatories (APHO)( ), as well as realexamples from the Department ofHealth ( ), theInformation Centre ( ),the National Centre for HealthOutcomes Development( ), the HealthcareCommission( )and particular, you should read.

7 The NHS Institute s ImprovementLeaders Guides on Measurementfor Improvement and APHO s Annual Health And if you read hope is that the guide is shortenough and important enough to beread right through. However, there aresome key sections that will be useful bythemselves especially as quick-reference resources you can revisit. These are: section 2. indicators the importantprinciples (page 5) and section 7. Criteria for goodindicators and good indicator sets.(page 23).If you only read two sections from thisguide, read these! How can we ensure that theorganisation is actually doingwhat it says it is doing?

8 Because we use good indicatorsto measure the right things andfeed these with the best data wecan get. The answer should be; What are indicators , and why are they soimportant? indicators are succinctmeasuresthat aim to describeas much abouta system as possible in as few pointsas possible. indicators help us understandasystem, compareit and are extremely importantforms of measurement, but they canalso be controversial (see below). Like all powerful tools, they can easilydo as much harm as good. The world is becoming a moretransparent and competitive place,where people want instant summaryinformation.

9 indicators appear to fitthis need and are therefore becomingan increasingly important part of howeverybody The three key roles ofmeasurementIndicators, like many other forms ofmeasurement, can be used in threebroad ways:1. for understanding: to know how asystem works and how it might beimproved (research role) 2. for performance: monitoring if andhow a system is performing to anagreed standard (performance/managerial/improvement role)3. for accountability: allowing us tohold ourselves up to patients, the government and taxpayers and beopenly scrutinised as individuals, teams and organisations(accountability/democratic role).

10 Why are people suspiciousand mistrustful towardsindicators?Mistrust and ambivalence towardsindicators is hardly surprising whenconsidering what they are designed todo. While they play an increasinglyfundamental role in monitoring ourperformance, they can only everindicateand summarisethe complexsystems in which we indicators : some useful backgroundObjectives of this section: to help you understand why indicators have assumed such importance to explore why indicators cause so much anxiety and resentment to discuss the different ways indicators can be A particularhospital has a high death rateamongst its patients.