SCOPE Work Package 7 Quality Management …

1 SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 2016 SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 2 Contents Acknowledgments 3 1. Introduction 4 Purpose of the document 4 Definitions and abbreviations 4 Background 5 2. Concepts 7 Compliance Management 7 Performance Management 7 Performance versus Compliance 7 3. Indicators 8 Key performance indicators (KPIs) 9 Key Risk Indicators (KRIs) 10 4. Examples of compliance and performance indicators 12 5.

2 Balanced Scorecard (BSC) a tool for monitoring performance and compliance indicators 21 6. Summary and conclusions 22 SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 3 Acknowledgments Authors Ana Sofia Martins, Magda Pedro, Margarida Guimar es SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 4 1. Introduction Purpose of the document The purpose of this document is to provide definitions and clear distinction between compliance and performance Management and to provide some examples of indicators.

3 It is at the discretion of each NCA whether to consider any examples presented in this document, if relevant and suit-able to their work methodologies. Definitions and abbreviations Terminology Description ADR Adverse Drug Reaction AR Assessment Report BSC Balanced Scorecard CAPA Corrective Action and Preventive Action EC European Commission EPITT European Pharmacovigilance Issues Tracking Tool EU European Union GVP Good Pharmacovigilance Practices HCP Healthcare Professional ICSR Individual Case Safety Report KPI Key Performance Indicator KRI Key Risk Indicator MAA Marketing Authorisation Application MAH Marketing Authorisation Holder MS Member State NCA National Competent

4 Authority NUI Non Urgent Information PASS Post-Authorisation Safety Study PSUSA Periodic Safety Update Single Assessment PV Pharmacovigilance QMS Quality Management system RA Rapid Alert SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 5 Terminology Description RMP Risk Management Plan SCOPE Strengthening Collaboration for Operating Pharmacovigilance in Europe WP work Package WHO World Health Organisation Background In the SCOPE (Strengthening Collaboration in Operating Pharmacovigilance in Europe) survey for work Package (WP) 7, National Competent Authorities (NCAs) were asked to provide information on their workflow tracking system used for pharmacovigilance (PV)

5 Purposes and to share their experience on compliance Management , including the type of indicators monitored, the fre-quency of compliance checks as well as the method of recording the results. As highlighted in the SCOPE survey report for WP7, from the responses of 26 Member States (MSs) given questions on workflow Management , it could be concluded that a fully functional workflow tracking tool or system for all PV processes was uncommon (only 7 NCAs ). Partial solutions are more widespread (12 NCAs ) and 7 NCAs ( ) do not have a workflow tracking system in place.

6 Integration of the workflow tracking tool with document man-agement is present in slightly more than half of the surveyed NCAs with a complete or partial tracking system in place. Compliance and performance Management are tightly coupled to workflow Management /track-ing because data feeding into such activities derives from the workflow by recording and evalu-ating pre-defined indicators of effectiveness and Quality . NCAs were asked to provide information on the most commonly monitored Quality attributes in association with PV activities.

7 The top three answers indicated the monitoring of (1) legally de-fined timelines, (2) the Quality and completeness of assessment and adverse drug reaction (ADR) reports, and (3) working hours spent on each activity. The responses given by MSs have demon-strated that there is a difficulty in distinguishing between compliance and performance indicators, as these concepts are linked but do not have the same content. One of the objectives of this document is to provide clear definitions on compliance and performance Management , as well as examples of indicators from NCAs.

8 SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 6 MSs indicated that data monitoring for compliance and performance checks were conducted both via manual and automated queries, with manual methods prevailing over automated tech-niques. The frequency of compliance (and performance) checks varied on a wide spectrum, being dependent on the characteristics of each process and activity, on how stable the process is and the controls already in place. All responding MSs indicated that there was some degree of Cor-rective Action and Preventive Action (CAPA) put in place and followed up until resolution of defi-ciencies.

9 This CAPA procedure was fully functional in 22 MSs ( ). SCOPE work Package 7 Quality Management Systems Compliance and Performance: Management and Indicators 7 2. Concepts Compliance Management Compliance is the fulfilment of a requirement defined in the legislation, guidelines and/or specific documents (for example, of the Quality Management system (QMS), contracts of outsourced services, etc.). From an outward look, compliance Management is about providing accountability for the perfor-mance of the PV department, risk Management and stakeholder engagement, in short having the appropriate systems in place to provide the required information in a timely manner and to the appropriate Quality standards.

10 From an inward perspective, compliance is related to monitoring and supervision. Reporting, analysis, ongoing review and corrective actions are steps that also contribute to achieving com-pliance. Performance Management Performance can be defined as the accomplishment of a given task measured against present known standards of accuracy, completeness, cost (human resources allocated), and speed (ful-filling deadlines). It includes the activities which ensure that goals are consistently being met in an effective and efficient manner.