Safety Performance Indicators (SPI) Safety Performance ...

1 Safety Performance Indicators (SPI) Safety Performance Targets (SPT)and MeasuringCriteria29th March, 2017 Jorge LeiteVP Quality& SafetyTAP maintenance & EngineeringIt sgreattohavereliableIndicatorswhenwearec oncernedaboutSafety29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & Engineering29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSafety Management March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSafety Risk Management TheSMSissupposedtodoonesimplething:..toa llocateresourcesagainstrisk29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & , , Performance Indicators29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringICAO Annex19 Safety ManagementAppendix2. Framework for a Safety Management System(SMS) Performance monitoringand SPIs29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringICAO Annex19 Safety ManagementChapter1. DefinitionsSafetyDefinitionsSafety performanceSafety Performance indicatorSafety Performance targetsafetyachievementasdefinedbythesaf etyperformancetargetsandsafetyperformanc eindicatorsdata-basedparameterusedformon itoringandassessingsafetyperformanceplan nedorintendedobjectiveforsafetyperforman ceindicator(s)overagivenperiod29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSPTsHazardIdentificationSafet y ImprovementRisk ManagementSafety Performance DemingCycleSPIs29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSPIsaredata-basedparametersth atmeasurecertaincharacteristicsaboutoccu rrences,events,incidents,accidents, sSMSA lignedwiththesafetytargetsThat(really) assesssafetyperformance Obvious Linkedtosafetyconcerns Trackingsignificantissues Short-term(tactical) Medium-term(strategic)

2 Measurable Numericalwheneverpossible29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringValidReliableSensitiveReprese ntativeResistantto biasCost-effectiveValidatinga usefulSPII tmeasureswhatwewantto measure, wellcorrelatedItisresponsivetochanges,st atisticallysignificant,shorttimedItcover sallaspectsthatarerelevantItisnotpossibl etomanipulateItcostsnotmorethanitgivesba ckItisnotdependentonconditions,situation s,individuals29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSPIsusedatTAPM&Eareclassified inthefollowing3categories, :TypesofSPIO rganizationalSPIs Monitorsafetyobjectivesandsafetytargets Monitorrisklevel Controlimpactonsustainability,competitiv enessandimage Controlimpactonratingsandinsurancecosts AssesscontingencypreparednessandMoC Controlsuppliersandproviders29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringTypesofSPI (cont.)SSP-connectedSPIs Assurecompliance SatisfyStatesafetygoals MeetpublicexpectationsandEUvisionCustome rrelatedSPIs Assurecontractualsafetycompliance Satisfycustomer ssafetygoals Enablecontinuouscontractmonitoring Providecompetitiveedgeanddifferentiation 29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringLaunchinganSPII nrelationtoeachSPIchosen,thefollowingche ck- March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringSourcesofdata for SPIsReactiveanalysisofpasteventsandoutco mesProactiveanalysisofpresentandreal-tim eeventsPredictiveforecastfutureeventsoro utcomes ASR,VOR,MOR,SAFA Hazardidentification Incidentandaccidentreports Safetyinvestigations ASR,VOR Surveys,audits Compliancemonitoring Improvementplans FDM,reliabilityanalysis Processesmonitoring Trendfollowing Statitisticalanalysis29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringExampleSPIs.

3 PartM (CAMO) (target)Tolerable (alert level)Not Acceptable1 ACCO perationalAccidentsAccidents due to maintenance , p/Y0>012 TIRO perationalTIRT echnical Incident Reports, p/106FH, Curr<11-2>23 ISDO perationalIFSDE ngine Inflight Shutdowns, p/104FC, Curr<11-2>24 MELO perationalMEL ExtensionsRequested extensions for MEL items, p/Y<1010-13>135 ADIO perationalAD IrregularitiesAirworthiness Directives irregularities, p/Y<11-2>26 RSKO perationalRisk LevelAverage risk level determined for all occurrences, CurrLowMinimal>Minimal7 UERM aintenanceEngine RemovalsUnscheduled Engine Removals, p/Y <22>28 CONM aintenanceConvenience RemovalsComponentremovalsfor convenience, p/Q<8080-100>1009 EEFM aintenanceEmergency Equipment FailuresFailuresin emergencyequipmentduringprogrammedtests, p/Q<2%2%-5%>5%10 VORO perationalVoluntary ReportsVoluntary Occurrence Reports, p/Y>8060-80<6029 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringExampleSPIs: Part145 (MRO) (target)Tolerable (alert level)

4 Not Acceptable1 ACCO perationalAccidentsAccidents due to maintenance activity, p/Y0>012 SNGO perationalSnagsOperational snags due to maintenanceactivity, p/M<1010-15>153 RSKM aintenanceRiskLevelAverage risk level determined for all occurrences, CurrLowandMinimalModerateHighandVeryHigh 4 VORM aintenanceVoluntary ReportsVoluntary Occurrence Reports, p/Y>500400-500<4005 UIDM aintenanceUnintendedDamagesUnintendeddamagesduringmaintenanceactions, p/Q<55-7>76 EEFO perationalEmergency Equipment FailuresFailuresin emergencyequipmentaftermaintenance, p/Q<5%5%-10%>10%7 CANL ogisticsCanibalizationsNumber of canibalizations, p/Q <200200-250>2508 CLDR eputationalClaims/DisputesClaimsanddispu tes withcustomersdueto safetyissues, p/S<22-3>39 SUPL ogisticsSuppliersClaimsanddisputes withsuppliersdueto safetyissues, p/Q<55-8>829 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringHard factsaboutSPIs ThereisnosingleSPIapropriatetoallorganiz ations ChosenSPIsshouldcorrelatetorelevantsafet yobjectives Itisdifficulttochoosegood(andfew)SPIs It seasytoendupwithalotofindicators Inreality,theymayfailtogiveaccuratetrend information Registeredinthesafetylibrarywithrelevant information29 March 2017 SASS 2017 Jorge Leite @ TAP maintenance & EngineeringThankyou!

5 Jorge LeiteTAP maintenance & EngineeringVP Quality and March 2017 SASS 2017 Jorge Leite @ TAP maintenance & Engineering