Measures for Success: Lessons Learned from …

1 PSMCRS Software and Systems MeasurementPSM - IFPUG, 1 PSM All rights for success : Lessons Learned from applying PSMP ractical Software and Systems MeasurementObjective Information for Decision MakersDepartment of Defense US ArmyPractical Software and Systems MeasurementPSM - IFPUG, 2 PSM All rights Principles Measurement Is a Consistent but Flexible Process that Must Be Tailored to the Unique Information Needs and Characteristics of the Project or Organization Decision Makers Must Understand What is Being Measured and Trust the Information Measurement Must Be Used to be MeaningfulPSMCRS Software and Systems MeasurementPSM - IFPUG.

2 3 PSM All rights - ISO Standards - CMMIP ractical Softwareand Systems MeasurementISO/IEC SC7 Standards12207(revision - supporting process)15288 (measurement concepts)9126 (terminology coordinated)14598(terminology coordinated)-----ISO/IEC 15939, Software Measurement ProcessCMMIM easurement and AnalysisPractical Software and Systems MeasurementPSM - IFPUG, 4 PSM All rights Management Requires Measurement Information to Support Critical Project and Organizational Business and Technical Decisions Measurement Results Must Be Communicated and Used Across the Entire Corporate Entity Measurement Results Must Be Incorporated with Risk Management and Context InformationPSMCRS Software and Systems MeasurementPSM - IFPUG, 5 PSM All rights but Flexible ProcessPractical Software and Systems MeasurementPSM - IFPUG.

3 6 PSM All rights ActivitiesCore Measurement ProcessInformation NeedsEvaluateMeasurementImprovementActio nsAnalysisResults and Performance MeasuresScope of PSMUser FeedbackAnalysis ResultsEstablish andSustain CommitmentPlanMeasurementPerformMeasurem entTechnical and ManagementProcessesMeasurement Plan NewIssuesPSMCRS Software and Systems MeasurementPSM - IFPUG, 7 PSM All rights Measurement Measures Are Defined to Provide Insight into a Project or Organization s Information Needs by-Identifying what the decision makers need to know-Relating these to entities that can be measured-Selecting and specifying Measures based on project and organizational processesPractical Software and Systems MeasurementPSM - IFPUG, 8 PSM All rights Categories Schedule and Progress Resources and Cost Product Size and Stability Product Quality Process Performance Technology Effectiveness Customer SatisfactionPSMCRS Software and Systems MeasurementPSM - IFPUG.

4 9 PSM All rights Measurement - Lessons Learned Start by Implementing a Small Set of Measures -Reduces the level of change, resources required, and impact on the workload-Add additional Measures later, incrementally The Measurement Plan Should Specify Both What Will be Measured and How the Process Will WorkPractical Software and Systems MeasurementPSM - IFPUG, 10 PSM All rights Measurement RequirementsEnterprise ManagementOrganizationalManagementProjec tManagementPerformance MeasurementNormative Performance BaselinesTechnical and Business PolicyInvestment Decisions & AnalysisProcess ImprovementProject Planning GuidelinesPerformance Based GuidelinesOrganizational Norms & BenchmarksProject Estimation & PlanningProject Performance TrackingProject Tradeoff AnalysisResource ManagementRiskManagementProcessInformati on - DrivenMeasurement ProcessPSMCRS Software and Systems MeasurementPSM - IFPUG.

5 11 PSM All rights Measurement - Lessons Learned (cont). Workshops Are Good For Defining Information Needs Allow Tailoring of Organizational Measures Successful Measurement Programs Integrate the Needs of all Decision-Makers-This simplifies data collection and reduces duplicationPractical Software and Systems MeasurementPSM - IFPUG, 12 PSM All rights Measurement Collecting Measurement Data, Performing Analysis, and Presenting Results Analysis Can Include Estimation, Feasibility Analysis of Plans, and Performance Analysis of Actual Data Against PlansPSMCRS Software and Systems MeasurementPSM - IFPUG.

6 13 PSM All rights Analysis ModelTechnology EffectivenessProcessPerformanceProduct Size and StabilityResourcesand CostSchedule and ProgressProductQualityCustomer SatisfactionPractical Software and Systems MeasurementPSM - IFPUG, 14 PSM All rights - EffortEstimating , , KFunction PointsStaff Month-1 Standard DeviationProject: PSMData as of 31 Mar 98+1 Standard DeviationAverageProject under considerationMeasurement Feasibility AnalysisPSMCRS Software and Systems MeasurementPSM - IFPUG, 15 PSM All rights Learned - Perform Measurement Automate Data Collection Whenever Possible It Take About 6 to 9 Months to Establish Measures -Initial focus is on ensuring data is provided-Next focus in on data problems-After these are resolved, focus can move to performance issues Clearly Identify the Reporting Mechanisms at Both the Project and Organizational Levels Aggregation Approaches Need to be Specified.

7 Especially When Measures Are TailoredPractical Software and Systems MeasurementPSM - IFPUG, 16 PSM All rights and Sustain Commitment Includes Establishing the Resources, Training, and Tools to Implement a Measurement Program Effectively and Ensuring Commitment to Use the Information that is Produced Need to have Commitment Reinforced and Demonstrated Regularly Need to Adopt an Action OrientationPSMCRS Software and Systems MeasurementPSM - IFPUG, 17 PSM All rights Support for Measurement The Resulting Culture Shock from Implementing any new Process causes a Natural Reaction of Personal Resistance-Overcome resistance to change Provide the Participants with an Understanding of the Measurement Process and the Benefits to Their Projects-Training programs should help project representatives identify information needs and Measures -Planning workshops should include representatives at all levels of the organizationPractical Software and Systems MeasurementPSM - IFPUG.

8 18 PSM All rights Learned - Evaluate Measurement Both the Measurement Process and the Specific Measures Should be Periodically Evaluated and Improved Measurement is an Iterative Process: the Measures are Refined as Information Needs Change and the Organization Implements Improvement ActionsPSMCRS Software and Systems MeasurementPSM - IFPUG, 19 PSM All rights and Trust Measurement InformationPractical Software and Systems MeasurementPSM - IFPUG, 20 PSM All rights Model: High-Level ViewAdapted from ISO/IEC 15939 - Software Measurement ProcessInformationProductInformation NeedMeasurementConstructMeasurableConcep tAttributeEntityPSMCRS Software and Systems MeasurementPSM - IFPUG, 21 PSM All rights Construct - LevelsInformationProductDerivedMeasureIn dicatorBase MeasureAttributeMeasurement ConstructPractical Software and Systems MeasurementPSM - IFPUG.

9 22 PSM All rights or Evaluation thatProvides a Basis for DecisionMaking-Operations Quantifying anAttribute Against a ScaleIndicatorDerived MeasureDerived MeasureBaseMeasureAlgorithm Combining Two or More Base Measures A measure of a Single AttributeBy a Specific Method Quantity Defined as a Function ofTwo or More MeasuresAlgorithm Combining Measures and Decision CriteriaMeasurementFunctionEntitiesInfor mation NeedsAdapted from ISO/IEC 15939 - Software Measurement ProcessBaseMeasureInterpretationAnalysis ModelInformationProductAttributeAttribut eProperty Relevant to Information NeedsMeasurement ConstructPSMCRS Software and Systems MeasurementPSM Version.

10 23 Measurement Construct - ProductivityAnalysisModelCompute Mean and StandardDeviation for Historical ProjectCompared to Estimate for newProjectsAdjusted Mean and TwoStandard Deviation Confidence LimitsAT T R IB UT E SBASE MEASURESINDICATORSDERIVED MEASURESC ount TotalHoursCount SemicolonsDivide SizeBy Effort Repeat for Each Historical ProjectValue for Project XValue for Project XValue for Project XProject X Actual ProductivityMeasurementFunctionSizeProje ct XMeasurementMethodMeasurementMethodCount TotalHoursCount inputs, outputs, inquires, files, and interfacesDivide SizeBy Effort Repeat for Each Historical ProjectValue for Project XValue for Project XValue for Project XProject X Actual ProductivityMeasurementFunctionSizeProje ct XSourceCodeSemicolonHoursTimecardsFuncti on PointsHoursTimecardsMeasurementMethodMea surementMethodValue for Project XValue for Project XSizeProject XValue for Project XValue for Project XSizeProject XCount TotalHoursDivide SizeBy Effort Value for Project YValue for Project YValue for Project YProject X Actual ProductivityMeasurementFunctionSizeProje ct XMeasurementMethodMeasurementMethodCount TotalHoursDivide