Test Readiness Review Purpose - AcqNotes

1 Test Readiness ReviewPurposeThe Test Readiness Review process described below is an extract of the overall Software QualityAssurance process outlined within the SQA Plan (SQAP), paragraph The Purpose of theTest Readiness Review is to provide management with the assurance that the software hasundergone a thorough test process and is ready for turnover to the next test phase. The scopeof the Test Readiness Review is to inspect the test products and test results from the completedtest phase for completeness and accuracy, and to verify that the test cases, test scenarios, testscripts, environment, and test data have been prepared for the next test of the test teams contributing to an application release will hold Test Readiness Reviews fortheir application.

2 All test teams contributing to an application release will hold Test ReadinessReviews with the Enterprise Test Organization at the time that the application is ready forintegration into the ReviewsInformal reviews may or may not include a formal meeting, but are subject to the same reportingrequirements as described below for formal reviews. An SQA process Review of the TRR ReviewsFormal Test Readiness Reviews will be held for each application of a release at the completion ofthe Software Integration Test, and at the completion of the Functional Validation Test.

3 AnImplementation Readiness Review will be held by the Enterprise Test Organization at thecompletion of the Enterprise Acceptance Test and Operational of Test Readiness ReviewsThere are three (3) levels of Test Readiness Reviews at the application level as defined below:1) Development Test Readiness Review informal test Readiness Review conductedfollowing successful completion of unit / module testing of a given ) Project Test Readiness Review formal test Readiness Review conducted followingsuccessful completion of the Software Integration Test (SIT) of a given ) Enterprise Test Readiness Review formal test Readiness Review conducted followingsuccessful completion of the Functional Validation Test (FVT)

4 Of a given is one level of Test Readiness Review conducted at the Enterprise level, and anImplementation Readiness Review following Enterprise testing as defined below:1) Acceptance Test Readiness Review formal test Readiness Review conducted followingsuccessful completion of the Enterprise Integration Test and Performance Test of eachDCII ) Implementation Readiness Review formal Review conducted following successfulcompletion of the Enterprise Acceptance Test and portions, if not all of the OperationalAssessment at the Enterprise level for a given DCII Readiness Review ParticipantsKey participants for each of the Test Readiness Reviews are defined below.

5 1) Development Test Readiness Reviewa) DCII Test Directorb) Technical Project Officerc) Application Test Managerd) Project SQA Representatives2) Project Test Readiness Reviewa) DCII Test Directorb) Technical Project Officerc) Functional Project Officerd) Application Test Directore) Application Test Managerf) Enterprise Test Directorg) Test Integratorh) Certifying Subject Matter Expertsi) Project SQA Specialists3)Enterprise Test Readiness Review and Acceptance Test Readiness Reviewa) Program Managerb) DCII Test Directorc) Technical Project Officerd) Functional Project Officere) Application Test Directorf) Enterprise Test Directorg) Test Integratorh) Certifying Subject Matter Expertsi) Operational Assessment Test Managerj) Project SQA Specialists4)Implementation Readiness Reviewa) Program Managerb) DCII Test Directorc) Enterprise Test Directord) Test Integratore) Certifying Subject Matter Expertsf) Operational Assessment Test Managerg) Project SQA SpecialistsCertifying Subject Matter ExpertsThere are several categories of certifying Subject Matter Experts relating to the DCII.

6 They areas described below:1) FFMR Certifying Subject Matter Experts:Certifying Subject Matter Experts (SMEs) comprise of representatives from theAccounting Firm(s) of KPMG and Arthur Andersen that have been contracted to verifycompliance of the Federal Financial Management Requirements that prescribes thepolicies and standards for federal agencies to follow in developing, operating,evaluating, and reporting on financial management ) DII COE Certifying Subject Matter Experts:The Defense Information Infrastructure (DII) Common Operating Environment (COE)certifying Subject Matter Experts (SMEs) comprise of representatives that have beenempowered to test, validate, and certify that the DCII is compliant with the DII CommonOperating Environment Integration and Runtime Specification, DII Common OperatingEnvironment Software Quality Compliance Plan, DoD Joint Technical Architecture, DoDTechnical Architecture Framework for Information Management, and User InterfaceSpecification for the Defense Information )

7 Security Certifying Subject Matter Experts:Security Certifying Subject Matter Experts comprise of representatives appointed toensure compliance of the Minimum Security Requirements List (MSRL) of the and ResponsibilitiesOne of the keys to an effective formal Review is in assigning and maintaining roles for eachparticipant. At a minimum each formal Review must be attended by a Review coordinator,presenter, meeting recorder, SQA specialist, and CoordinatorThe Review coordinator is a key player in all reviews and conducts all Review meetings. Thereview coordinator is not the author of the product being reviewed, but should have theknowledge and competence to participate fully as a reviewer.

8 The major functions of the reviewcoordinator are to:1) Be responsible for all up front ) Verify that the reviewers are properly prepared by determining if each reviewer isfamiliar with the Review products. The Review is to be re-scheduled if the reviewers arenot fully ) Notify all Review participants of the Review date, time, and ) Start the meeting on ) Keep reviewers focused on the test product being reviewed. The Review coordinatorkeeps the reviewers focused on finding deficiencies, not necessarily fixing ) Act as a reviewer and participate in the group ) Ensure the checklist(s), Action Item Notices, and the summary reports are Review coordinator will work with the SQA group to perform follow-up on Review is of the test products and test results, not the presenter.

9 The major functions of thepresenter are to:1) Provide an overview of the product being ) Be present at the Review for ) Make corrections to the test product as necessary after the RecorderThe recorder will log all deficiencies on the Review Checklist and Action Item Notice sheets. Themeeting recorder may also be a reviewer and may contribute to the group discussion. Themeeting recorder will be responsible for distributing the summary report to all Review SpecialistsThe SQA specialist will Review the test products and activities to ensure compliance with the SQAplan and identified standards.

10 The SQA specialist will track action items found during the TestReadiness Review to closure, and the results are added to the SQA metrics repository. The SQAspecialist will make regular reports to the DCII SQA staff specialist, Program Manager, and DCIITest Director as per the procedures outlined in paragraph of the represent those responsible for the level of software or system testing applicable forthe Review . Reviewers will devote sufficient time in preparation. This includes reviewing the testproducts from the test phase, certifications, test results, and test reports.