Administrative Changes to AFI 99-103, Capabilities-Based ...

1 BY ORDER OF THE AIR FORCE INSTRUCTION 99-103. SECRETARY OF THE AIR FORCE. 6 APRIL 2017. Test and Evaluation Capabilities-Based TEST AND. EVALUATION. COMPLIANCE WITH THIS PUBLICATION IS MANDATORY. ACCESSIBILITY: Publications and forms are available for downloading or ordering on the e-Publishing website at RELEASABILITY: There are no releasability restrictions on this publication. OPR: AF/TEP Certified by: AF/TEP. (Col Hans Miller). Supersedes: AFI99-103, 16 October 2013 Pages: 113. This publication implements Air Force Policy Directive (AFPD) 99-1, Test and Evaluation Process. It describes the planning, conduct, and reporting of cost effective test and evaluation (T&E) programs as an efficient continuum of integrated testing throughout the system life cycle. This AFI implements the policies in Department of Defense Directive (DoDD) , The Defense Acquisition System, and DoD Instruction (DoDI) , Operation of the Defense Acquisition System (collectively called the DoD 5000-series); and Chairman of the Joint Chiefs of Staff (JCS) Instruction (CJCSI) , Joint Capabilities Integration and Development System.

2 This AFI must be used in conjunction with AFPD 10-6, Capability Requirements Development (and the associated AF/A5R Requirements Development Guidebooks), AFI 63- 101/20-101, Integrated Life Cycle Management, AFI 17-101, Risk Management Framework (RMF) for Air Force Information Technology (IT), DoDI , Interoperability of IT, including NSS, 21 May 2014; and AFGM2015-33-03 (and AFI that will replace it). Interoperability & Supportability of Air Force (IT/NSS), 23 July 2015. The Defense Acquisition Guidebook (DAG) contains non-mandatory guidance. This instruction applies to all Air Force organizations, including the Air National Guard, Major Commands (MAJCOM), Direct Reporting Units (DRU), and Field Operating Agencies (FOA). This instruction applies to all Air Force acquisition projects and programs regardless of acquisition category (ACAT). The authorities to waive wing/unit level requirements in this publication are identified with a Tier ( Tier-0, Tier-1, Tier-2, Tier-3 ) number following the compliance statement IAW AFI 33-360.

3 Submit requests for waivers through the chain of command to the appropriate Tier waiver approval authority, or alternately, to the Publication OPR for non-tiered compliance items. 2 AFI99-103 6 APRIL 2017. Waivers to mandates involving the acquisition program execution chain are processed in accordance with the acquisition chain of authority as specified in AFI 63-101/20-101. Any organization supplementing this instruction must send the proposed document to AF/TEP: for review prior to publication. Ensure that all records created as a result of processes prescribed in this publication are maintained IAW. Air Force Manual (AFMAN) 33-363, Management of Records, and disposed of IAW Air Force Records Disposition Schedule (RDS) in the Air Force Records Information Management System (AFRIMS). SUMMARY OF Changes . This document has been extensively rewritten and should be read in its entirety.

4 It incorporates multiple Changes resulting from the 7 January 2015 release of DoDI and other DoD. directives and instructions since the previous version of AFI 99-103 published 16 October 2013. Changes resulting from the rewrite of DoDI include replacement of the Test and Evaluation Strategy (TES) by the Milestone (MS) A Test and Evaluation Master Plan (TEMP), the addition of accelerated acquisition program models and Developmental Evaluation Framework (DEF) requirement in the TEMP. Additions include AF cyber test policy, test-for- Foreign Military Sales (FMS) policy, revised interoperability policy, clarification of Anti- Tamper (AT) test and reporting policy and more direction WRT Lead Developmental Test &. Evaluation Organization (LDTO) assignment and responsibility. Chapter 2 and Chapter 3 have been swapped to align with AFI convention; Responsibilities typically resident in Chapter 2.

5 Chapter 1 TEST AND EVALUATION CONCEPTS 7. Purpose of Test and Evaluation (T&E).. 7. The Acquisition Environment.. 7. Figure Integration of the Requirements, Acquisition, IT, and T&E Process.. 9. General T&E Principles.. 10. Integrated Test Team (ITT).. 12. Document Organization.. 12. Applicability and Authority.. 13. Areas Not Covered by this AFI.. 13. Compliance Items.. 14. Chapter 2 RESPONSIBILITIES 15. Overview of Responsibilities.. 15. Director, Operational Test and Evaluation (DOT&E).. 15. AFI99-103 6 APRIL 2017 3. Deputy Assistant Secretary of Defense for Developmental Test and Evaluation (DASD(DT&E)).. 15. Headquarters, Air Force, Director of Test and Evaluation (AF/TE).. 15. Assistant Secretary of the Air Force for Acquisition, Technology, and Logistics (SAF/AQ).. 16. Headquarters, Air Force, Deputy Chief of Staff for Intelligence, Surveillance, and Reconnaissance (AF/A2).

6 17. Headquarters, Air Force, Deputy Chief of Staff for Operations, Plans, &. Requirements (AF/A3) and Strategic Plans and Programs (A5/8).. 17. Secretary of the Air Force, Office of Information Dominance and Chief Information Officer (SAF/CIO A6).. 17. Headquarters, Air Force Materiel Command (AFMC).. 18. Headquarters, Air Force Space Command (AFSPC).. 19. Operational MAJCOMs, DRUs, and FOAs.. 20. Air Force Operational Test and Evaluation Center (AFOTEC).. 21. United States Air Force Warfare Center (USAFWC).. 22. Operational Test Organizations (OTO).. 22. Program Executive Officer (PEO).. 23. Program Managers (PM).. 23. Chief Developmental Tester (CDT), Test Manager (TM).. 26. Lead Developmental Test and Evaluation Organization (LDTO).. 27. Participating Test Organizations (PTO).. 28. Integrated Test Team (ITT).. 28. Chapter 3 TYPES OF TEST AND EVALUATION 30.

7 Major Categories of Test & Evaluation.. 30. Developmental Test & Evaluation.. 30. Types of Developmental Testing.. 31. Operational Test.. 32. Types of OT&E.. 32. Table Summary of Operational Testing Options.. 36. 4 AFI99-103 6 APRIL 2017. Testing of Training 36. Specialized Types of Test and Evaluation.. 36. Table Specialized Types of T&E.. 37. Weapons System Evaluation Program (WSEP).. 37. Other Test 38. Chapter 4 T&E ACTIVITIES SUPPORTING MILESTONE A DECISIONS 40. Pre-MS A Tester Involvement.. 40. Figure Integration of Requirements, Acquisition, and T&E Events Prior to MS 40. Pre-MS A Tester Involvement in Requirements Development.. 40. Pre-MS A Tester Involvement in the Acquisition Process.. 41. Formation of the ITT.. 41. Figure Integrated Test Team.. 43. Determining the LDTO.. 44. Determining the OTO.. 45. Figure Determining the Operational Test Organization.

8 46. OSD T&E Oversight and Approval.. 47. Lead Service 49. Tester Inputs during Materiel Solution Analysis (MSA).. 49. Developing Test Measures.. 49. Test and Evaluation Master Plan (TEMP).. 50. Lead DT&E Integrator.. 52. Reliability Growth Planning.. 52. Program Protection.. 53. Pre-Milestone A Planning for T&E Resources.. 53. Testing Defense Business Systems (DBS).. 54. Testing of Urgent Needs.. 55. Additional Early Planning 55. Table Topics for Early Test Planning Consideration.. 56. AFI99-103 6 APRIL 2017 5. Chapter 5 T&E ACTIVITIES SUPPORTING MILESTONE B DECISIONS 57. Post MS A.. 57. Figure Integration of Requirements, Acquisition, and T&E Events Prior to MS B.. 57. T&E Funding Sources.. 57. Formal Contractual Documents.. 58. Limitations on Contractor Involvement in Operational Testing.. 58. Testing IT and DBS.. 59. Modeling and Simulation (M&S) in Support of T&E.

9 59. Pre-MS B DT&E Planning.. 60. LFT&E 61. Early Operational Assessment (EOA) Planning and Execution.. 63. Tester Involvement in Requirements Documentation.. 63. Critical Technical Parameters (CTP).. 63. Testing COTS, NDI, and GFE.. 64. Scientific Test and Analysis Techniques (STAT).. 64. Cyber Test.. 64. RFP 65. MS B TEMP .. 65. Tailored Integrated Documentation.. 66. Management of T&E Data.. 66. Deficiency Reporting (DR) 68. DRs for Cyber Vulnerabilities.. 69. Independent Technical, Environmental and Safety Reviews.. 69. Test Deferrals, Limitations, and Waivers.. 70. Chapter 6 T&E ACTIVITIES IN SUPPORT OF MILESTONE C AND BEYOND 71. Post MS B.. 71. Figure Integration of Requirements, Acquisition, and T&E Events Supporting MS C. and Beyond.. 71. Refining the ITC in the 71. 6 AFI99-103 6 APRIL 2017. Developing Test Plans That Are Integrated.. 72. Realistic Testing.

10 72. Certification of System Readiness for Dedicated Operational Testing.. 73. Plans and Briefings for Operational Testing.. 75. OSD Involvement.. 75. Operational Tester DR 75. Interoperability Certification Testing.. 75. Tracking and Closing DRs.. 76. Modifications.. 76. Integrated Testing During Sustainment and Follow-on Increments.. 76. Disposing of Test 76. OT Reporting on Fielding of Prototypes or Pre-Production Systems.. 77. Chapter 7 TEST AND EVALUATION REPORTING 78. General Reporting 78. DT&E Reports.. 78. DT&E Report Distribution.. 78. Operational Test Reports.. 78. Capabilities and Limitations (C&L) Reports.. 79. AT 80. Operational Test Report 80. Briefing Trail.. 80. Distributing and Safeguarding Test Information.. 80. Information Collection and Records.. 81. Attachment 1 GLOSSARY OF REFERENCES AND SUPPORTING INFORMATION 82. Attachment 2 INFORMATION REQUIREMENTS FOR OSD T&E OVERSIGHT.