DTIC

1 AD-A273 225 iTechnical Report 983 pIl 11111111i1!iii l,Career Path Appreciation (CPA)Data Reduction and AnalysisPhilip LewisAuburn UniversityAugust 1993 DTICELECTEN0V2 91993 United States Army Research Institutefor the Behavioral and Social SciencesApproved for public release; distibution is 1 230 9 ARMY RESEARCH INSTITUTEFOR THE BEHAVIORAL AND SOCIAL SCIENCESA Field Operating Agency Under the Jurisdictionof the Deputy Chief of Staff for PersonnelEDGAR M. JOHNSOND irectorResearch accomplished under contractfor the Department of the ArmyAuburn University F-. 9 U~PETE-D 5 NTIS R-,: " review ..Herb Barber Di: , Jacobs ,v,,,xLty C ..L)istNOTICES_,t---------STRIB trroX Prim dsrbt~no hs has been made by EFarBehavioral and oc Sciences, ATTN: PERI 5 Ave.

2 , Alexandria, Virginia22333-5600 FINALDISPOSITION: This report may be destroyed when it is no longer needed. Please do notreturn it to the Army Research Institute for the Behavioral and Social The findings in this report are not to be construed as an official Department of the Armyposition, unless so designated by other authorized Fcrm ApprovedREPORT DOCUMENTATION PAGE o N 0704-0188P tmi ltflig ae for t o, n C ofIffl OA @ ftfoEd , " t,19 Maic to a-iragt I "Ou, PeFr ml la Me btWU, the ,,mw tOf rf'."vrn9 ,nttru,. :AS e1. nf; *a&t toect,g amh.' o .amwnw the date .waged. and couwetinmg Otis? r' trw of ,atotUmwiIlon %d covftwA.*n r"inqttAFI bwo"e Mot aOr any ! *,VW of of if on atbo. nudn g t = , ton, I#1' red1au was , t,,n, to * A NesaQouaIO Sov, c, Orectoate ,f ibfo.

3 Aton oWSS ,totaW rooe t. 1215 e J e t .,oeav Hbhe fya. Suite 1204. Arington. V 2202-0302. and to the O ct Of M de"n'ale t aOW sudge , Papetrwo Ieauction PrOPg0t (70044, ). Asohngton. DC 2 MCI31. AGENCY USE ONLY (L eave ODAnA 2 REPORT DATE 3. REPORT TYPE AND DATES COVERED1 1993, August Final ADr 92 -Mar 934 TITLE AND SUBTITLE S. FUNDING NUMBERSDAAL03-9 1-C-0034 Carter Path Appreciation (CPA) Data Reduction and Analysis 62785A7916. AUTHOR(S) 2405 Lewis, Philip (Auburn University)7. PERFORMING ORGANIZATION NAME(S) AND ADORESS(ES) 8. PERFORMING Army Research Institute for the Behavioral and REPORT NUMBERS ocial SciencesATTN: PERI-RO5001 Eisenhower AvenueAlexandria, VA 22333-56009. SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10.)

4 SPONSORING, krmy Research Institute for the Behavioral and AGENCY REPORT NUMBERS ocial Sciences ARI Technical ReportATTN: PERI-RO 9835001 Eisenhower AvenueAlexandria, VA 22333-560O_11. SUPPLEMENTARY NOTESC ontracting Officer's Representative, T. Owen was performed under a Scientific Services Agreement issued by DISTRIBUTION/ AVAILABILITY STATEMENT 12b. DISTRIBUTION CODEA pproved for public release; distribution is ABSTRACT (Maximum 200 words)The Career Path Appreciation (CPA) is an assessment interview that theoreticallygives insight into conceptual capacity. CPA interviews were conducted with 148active-duty Army officers in residence at the Army War College, CarlisleBarracks, Pennsylvania. Each volunteered to be interviewed.

5 The interraterreliability, based on 57 cases scored by two raters, was .81. Considering the quasi-clinical nature of the assessment interview, this is highly acceptable. In addition,modest construct validity was demonstrated for the CPA Current Conceptual Capacityscores. War college instructors, who rated a substample on strategic thinking skillas demonstrated in War College seminar groups, tended to rate those who scored higheron the CPA as better thinkers than those who scored lower (r = .57 and .51 on twodifferent thinking skill measures).Examination of individual responses to the PHRASES task by subjects classifiedinto four conceptual capacity levels on the basis of their investigator-rated CPAperformances suggested ways to improve some of the PHRASES item SUBJECT TERMS 15.

6 NUMBER OF PAGESC onceptual skills Stratified systems theory S7 Assessment Strategic leadership 16. PRICE CODE17. SECURITY CLASSIFICATION IS. SECURITY CLASSIFICATION 19. SECURITY CLASSIFICATION 20. LIMITATION OF ABSTRACTOF REPORT OF THIS PAGE OF ABSTRACTU nclassified Unclassified Unclassified UnlimitedNSN 7540-01-2B0-5500 Standard Form 298 (Re, 2-9)Peinbft bo y 49 Std IWIST echnical Report 970 Career Path Appreciation (CPA)Data Reduction and AnalysisPhilip LewisAuburn UniversityStrategic Leadership Technical Jacobs, ChiefManpower and Personnel Research DivisionZita M. Simutis, Army Research Institute for the Behavioral and Social Sciences5001 Eisenhower Avenue, Alexandria, Virginia 22333-5600 Office, Deputy Chief of Staff for PersonnelDepartment of the ArmyAugust 1993 Army Project Number Manpowr, Personnel, and Training2Q162785A791 Approved for public release; distribution is growing body of research attests to the importance of complex cognitive/conceptualskills for successful strategic leadership performance.

7 However, technologies for assessingand enhancing these skills are still in their infancy, as is a comprehensive theory of adulthuman development that would relate these skills to other essential leader report documents an investigation of one approach, an extended structuredinterview, for assessing these skills. Most of the academic year 1991-92 Army WarCollege class participated in the effort. The research provides good evidence for the reliabilityof the interview, and suggests that trained interviewers make consistent judgments concerningthe conceptual skills that are being assessed. These findings make reasonable further effortsthat are now under way to establish the construct validity of the interview and to develop lesscostly approaches to measuring the same work was accomplished as a part of the program of the Strategic LeadershipTechnical Area (SLTA) or the Manpower and Personnel Research Division of the ArmyResearch Institute for the Behavioral and Social Sciences (ARI).

8 EDGAR M. J HSOND irectorvACKNOWLEDGMENTSThe research reported herein was supported by the Army Research Institute forthe Behavioral and Social Sciences (ARI) under the auspices of the Army ResearchOffice Scientific Services Program administered by collection at the Army War College would not have been possible withoutthe cooperation and active assistance of the faculty and staff of the Department of Command,Leadership, and Management (DCLM) and its Head, Colonel Rich Goldsmith. Herb Barberof DCLM provided particularly invaluable logistical and conceptual support during the datacollection phase at the War the project, the assistance, support, and cooperation of T. 0. Jacobs andKathie Evans of ARI's Strategic Leadership Technical Area were both essential PATH APPRECIATION (CPA) DATA REDUCTION AND ANALYSISEXECUTIVE SUMMARYR equirement:This research was performed to determine the interrater reliability of the Career PathAppreciation (CPA) and to conduct a psychometric examination of its component parts.

9 Inparticular, the psychometric examination was intended to focus on the contribution of thevarious parts to the total assessment, and on the internal consistency of the stimulus items inone specific part of the total assessment :CPA interviews were conducted with 148 active duty Army officers in residence at Army War College, Carlisle Barracks, Pennsylvania. Each participant volunteered to beinterviewed. The interviews were conducted by individuals familiar with the CPA assessmentprocedure. They were tape recorded and the tapes were subsequently transcribed. Onehundred and thirty-seven (137) of these interviews were scored by the present investigator, ofwhich 52 were also scored by an expert in Stratified Systems Theory.

10 These replicatedscorings provided the basis for estimation of interrater reliability. In addition, the stimulusitems in the PHRASES part of the CPA were examined for internal consistency; several werereplaced in response to this :The interrater reliability of the CPA, based on the 57 cases scored by two raters, Considering the quasi-clinical nature of the assessment interview, this is highlyacceptable. In addition, modest construct validity was demonstrated for the CPA CurrentConceptual Capacity scores. War College instructors, who rated a subsample on strategicthinking skill as demonstrated in War College seminar groups, tended to rate those who scoredhigher on the CPA as better thinkers than those who scored lower (R =.)