THE RELATIONSHIP BETWEEN WELL-STRUCTURED …

1 The Pennsylvania State UniversityThe Graduate SchoolCollege of EducationTHE RELATIONSHIP BETWEENWELL- structured AND ILL-STRUCTUREDPROBLEM SOLVING IN MULTIMEDIA SIMULATIONA Thesis inInstructional SystemsbyNamsoo Shin HongSubmitted in Partial Fulfillmentof the Requirementsfor the Degree ofDoctor of PhilosophyAugust 1998iiiABSTRACTP roblem solving, especially complicated ill- structured problem solving, has been amajor concern in education. Research of the past decade provides qualitative ways ofviewing the solving processes of ill- structured problems. Sinnott, Voss & Post, andJonassen suggested that ill- structured problem solving has to support new, more qualitative,components than those for solving WELL-STRUCTURED study set forth to test the theory that the problem-solving skills used for WELL-STRUCTURED problems are necessary but not sufficient for solving ill- structured problems inthe context of an open-ended, multimedia problem-solving environment.

2 Two sets of open-ended questions were posed to reflect students solving skills in WELL-STRUCTURED and ill- structured problems involving astronomy , various instruments including domain-specific knowledge, structuralknowledge, and justification skills were developed to measure students necessary cognitivecomponents for solving problems. Finally, inventories such as science attitude, motivationin astronomy, knowledge of cognition, and regulation of cognition were employed to collectthe appropriate data of metacognition and non-cognitive , judgmental scoring systems were developed using a quantitative indexintended to reflect the extent to which subjects possessed solving skills as well as certaincognitive components of WELL-STRUCTURED and ill- structured problems.

3 The results of thisstudy verified past research conclusions that WELL-STRUCTURED and ill- structured problemsrequire different necessary components for reaching successful overall, cognition, including domain-specific knowledge and structuralknowledge, and justification skills were critical components for successful solution in WELL-STRUCTURED problem solving. Alternatively, metacognition, non-cognitive variables,justification skills, as well as cognition, were found to be essential components needed tosolve ill- structured problems. Implications for science education in a multimedia simulationenvironment, assessment on problem solving, and problem-solving research are OF CONTENTSLIST OF TABLESVIIILIST OF FIGURESXACKNOWLEDGMENTSXICHAPTER 1.

4 INTRODUCTION1 Rationale for of the Study ..1 Problem of RELATIONSHIP BETWEEN WELL-STRUCTURED and of Research Studies in Ill- structured of the of WELL-STRUCTURED Problem of Ill- structured Problem Solving ..9 Research Questions ..9 CHAPTER 2. LITERATURE REVIEW11 WELL-STRUCTURED Problems ..11 Solving Process of WELL-STRUCTURED of WELL-STRUCTURED Problem-Solving Processes ..13 Components for Solving WELL-STRUCTURED of Process of Ill- structured Problems ..17 Representation Problems ..19 Solution and of Ill- structured Problem-Solving of Solving Ill- structured Problems .. of of of Components for Solving Ill- structured Problems.

5 30 Differences BETWEEN WELL-STRUCTURED and Ill- structured Problems ..30 Research Summary ..35 CHAPTER 3. Design .. Variables of Science-Related of Motivation in Astronomy (TMA)..41 Problem-Solving Processes and Component Measures ..43 WELL-STRUCTURED Problem-Solving Processes Inventory (WPSPI) ..44 Ill- structured Problem-Solving Processes Inventory (IPSPI) ..45viCognition Inventory (CI) ..48 Justification Inventory (JI) ..48 Developing Scoring Validity of Scoring of the Tests .. 4. RESULTS58 Results of WELL-STRUCTURED Problem Solving ..58 Results of Near-Transfer Ill- structured Problem Solving.

6 61 Results of Far-Transfer Ill- structured Problem Solving ..63 Summary of Results ..65 CHAPTER 5. DISCUSSION66 WELL-STRUCTURED Problem Solving ..66 Ill- structured Problem Implication on Problem Implication on Problem Implication on Problem of Discussion ..80viiREFERENCES81 APPENDIX A. RESEARCH RECRUITMENT LETTER92A Recruitment Letter: B. QUESTIONNAIRES94 Student Do You Solve of Science-Related of Motivation in C. FACTOR LOADING102 Factor Loading of How Do You Solve D. PROBLEM-SOLVING INSTRUMENTS105 Problem-Solving Exercise Part 1: WELL-STRUCTURED Problems ..106 Problem-Solving Exercise Part 2: Ill- structured Problems.

7 108 APPENDIX E. SCORING SYSTEMS113 WELL-STRUCTURED Problem-Solving Scoring Ill- structured Problem-Solving Scoring Ill- structured Problem-Solving Scoring System ..131viiiLIST OF TABLEST able Examples of Studies in Ill- structured Problem Solving ..5 Table Comparisons of Problem Solving, Science Processes and ScientificInquiry ..6 Table Ill- structured Problem-Solving Summary of Differences BETWEEN well - and Ill- structured Summary of Comparison Eigenvalues BETWEEN K1 Analysis and Parallel Analysisin HSP (n = 118) ..40 Table Comparison Eigenvalues BETWEEN K1 Analysis and Parallel Analysisin TMA (n = 118).

8 42 Table Example of WELL-STRUCTURED Problem Testing Items ..45 Table Example of Near-Transfer Ill- structured Problem Testing Items ..46 Table Example of Far-Transfer Ill- structured Problem Testing Items ..47 Table Example of Domain-Specific Knowledge and Structural KnowledgeTesting Testing Items for Measuring Justification Skills in Testing Item for Measuring Justification Skills in Near-TransferIll- structured Problem ..51 Table Testing Item for Measuring Justification Skills in Far-TransferIll- structured Problem ..51 Table Comparison BETWEEN Novice and Expert Groups.

9 54 Table Inter-Rater Reliability BETWEEN Time Schedule for Instrument Intercorrelations among the Independent Variables in well -StructuredProblem Summary of Simultaneous Regression Analysis for Variables PredictingWell- structured Problem-Solving Scores (N = 118) ..60ixTable Intercorrelations among the Independent Variables in Near-Transfer Ill- structured Problem Analysis ..61 Table Summary of Simultaneous Regression Analysis for Variables PredictingNear-Transfer Ill- structured Problem-Solving Scores (N = 112) ..62 Table Intercorrelations among the Independent Variables in Far-Transfer Ill- structured Problem Analysis.

10 63 Table Summary of Simultaneous Regression Analysis for Variables PredictingFar-Transfer Ill- structured Problem-Solving Scores (N = 111) ..64xLIST OF FIGURESF igure Diagram of WELL-STRUCTURED Problem-Solving Diagram of Ill- structured Problem-Solving Processes ..22 Figure Scree Test of the TMA Eigenvalues Plot ..42xiACKNOWLEDGMENTSThe research reported herein was supported by the Classroom of the Future(COTF), funded in part as a research and development center by the National Aeronauticsand Space Administration (NASA) as well as the West Virginia Space Grant Consortium,Wheeling Jesuit University.