PISA 2015 DRAFT MATHEMATICS FRAMEWORK - …

1 2 1 PISA 2015 DRAFT MATHEMATICS FRAMEWORK The PISA 2015 DRAFT MATHEMATICS FRAMEWORK explains the theoretical underpinnings of the PISA MATHEMATICS assessment, including the formal definition of mathematical literacy continued from 2012, the mathematical processes which students undertake when using mathematical literacy and the fundamental mathematical capabilities which underlie those processes. The DRAFT FRAMEWORK describes how mathematical content knowledge is organised into four content categories and outlines the content knowledge that is relevant to an assessment of 15-year-old students.

2 It describes four categories of contexts in which students will face mathematical challenges. The DRAFT FRAMEWORK recommends the proportions of items from each of the four content and context categories, each response format and each process to be used in the 2015 instrument. The categorisations are illustrated with seven units used in PISA surveys and field trials. The PISA assessment will measure how effectively countries are preparing students to use MATHEMATICS in every aspect of their personal, civic and professional lives, as part of their constructive, engaged and reflective citizenship.

3 MARCH 20132 2 TABLE OF CONTENTS INTRODUCTION .. 3 DEFINITION OF MATHEMATICAL LITERACY .. 5 A view of students as active problem solvers in PISA 2015 .. 6 An explicit link to a variety of contexts for problems in PISA 2015 .. 8 A visible role for mathematical tools, including technology in PISA 2015 .. 8 ORGANISATION OF THE DOMAIN .. 9 Mathematical processes and the underlying mathematical capabilities .. 9 Mathematical processes .. 9 Formulating situations mathematically .. 10 Interpreting, applying and evaluating mathematical outcomes .. 12 Fundamental mathematical capabilities underlying the mathematical processes.

4 12 Mathematical content knowledge .. 16 Change and relationships .. 17 Space and shape .. 18 Quantity .. 18 Uncertainty and data .. 19 Content topics for guiding the assessment of mathematical literacy for 15-year-old students .. 19 Contexts .. 21 ASSESSING MATHEMATICAL LITERACY .. 22 Structure of the PISA 2015 MATHEMATICS assessment .. 23 Reporting proficiency in MATHEMATICS .. 26 Computer-based assessment of MATHEMATICS .. 28 SUMMARY .. 29 APPENDIX A: FUNDAMENTAL MATHEMATICAL CAPABILITIES AND THEIR RELATIONSHIP TO ITEM DIFFICULTY .. 31 APPENDIX B: ILLUSTRATIVE PISA ITEMS.

5 33 Charts .. 33 Fuji .. 35 Pizzas .. 37 Litter .. 40 Rock Concert .. 42 44 Carpenter .. 48 REFERENCES .. 51 2 3 Introduction In PISA 2015 , MATHEMATICS will be assessed as a minor domain, providing an opportunity to make comparisons in student performance over time. This FRAMEWORK continues the description and illustration of the PISA MATHEMATICS assessment as set out in the 2012 FRAMEWORK , when MATHEMATICS was re-examined and updated for use as the major domain in that cycle. For PISA 2015 , computer-based assessment will be the primary mode of delivery for all domains, including mathematical literacy.

6 However, paper-based assessment instruments will be provided for countries choosing not to test their students by computer. The mathematical literacy component for both the computer-based and paper-based instruments will comprise of the same intact clusters of MATHEMATICS trend items. The number of trend items in both minor domains will be increased, therefore increasing the construct coverage whilst reducing the number of students responding to each question. This design is intended to reduce potential bias whilst stabilising and improving the measurement of trend.

7 As the computer-based assessment of MATHEMATICS (CBAM) was an optional domain for 2012 and was not taken by all countries, it is not part of the mathematical literacy trend. Therefore CBAM items will not be included in the 2015 assessment where mathematical literacy is a minor domain, despite the change in delivery mode. The FRAMEWORK has been updated to reflect the change in delivery mode, including a discussion of the considerations of transposing paper items onscreen and examples of how that might look. The definition and constructs of mathematical literacy however, remain unchanged and consistent with 2012.

8 The PISA 2015 MATHEMATICS FRAMEWORK is organised into several major sections. The first section, Definition of Mathematical Literacy, explains the theoretical underpinnings of the PISA MATHEMATICS assessment, including the formal definition of the mathematical literac y construct. The second section, Organisation of the Domain, describes three aspects: a) the mathematical processes and the fundamental mathematical capabilities (in previous frameworks the competencies ) underlying those processes. b) The way mathematical content knowledge is organised in the PISA 2012 FRAMEWORK , and the content knowledge that is relevant to an assessment of 15-year-old students.

9 C) The contexts in which students will face mathematical challenges. The third section, assessing Mathematical literacy, outlines structural issues about the assessment, including a test blueprint and other technical information. The several addenda include further descriptions of the fundamental mathematical capabilities, several illustrative PISA items and a reference list. The 2012 FRAMEWORK was written under the guidance of the 2012 MATHEMATICS Expert Group (MEG), a body appointed by the main PISA contractors with the approval of the PISA Governing Board (PGB).

10 The ten MEG members included mathematicians, MATHEMATICS educators, and experts in assessment, technology, and education research from a range of countries. In addition, to secure more extensive input and review, a DRAFT of the PISA 2012 MATHEMATICS FRAMEWORK was circulated for feedback to over 170 MATHEMATICS experts from over 40 countries. Achieve and the Australian Council for Educational Research (ACER), the two organisations contracted by the Organisation for Economic Co-operation and Development (OECD) to manage FRAMEWORK development, also conducted various research efforts to inform and support development work.