National Assessment Program – ICT Literacy

1 National Assessment Program ICT LiteracyYears 6 & 10 Repor t 2014 Australian Curriculum, Assessment and Reporting Authority 2015 This work is copyright. You may download, display, print and reproduce this material in unaltered form only (retaining this notice) for your personal, non-commercial use or use within your other rights are reserved. Requests and inquiries concerning reproduction and rights should be addressed to:ACARA Copyright Administration, ACARA Level 10, 255 Pitt Street Sydney, NSW 2000 Email: StaffJulian Fraillon and Wolfram Schulz were co-directors of the project that resulted in this report.

2 This public report was written by Julian Fraillon, Wolfram Schulz, Eveline Gebhardt and John Ainley. Kate O Malley and Warren Herbs managed the field operations and data collection. The Assessment development team was led by Julian Fraillon and Ray Philpot. The sampling and analysis team was led by Wolfram Schulz and Eveline Gebhardt and Martin Murphy. The information technology team comprised Robbie Ratts, Jafaruddin Lie, Mette Hoeyberg, Matt Wurm and Phooi Lai OF TABLES vLIST OF FIGURES ixACKNOWLEDGEMENTS xFOREWORD xiSOME TERMS USED IN THIS REPORT xiiiEXECUTIVE SUMMARY xviCHAPTER 1: INTRODUCTION 1 ICT Literacy in the educational goals for young Australians 1 ICT Literacy in the National Assessment Program 2 What is assessed in NAP ICT Literacy 3 Stages in the 2014 National Assessment of ICT Literacy 4 Structure of the report 5 CHAPTER 2.

3 ASSESSING ICT Literacy 7 ICT Literacy Assessment framework 7 The NAP ICT Literacy Assessment Framework and other frameworks 10 Assessment instrument 12 Delivery methods 14 Sample 15 Administration 20 Comparability across cycles of NAP ICT Literacy 20 Summary 22 CHAPTER 3: A National PROFILE OF ICT Literacy 23 Developing the NAP ICT Literacy scale 23 Describing the NAP ICT Literacy scale 25 The proficient standards 28 Comparisons of student performance by year level 28 Comparisons of student achievement since 2005 29 Illustrative examples of proficiency for the NAP ICT Literacy scale 33 Teaching foci for developing ICT Literacy 48 Summary 52 NAP ICT Literacy Years 6 & 10 Report 2014 ContentsivCHAPTER 4.

4 PATTERNS OF ICT Literacy 53 Performance in ICT Literacy among states and territories 53 Comparisons of jurisdictional score averages and distributions across cycles 54 Percentages attaining the proficient standard 57 Percentages of students at proficiency levels 61 ICT Literacy by student background 64 Summary 72 CHAPTER 5: STUDENT USE OF ICT 73 Background 73 Computer familiarity 75 Using computer applications 80 ICT at school 89 Conclusion 93 CHAPTER 6.

5 STUDENT PERCEPTIONS OF ICT 95 Student interest in and enjoyment of working with computers 95 Student recognition of the importance of working with computers 98 Student ICT self-efficacy 101 Influences on ICT Literacy 105 Summary 110 CHAPTER 7: CONCLUSION 112 ICT Literacy in 2014 112 Changes over nine years 113 Interpreting the decline in achievement between 2011 and 2014 114To what extent are digital divides evident? 115 How often and for what purposes are students using computers? 116 Student perceptions about using ICT 116 Summary 117 REFERENCES 118 APPENDIX 1: NAP ICT Assessment FRAMEWORK 120 APPENDIX 2: ORDERED MAP OF NAP ICT Literacy 2014 TASK DESCRIPTORS 122 APPENDIX 3: STUDENT QUESTIONNAIRE 126 APPENDIX 4: SAMPLE CHARACTERISTICS BY STATE AND TERRITORY 130 APPENDIX 5: REPORTING OF DIFFERENCES BETWEEN SCALE SCORE AVERAGES 138 APPENDIX 6.

6 MEAN SCORES ON QUESTIONNAIRE INDICES BY YEAR LEVEL AND STATE AND TERRITORY 141vList of tablesTable ES 1 NAP ICT Literacy scale proficiency level descriptors and percentage distribution of students by year level xixTable ES 2 ICT Literacy mean scale scores for Year 6 and Year 10 from 2005 to 2014 xxiiTable ES 3 Percentages of Year 6 and Year 10 students attaining the proficient standard in ICT Literacy from 2005 to 2014 xxiiiTable ES 4 Year 6 and Year 10 means and mean differences with confidence intervals for ICT Literacy scores, nationally and by state and territory in 2014 xxivTable ES 5 Percentages of Year 6 and Year 10 students at or above the Proficient Standard on the ICT Literacy scale by jurisdiction in 2014 xxvTable Information and communication technology Literacy progress map 9 Table Numbers of students and schools in the target and achieved samples 17 Table National percentage distribution of sample characteristics (weighted)

7 18 Table NAP ICT Literacy scale proficiency level descriptors and percentage distribution of students by year level 26 Table ICT Literacy mean scale scores for Year 6 and Year 10 from 2005 to 2014 29 Table Percentage distribution of Year 6 and Year 10 students across proficiency levels on the ICT Literacy scale from 2005 to 2014 31 Table Percentages of Year 6 and Year 10 students attaining the proficient standard in ICT Literacy from 2005 to 2014 31 Table Year 6 and Year 10 means and mean differences with confidence intervals for ICT Literacy scores, nationally and by state and territory in 2014 53 Table Means and mean differences with confidence intervals in Year 6 for ICT Literacy scores, nationally and by state and territory in 2014, 2011, 2008 and 2005 55 Table Pair-wise comparisons of Year 6 mean performance on the ICT Literacy scale between states and territories in 2014 55 Table Means and mean differences with confidence intervals in Year 10 for ICT Literacy scores, nationally and by state and territory in 2014, 2011.

8 2008 and 2005 56 Table Pair-wise comparisons of Year 10 mean performance on the ICT Literacy scale between states and territories in 2014 57 Table Percentages of Year 6 students attaining the proficient standard on the ICT Literacy scale, nationally and by state and territory in 2014, 2011, 2008 and 2005 58 Table Pair-wise comparisons of percentages of Year 6 students at or above the proficient standard between states and territories in 2014 58 Table Percentages of Year 10 students attaining the proficient standard on the ICT Literacy scale, nationally and by state and territory in 2014, 2011, 2008 and 2005 60 Table Pair-wise comparisons of percentages of Year 10 students at or above the proficient standard between states and territories in 2014 60 Table Percentage distribution of Year 6 students over proficiency levels by state and territory in 2014 and nationally in 2014, 2011, 2008 and 2005 62 NAP ICT Literacy Years 6 & 10 Report 2014 List of tablesviTable Percentage distribution of Year 10 students over proficiency levels, nationally and by state and territory in 2014 and nationally in 2014, 2011.

9 2008 and 2005 63 Table Mean performance of males and females in Year 6 and Year 10 on the ICT Literacy scale by state and territory in 2014, and comparison of National means in 2014 with 2011, 2008 and 2005 64 Table National percentages of males and females in Year 6 and Year 10 attaining the proficient standards on the ITC Literacy scale in 2014, 2011, 2008 and 2005 65 Table Mean scores and percentages attaining the proficient standards for Indigenous and non-Indigenous Year 6 and Year 10 students on the ICT Literacy scale in 2014 66 Table Mean scores and percentages attaining the proficient standards for Year 6 and Year 10 students on the ICT Literacy scale by language spoken at home in 2014 67 Table Mean scores and percentages attaining the proficient standards for Year 6 and Year 10 students on the ICT Literacy scale by country of birth in 2014 67 Table Mean scores and percentages attaining the proficient standards for Year 6 and

10 Year 10 on the ICT Literacy scale by geographic location in 2014 in comparison with 2005, 2008 and 2011 69 Table Mean scores and percentages for Year 6 and Year 10 students attaining the proficient standards on the ICT Literacy scale by categories of parental occupation in 2014 70 Table Mean scores and percentages for Year 6 and Year 10 students attaining the proficient standards on the ICT Literacy s