Changing face of examining - TED Ankara Koleji Kütüphane ...

1 Changing face of examiningPresentation StructurePresentation Structure BackgroundBackground Operational supportki Emarking Application processIB examiner informationIB examiner information May2010 May 2010 6,500 examiners1 150components 1,150 components 100,000 candidates138ti 138 countrieslhfl Annual growth of approximately 10% ib examiner information (cont) ib examiner information (cont) MajorityofexaminersarebasedinafewMajorit y of examiners are based in a few countries UK UK USAA ustralia Australia International education increase the number fiithtiof examiners in other countriesIB examiner information (cont) ib examiner information (cont)2008 Examiner rolesExaminer roles DifferentrolesDifferent roles Senior examiners Chiefexaminers/assessorsChief examiners /assessors Examiner responsible for a language School based syllabus assessorsy Operational examinersExaminer roles(cont)Examiner roles(cont)

2 OperationalexaminersOperational examiners Examiner Mark candidates work against a markscheme or gmarking notes Moderator Moderates a teachers marking Team leaderPi i li/dt Principal examiners /moderatorsRecruitment policyRecruitment policy InformationInformation Universal across all DP subjects Identifies required qualifications and experienceOithii One years on going teaching experience A degree in the subject or a related subjectExaminer contractExaminer contract Contractrevisedforthe2011sessionContract revised for the 2011 session More user friendlyCl ifilihlidd Clarifies roles with newly introduced systemsExamining visual artsExamining visual arts EnsuringvalidityofassessmentEnsuring validity of assessment An examiner can examine at a school for a maximumoftwoconsecutiveyearsmaximum of two consecutive years Travelling distance Visual arts examiner listExaminer inductionExaminer induction SupportnewlyappointedexaminersSupport newly appointed examiners Clarifies assessment processfiflli Reference point for all examinersExaminer newsletterExaminer newsletter ExaminerfocussedExaminer focussed Community of examinersflif i Useful informationE marking why it s such an exciting time to join the IB examining IB have been successfully e marking since the November 2009 which will be e marked in November 20102010 Biology SL p2 ITGS HL/SL p1gyp Economics SL p1 & p2 English B HL p1/p Maths SL p1 & p2 Maths studies SL p1 & p2 English B SL p1 Environmental systems & itiSL2 Physics SL p2 Theory of knowledge essaysocieties SL p2 This list of subjects will be extended in the May

3 2011 sessionRamp up100%120%80%100%40%60%0%20%201020112012 2013 Ramp upBy 2013 97%of scripts will be e markedyp 2010 12% 2011 36% 2012 65% 2013 97%Improving the quality of assessment For paper based marking, examiner performance is monitored through the use of sample re marking and moderation. This system, which is the best possible in a paper basedsystemsuffersfromanumberofbased system, suffers from a number of drawbacks. examiners cannot learn from this process during the marking session examiners do not have the opportunity to improve their standard of marking during the marking session Where a complete re mark is necessary there is little time to complete the workImproving the quality of assessment From November 2010, the IB will introduce seedingto monitor examiner performance with e marked scripts and with this approach these drawbacks are reduced or removed of the seeding process examiners are given more guidance on the application of the ggppmarkscheme at the start of their marking through practice scriptsEid lif kliibki5 examiners need to qualify to mark live scripts by marking 5 scripts correctly , with a second chance of another 5 scripts if necessary Once marking.

4 A certain number of scripts (seeds) are randomly added to an examiner s worklist. The script cannot beidentifiedbytheexaminerasaseedbe identified by the examiner as a seed Summary of the seeding process (2) examiners mark these seeds and unless they mark the seed outside of pre agreed tolerances they keep on marking The first time the examiner marks the seed inaccurately they cannot continue to mark until they have accepted quality feedbackfeedback If the examiner marks a second consecutive seed outside of the pre agreed tolerance they are stopped from marking until they have received guidance from their team leader If the examiner marks 3 seeds outside of the pre agreed tolerancetheyarestoppedfrommarkingandthe irscriptswilltolerance they are stopped from marking and their scripts will be re allocated Summary of the seeding process (3)

5 The IB and the senior examiners can view the status of each examiner within their marking team during the marking processTh fdfbid Therefore, progress and performance can be monitored more closelyExaminer comments100%May 10 examination sessionWhichofthefollo ingords/phrasesoldosetodescribethe80%100 %69%Which of the following words/phrases would you use to describe the e marking system used during the May 10 IB Diploma Programme exam session?40%60%36%28%0%20%11%5%11%Enjoyab leCumbersome Straightforward to useFlexibleComplicatedOtherAverage response rate to questionnaire: 85% (266 out of 315 examiners )Examiner comments Like anything else new, it will take some time but I can already tell you that this is easier that marking the scripts themselves. Quite happy to use this system. Beats having piles of paper alloverthehouse!

6 !!! all over the house!!!! It is very enjoyable to grade papers with scoris Actually,Ithinkthatthissoftwareanditsuse rfriendlyActually, I think that this software and its user friendly approach is amazing I was using a tablet PC with a stylus, so the "stamping" of bldk annotations was very enjoyable and quick. Examiner comments Helpdesk at IB was personal and first class. E marking was definitely a nice experience. The experience gyppof working on scoris assessor was really a very good one. Thanks for providing me an opportunity to learn and improve uponmy'onlinemarking(emarking)skills upon my online marking (e marking) skills. I really enjoyed e marking and cannot imagine going back to paper. scoris was very easy to do .. the familiarization mode was helpful in getting me ready for scoring.

7 E marking is very, veryeasytodoandwasveryenjoyable!very easy to do and was very enjoyable! Far superior to the previous system! Examiner support For any examiner e marking there is a dedicated ygsupport team available 7 days a week during the session. Any queries regarding e marking should be directed to @gWhy become an examiner?Why become an examiner? ProfessionaldevelopmentProfessional development Deeper knowledge of assessment ExaminerexperienceExaminer experience Access to materials Part of an examining team Examiner training Candidate answersWhy become an examiner?(cont)Why become an examiner? (cont) MoneyMoney StatusAddtthCV Adds to a teachers CV InputWhy become an examiner?(cont)Why become an examiner? (cont)CaseStudyCase Study Alison Ryan Mathematical Studies team leader I started marking as an assistant examiner and subsequently worked with the IB as the dhi fifMh ildeputy chief examiner for Mathematical Studies between 2001 and 2006.

8 I am currently a team leader for both Mathematical Studies projects and paper 1. Why become an examiner?(cont)Why become an examiner? (cont)CaseStudyCase Study Since becoming an examiner I have been involved in two curriculum reviews, I have run teacher workshops and been involved in school authorisation visits. Being involved in these activities has allowed me to meet interesting people from aroundtheworldwhoteachawidevarietyofsubj ects around the world who teach a wide variety of to applyHow to apply IBwebsite www ibo org/examinersIB website OETR if Application form Application process policy References AppointmentQuestionsQuestions