Digitaal toetsen – DBC experiment
3: Hoe belangrijk is parate kennis nog?
Waar het mee begon: Horloges verboden bij diverse hogescholen. Reden: smartwatch. Enige manier om het tegen te houden…
Nieuw tentamensysteem: OPEN WERELD. Grote databank, systeem beslist welke vragen je krijgt. In willekeurige volgorde.
Met een strakke tijdslimiet bij kennistoetsen. Dus: wat bij jou vraag 1 is, is bij jou vraag 44 en zit er bij jou niet eens in.
Enige wat verboden is: onderling overleg. Tentamensysteem nog niet ver genoeg ontwikkeld.
Pilot 1 Business Economics Database with questions Over 200 million possible exams Approx 25 open questions On campus 40 candidates
Pilot 1: Lessons learned Students Google a lot (uncertainty) Technical difficulties WiFi
Pilot 2 50 multiple choice questions Time: 40 minutes ProctorExam Light (screen recording) Invigilators (1:10) 40 candidates, two rooms, Fontys. All questions where knowledge based
YES, students could google EVERY answer Yet only 35,1% passed…
Pilot 2: lessons learned (1) No knowledge? You can’t Google efficiently… The more they search, the lower the grade. Underestimation
Pilot 2: Lessons Learned (2) Technical difficulties WiFi on campus Plugin on Chrome WiFi Network was strengtened Still insufficient.
Pilot 2a: Resit, at home Proctorexam Classic Five students No issues. Automated procedure Five students No issues.
Pilot 3 Big Data Marketing 13 open questions 60 minutes (database: >90 questions) 60 minutes 43 candidates (36 at home, 7 at Fontys) ProctorExam – live proctoring
Pilot 3: lessons learned Manage expectations! Lots of uncertainty: 1) Privacy 2) Connection 3) Digital 4) It’s new. Two groups: 33 students @ home: no issues. 7 students @ Fontys: failure.
Pilot 3: lessons learned (2) Stability WiFi connection issues Fibre-optic failure (Fontys) Stability II: Student with bad connection Live proctoring delays No problem (database)
Fraud detection Several students flagged One creative student False positives One creative student Refreshed exam No fraud detected No signals of fraud
Some recommendations On campus: Wired connection If wireless: spread them out. Remote: Recommend wired connection. Have back-up options available (both digital AND analogue) Manage expectations.