Digitaal toetsen – DBC experiment

Presentatie over: "Digitaal toetsen – DBC experiment"— Transcript van de presentatie:

1

2 Digitaal toetsen – DBC experiment

3 3: Hoe belangrijk is parate kennis nog?

4 Waar het mee begon: Horloges verboden bij diverse hogescholen. Reden: smartwatch. Enige manier om het tegen te houden…

5 Nieuw tentamensysteem: OPEN WERELD.
Grote databank, systeem beslist welke vragen je krijgt. In willekeurige volgorde.

6 Met een strakke tijdslimiet bij kennistoetsen.
Dus: wat bij jou vraag 1 is, is bij jou vraag 44 en zit er bij jou niet eens in.

7 Enige wat verboden is: onderling overleg.
Tentamensysteem nog niet ver genoeg ontwikkeld.

8 Pilot 1 Business Economics Database with questions
Over 200 million possible exams Approx 25 open questions On campus 40 candidates

9 Pilot 1: Lessons learned
Students Google a lot (uncertainty) Technical difficulties WiFi

10

11 Pilot 2 50 multiple choice questions Time: 40 minutes
ProctorExam Light (screen recording) Invigilators (1:10) 40 candidates, two rooms, Fontys. All questions where knowledge based

12 YES, students could google EVERY answer
Yet only 35,1% passed…

13 Pilot 2: lessons learned (1)
No knowledge? You can’t Google efficiently… The more they search, the lower the grade. Underestimation

14 Pilot 2: Lessons Learned (2)
Technical difficulties WiFi on campus Plugin on Chrome WiFi Network was strengtened Still insufficient.

15 Pilot 2a: Resit, at home Proctorexam Classic Five students No issues.
Automated procedure Five students No issues.

16 Pilot 3 Big Data Marketing 13 open questions 60 minutes
(database: >90 questions) 60 minutes 43 candidates (36 at home, 7 at Fontys) ProctorExam – live proctoring

17 Pilot 3: lessons learned
Manage expectations! Lots of uncertainty: 1) Privacy 2) Connection 3) Digital 4) It’s new. Two groups: 33 home: no issues. 7 Fontys: failure.

18 Pilot 3: lessons learned (2)
Stability WiFi connection issues Fibre-optic failure (Fontys) Stability II: Student with bad connection Live proctoring delays No problem (database)

19 Fraud detection Several students flagged One creative student
False positives One creative student Refreshed exam No fraud detected No signals of fraud

20 Some recommendations On campus: Wired connection
If wireless: spread them out. Remote: Recommend wired connection. Have back-up options available (both digital AND analogue) Manage expectations.