Agenda

Day 1 — Monday, November 4th, 2019

Session Time Topic Type
1 09:00 – 09:15 Welcome
2 09:15 – 10:00 Introduction to basics of technology-based assessment:
What are log-file data and what can they be used for?		 Lecture
3 10:00 – 10:45 General information about the computer-based assessment (CBA) in PIAAC Lecture & Demo
4 10:45 – 11:00 Break
5 11:00 – 11:45 The PIAAC log-file data: Structure and documentation Lecture & Demo
6 11:45 – 12:30 The PIAAC LogDataAnalyzer (LDA) Hands-on
7 12:30 – 13:30 Lunch break
8 13:30 – 14:15 Exercise 1: Explaining task success with pre-defined indicators Hands-on
9 14:15 – 15:15 Exercise 2: Explaining task success with multiple process indicators using decision trees as a data-driven approach Hands-on
10 15:15 – 15:30 Break
11 15:30 – 17:00 Methodological approaches to the creation of process indicators Lecture


Day 2 — Tuesday, November 5th, 2019

Session Time Topic Type
1 09:00 – 09:15 Recap of Day 1 and Q & A
2 09:15 – 11:00 Introduction to the R package LogFSM
Exercise 3a: Describing the test-taking process for one PIAAC item by defining states and transitions 		Lecture & Hands-on
3 11:00 – 11:15 Break
4 11:15 – 12:15 Exercise 3a: Analyzing features derived from the test-taking process (e.g., n-grams of states) for different groups (e.g., age) Hands-on
5 12:15 – 12:30 Final Q & A
Closing session and evaluation