about
Diagnostic Questions: The NeurIPS 2020 Education Challenge (arxiv.org)
2 points by ArtWomb on Jul 27, 2020 | hide | past | pdf | discuss on HN

In plain words: A competition asks people to predict students' multiple-choice answers, spot high-quality questions, and choose the best next question for each student, using over 20 million math answer records from a large tutoring website. The tasks mirror what a real tutoring platform needs to personalize learning.

Abstract · Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challenge

Digital technologies are becoming increasingly prevalent in education, enabling personalized, high quality education resources to be accessible by students across the world. Importantly, among these resources are diagnostic questions: the answers that the students give to these questions reveal key information about the specific nature of misconceptions that the students may hold. Analyzing the massive quantities of data stemming from students' interactions with these diagnostic questions can help us more accurately understand the students' learning status and thus allow us to automate learning curriculum recommendations. In this competition, participants will focus on the students' answer records to these multiple-choice diagnostic questions, with the aim of 1) accurately predicting which answers the students provide; 2) accurately predicting which questions have high quality; and 3) determining a personalized sequence of questions for each student that best predicts the student's answers. These tasks closely mimic the goals of a real-world educational platform and are highly representative of the educational challenges faced today. We provide over 20 million examples of students' answers to mathematics questions from Eedi, a leading educational platform which thousands of students interact with daily around the globe. Participants to this competition have a chance to make a lasting, real-world impact on the quality of personalized education for millions of students across the world.

Zichao Wang, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Yordan Zaykov, José Miguel Hernández-Lobato, Richard E. Turner, Richard G. Baraniuk, Craig Barton, Simon Peyton Jones, Simon Woodhead, Cheng Zhang
arXiv:2007.12061 · cs.CY, cs.HC, cs.LG · submitted Jul 23, 2020 · updated Apr 12, 2021
abstract · pdf · html · 28 pages, 6 figures, NeurIPS 2020 Competition Track

add comment on HN