paper-with-me

Papers

Using Adaptive Experiments to Rapidly Help Students

2022-08-10 · Angela Zavaleta-Bernuy, Qi Yin Zheng, Hammad Shaikh, Jacob Nogas, Anna Rafferty, Andrew Petersen, Joseph Jay Williams

Adaptive experiments can increase the chance that current students obtain better outcomes from a field experiment of an instructional intervention. In such experiments, the probability of assigning students to conditions changes while more data is being collected, so students can be assigned to interventions that are likely to perform better. Digital educational environments lower the barrier to conducting such adaptive experiments, but they are rarely applied in education. One reason might be that researchers have access to few real-world case studies that illustrate the advantages and disadvantages of these experiments in a specific context. We evaluate the effect of homework email reminders in students by conducting an adaptive experiment using the Thompson Sampling algorithm and compare it to a traditional uniform random experiment. We present this as a case study on how to conduct such experiments, and we raise a range of open questions about the conditions under which adaptive randomized experiments may be more or less useful.

📄 PDF Abstract BibTeX arXiv:2208.05092

Code (0)

등록된 구현이 없습니다.

Tasks

Thompson Sampling

Similar Papers 제목 키워드 기반

Challenges in Statistical Analysis of Data Collected by a Bandit Algorithm: An Empirical Exploration in Applications to Adaptively Randomized Experiments

2021-03-22 · Joseph Jay Williams, Jacob Nogas, Nina Deliu, Hammad Shaikh 외

Multi-armed bandit algorithms have been argued for decades as useful for adaptively randomized experiments. In such experiments, an algorithm varies which arms (e.g. alternative interventions to help students learn) are …

Thompson Sampling

Opportunities for Adaptive Experiments to Enable Continuous Improvement in Computer Science Education

2023-10-18 · Ilya Musabirov, Angela Zavaleta-Bernuy, Pan Chen, Michael Liut 외

Randomized A/B comparisons of alternative pedagogical strategies or other course improvements could provide useful empirical evidence for instructor decision-making. However, traditional experiments do not provide a stra…

Decision Making

Enhancing a Student Productivity Model for Adaptive Problem-Solving Assistance

2022-07-07 · Mehak Maniktala, Min Chi, Tiffany Barnes

Research on intelligent tutoring systems has been exploring data-driven methods to deliver effective adaptive assistance. While much work has been done to provide adaptive assistance when students seek help, they may not…

A Comparative Analysis of classification data mining techniques : Deriving key factors useful for predicting students performance

2016-06-18 · Muhammed Salman Shamsi, Jhansi Lakshmi

Students opting for Engineering as their discipline is increasing rapidly. But due to various factors and inappropriate primary education in India, failure rates are high. Students are unable to excel in core engineering…

General ClassificationPrediction

Extending the Hint Factory for the assistance dilemma: A novel, data-driven HelpNeed Predictor for proactive problem-solving help

2020-10-08 · Mehak Maniktala, Christa Cody, Amy Isvik, Nicholas Lytle 외

Determining when and whether to provide personalized support is a well-known challenge called the assistance dilemma. A core problem in solving the assistance dilemma is the need to discover when students are unproductiv…