Yoav Bergner
Assistant Professor of Learning Sciences & Educational Technology
Research Interests
Make your next move.
Prepare your application
Review drafts before you send them.
Explore related searches
About
Yoav Bergner is an Assistant Professor of Learning Sciences & Educational Technology at New York University, USA. His research focuses on innovative educational practices, including web-based simulations in healthcare and embodied practices in learning contexts. Recent articles highlight his work on assessments in patient simulations, the integration of technology in movement education, and the analysis of group performance through process data in collaborative settings.
Articles (5)
Collaborative problem-solving (CPS) is a vital skill for students to learn, but designing CPS assessments is challenging due to the construct’s complexity. Advances in the capabilities of large language models (LLMs) have the potential to aid the design and evaluation of CPS items. In this study, we tested whether six LLMs agree with human judges on the quality of items measuring CPS. We found that GPT-4 was consistently the best-performing model with an overall accuracy of .77 (𝜅 = .53). GPT-4 did the best with zero-shot prompts, with other models only marginally benefiting from more complex prompts (few-shot, chain-of-thought). This work highlights challenges in using LLMs for assessment and proposes future research directions on the utility of LLMs for assessment design.
Year:
2024
Year:
2021
Year:
2020
Year:
2020
Year:
2020
Collaborators (1)
Ella Anghel
Senior Lecturer
Ben-Gurion University of the Negev
Make your next move.
Prepare your application
Review drafts before you send them.