Yoav Bergner

Assistant Professor of Learning Sciences & Educational Technology

New York University
Country flagUnited States

Research Interests

ApplyKite TwinLearns as you apply

Make your next move.

Prepare your application

Review drafts before you send them.

Explore related searches

About

Yoav Bergner is an Assistant Professor of Learning Sciences & Educational Technology at New York University, USA. His research focuses on innovative educational practices, including web-based simulations in healthcare and embodied practices in learning contexts. Recent articles highlight his work on assessments in patient simulations, the integration of technology in movement education, and the analysis of group performance through process data in collaborative settings.

Articles (5)

Collaborative problem-solving (CPS) is a vital skill for students to learn, but designing CPS assessments is challenging due to the construct’s complexity. Advances in the capabilities of large language models (LLMs) have the potential to aid the design and evaluation of CPS items. In this study, we tested whether six LLMs agree with human judges on the quality of items measuring CPS. We found that GPT-4 was consistently the best-performing model with an overall accuracy of .77 (𝜅 = .53). GPT-4 did the best with zero-shot prompts, with other models only marginally benefiting from more complex prompts (few-shot, chain-of-thought). This work highlights challenges in using LLMs for assessment and proposes future research directions on the utility of LLMs for assessment design.

Year:

2024

Year:

2021

Year:

2020

Year:

2020

Year:

2020

Collaborators (1)

Ella Anghel

Senior Lecturer

Ben-Gurion University of the Negev

ISRAEL
View details