Designing life science assessments in the era of generative artificial intelligence.

Andrew C Kwong, Christopher Magnano, Cristina DeOliveira, Christine Goglia, Joseph J Loparo, John Jacob Peters

Journal: PloS one 2026;21(4):e0346127

PMID: 41926387

Abstract

Generative artificial intelligence (GAI) algorithms have the potential to reshape education. Though GAI may help democratize access to education, it also presents many challenges for educators. Already, the ease of use of GAI has made it easier for students to bypass learning gains by prompting GAI for answers to assignments. Here, we assessed how ChatGPT performed on take-home assignments in a doctoral-level molecular biology course designed to train students in experimental design. Using Bloom's taxonomy as a framework, we hypothesized that ChatGPT would perform similarly to doctoral students on lower cognitive levels involving memorization and underperform at higher levels that rely on critical thinking. Students outperformed ChatGPT, but surprisingly, this result was driven by ChatGPT's poor performance on "remember" and "apply" tasks, which was partially improved by simple prompt engineering. To build assessments more robust to GAI usage, we developed and tested new free-response and multiple-choice assessments. We found a striking deficit in ChatGPT's ability to interpret scientific graphs and raw data in both short-answer and multiple-choice questions, even when using a version specifically designed for image interpretation. Based on our results, we propose several tips for designing out-of-class assessments that promote student learning in the era of GAI.

Copyright: © 2026 Kwong et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Address: Division of Gastroenterology, Hepatology, and Nutrition, Boston Children's Hospital, Boston, Massachusetts, United States of America.; Program in Biological and Biomedical Sciences, Harvard Medical School, Boston, Massachusetts, United States of America.; Department of Computer Science, Tufts University, Medford, Massachusetts, United States of America.; Department of Biological Chemistry and Molecular Pharmacology, Blavatnik Institute, Harvard Medical School, Boston, Massachusetts, United States of America.; Program in Biological and Biomedical Sciences, Harvard Medical School, Boston, Massachusetts, United States of America.; Department of Biological Chemistry and Molecular Pharmacology, Blavatnik Institute, Harvard Medical School, Boston, Massachusetts, United States of America.; Department of Biology, University of Richmond, Richmond, Virginia, United States of America.
Bant logo

© Copyright 2026, Nutrition Evidence

NED wishes to thank the following organisations for their support:

We use cookies to improve your experience and analyze site traffic with Google Analytics. By continuing to use our site, you agree to our use of cookies. Learn more.