Evaluating the Efficacy of a Multifaceted Prompt for Use with LLMs to Evaluate Course Project Reports
en-GBde-DEes-ESfr-FR

Evaluating the Efficacy of a Multifaceted Prompt for Use with LLMs to Evaluate Course Project Reports

03/06/2026 HEP Journals

Course project reports (CPRs) are vital for evaluating student learning outcomes, yet manual assessment is inefficient and subjective. Large language models (LLMs) have been applied to automated essay scoring but focus only on writing proficiency, neglecting critical thinking and practical competencies. To address this gap, this paper introduces PEG-Prompt, a novel prompting framework integrating the Paul-Elder critical thinking model. It assesses CPRs from six dimensions: structure, logic, coherence, originality, citation, and knowledge proficiency. The authors further optimize the framework using report key content extraction and few-shot scoring examples. A dedicated PEG-CPR dataset with 110 anonymized reports is constructed for validation. Experiments on four mainstream LLMs demonstrate that PEG-Prompt consistently reduces scoring errors and enhances alignment with human evaluations. Statistical and visualization analyses confirm significant performance improvements. The optimized approach produces detailed, human-like feedback supporting both formative student reflection and summative course assessment. This work advances AI-powered educational evaluation by combining critical thinking assessment with LLM prompt engineering.
This framework guides LLMs in evaluating CPR with respect to practical competencies, analytical reasoning, and writing skills while generating targeted feedback. This feedback facilitates students’ ability to reflect on their results and improve in their weaker areas, thereby contributing to the cultivation of higher-order intellectual traits.

The work entitled “Evaluating the Efficacy of a Multifaceted Prompt for Use with LLMs to Evaluate Course Project Reports” was published on Frontiers of Digital Education (published on April 25, 2026).
DOI:10.1007/s44366-026-0086-y
Attached files
  • Figure 2 General framework of PEG-Prompt—which is inspired by the Paul-Elder critical thinking framework—incorporates six dimensions.
03/06/2026 HEP Journals
Regions: Asia, China
Keywords: Humanities, Education

Disclaimer: AlphaGalileo is not responsible for the accuracy of content posted to AlphaGalileo by contributing institutions or for the use of any information through the AlphaGalileo system.

Testimonials

For well over a decade, in my capacity as a researcher, broadcaster, and producer, I have relied heavily on Alphagalileo.
All of my work trips have been planned around stories that I've found on this site.
The under embargo section allows us to plan ahead and the news releases enable us to find key experts.
Going through the tailored daily updates is the best way to start the day. It's such a critical service for me and many of my colleagues.
Koula Bouloukos, Senior manager, Editorial & Production Underknown
We have used AlphaGalileo since its foundation but frankly we need it more than ever now to ensure our research news is heard across Europe, Asia and North America. As one of the UK’s leading research universities we want to continue to work with other outstanding researchers in Europe. AlphaGalileo helps us to continue to bring our research story to them and the rest of the world.
Peter Dunn, Director of Press and Media Relations at the University of Warwick
AlphaGalileo has helped us more than double our reach at SciDev.Net. The service has enabled our journalists around the world to reach the mainstream media with articles about the impact of science on people in low- and middle-income countries, leading to big increases in the number of SciDev.Net articles that have been republished.
Ben Deighton, SciDevNet

We Work Closely With...


  • The Research Council of Norway
  • SciDevNet
  • Swiss National Science Foundation
  • iesResearch
Copyright 2026 by AlphaGalileo Terms Of Use Privacy Statement