Faculty Case Studies

Assessment Development

Designing Authentic Assessments

Strategy: Design Ethical, AI-Enabled Alternative Assessments at Scale 

Artificial Intelligence can be intentionally integrated into assessment design to create authentic, engaging learning experiences while addressing academic integrity and scalability challenges. By reframing AI as a structured role-play and problem-solving partner, instructors can develop alternative assessments that promote higher-order thinking, real-world application, and transparent, ethical use of AI in large-enrollment courses. 

course  banner

SCM 3005 – Supply Chain Management 

In SCM 3005 Supply Chain Management, Dr. Alison Watkins and Learning Designer Molly Murphy designed an AI-enabled alternative assessment that transformed a common academic integrity challenge into an opportunity for authentic, skill-based learning. 
With class sizes exceeding 100 students, traditional essay-based assignments had become both difficult to grade and vulnerable to inappropriate AI use. Rather than restricting AI or shifting to lower-impact multiple-choice formats, Dr. Watkins and Molly developed a structured ChatGPT-powered role-play assessment that required students to engage ethically and transparently with AI.  

911±¬ÁÏÍø used a faculty-authored prompt to simulate one of three real-world business negotiation scenarios, applying core supply chain and decision-making concepts in an interactive, dialogue-based format. This approach allowed students to practice professional communication, strategic thinking, and negotiation skills while making their use of AI explicit and measurable. To support instructor workload and consistency in grading, students were required to submit a transcript of their role-play and visually highlight sections that demonstrated how they met the activity parameters. This design choice streamlined evaluation while preserving opportunities for creative, personalized student engagement at scale. 


AI Tools Used: ChatGPT 

Digital Learning Designer Tips 

  1. Develop and pilot prompts before release to ensure they align with student learning outcomes and generate usable, relevant student outputs. 
  2. Link directly to the AI prompt to streamline student onboarding and minimize technical barriers. 
  3. Include clear guidance on how students can navigate free-tier usage limits or temporary access restrictions when using free versions of AI tools. 
  4. Require students to annotate or highlight transcripts to make evidence of learning outcomes easy to identify during review. 
molly murphy headshot

Molly Murphy - Learning Designer 

 

 

Quick Details

Faculty Developer: Alison Watkins, Ph.D.

College: USF Muma College of Business

Learning Designer: Molly Murphy

AI Tools Used: ChatGPT