AI Use in Assessment Development for UGME Program

This policy establishes responsible artificial intelligence (AI) usage guidelines for assessment development in the USASK College of Medicine’s Undergraduate Medical Education Program, ensuring accuracy, fairness, and ethical compliance.

A. Acceptable Use of AI in Assessments

• AI may assist in generating multiple-choice questions, case-based scenarios, extended written assessments, rubrics, and OSCE station content, provided human oversight is maintained.
• AI can be used to support faculty in analysis, question validation, and assessment standardization but must not replace expert judgment.
• AI-assisted assessments must align with curriculum objectives and evidence-based medical knowledge.

B. Acceptable Use of AI in Feedback and Marking

• AI may assist in the generation of marking criteria, however, it may not be used to mark assessments.
• AI may assist in creation of feedback, however, feedback must be checked by the expert to ensure accuracy.
• If submitting student-created content to an AI tool to generate feedback, review these guidelines for submitting content.
• Student-created content should not be submitted to AI-detection tools as they are unreliable and often biased against certain groups of students.

C. Ethical Considerations & Bias Mitigation

• AI-generated assessments will be reviewed by medical educators to prevent misinformation and reduce potential for bias.
• AI generated content will be checked to ensure respect in areas where biases could be perpetuated.
• AI-generated assessment content will be checked to ensure alignment with curriculum in both content and application.

D. Documentation of AI Use

• Where AI tools are used to generate assessments, faculty must document AI involvement and review how AI was used in the processes with the assessment team.
  • When submitting an assessment where AI has been used please note to the submitting administrator the following information: (1) what AI platform was used and (2) how AI was used.
• AI-generated content must be reviewed and validated by the assessment team before inclusion in formal assessments.
• AI-use will be disclosed to students via the course syllabi: “The College of Medicine may use assessments enhanced with AI tools. All assessments undergo an edit process including multiple people before an assessment is produced for student consumption.”

E. Data Privacy & Security

• AI tools must comply with USASK standards on data protection.
  • AI tools approved by USask
  • If you would like to explore unapproved tools, you should recommend new tools to be reviewed prior to using for university purposes. 
  • Never submit content that is not your own to an AI tool that will use it for training purposed.

Note: If you are using questions from the Examsoft databank, you must use Microsoft Copilot through the University of Saskatchewan (as of November 2025).

F. Oversight

• Faculty must maintain ultimate responsibility for assessment validity, ensuring AI-generated questions and/or analysis meets academic standards and upholds the best practices of non-AI assisted assessment.