AI-assisted Grading

Rubric Generation v2

3 min read

The v2 with examples prompt enhances the rubric generation process by requiring explicit documentation of the reasoning process through <rubric_development> tags. It provides a more detailed, step-by-step approach with clear examples and formatting guidelines. The prompt asks for justification of point allocations and requires quoting relevant parts of the exam question and grading hints to support each component. This structured approach ensures that the rationale behind each rubric item is thoroughly documented and well-supported.

Prompt

You are a professor specializing in the following domain and topic:
 
<topic_domain>{{topic_domain}}</topic_domain>
<topic_specific>{{topic_specific}}</topic_specific>
 
Your task is to create a comprehensive rubric for grading an exam question. This rubric will be used to ensure fair and efficient grading of student responses.
 
First, review the exam question:
 
<exam_question>
{{EXAM_QUESTION}}
</exam_question>
 
Next, consider these grading hints that outline what a good answer should include:
 
<grading_hints>
{{GRADING_HINTS}}
</grading_hints>
 
The maximum number of points for this question is:
 
<max_points>{{MAX_POINTS}}</max_points>
 
To help you understand the range of possible answers, here are some example responses from students (note that these are not necessarily correct):
 
<example_answer>{{EXAMPLE_1}}</example_answer>
<example_answer>{{EXAMPLE_2}}</example_answer>
<example_answer>{{EXAMPLE_3}}</example_answer>
<example_answer>{{EXAMPLE_4}}</example_answer>
<example_answer>{{EXAMPLE_5}}</example_answer>
 
Now, follow these steps to create the rubric:
 
1. Break down the question into key components:
   Analyze the exam question and grading hints. List the main steps, concepts, or elements a student would need to include in their answer. Ensure these components are at an understandable level of detail. Present this list in numbered format. Quote relevant parts of the exam question and grading hints to support each component.
 
2. Create rubric items:
   For each key component identified, create one or more rubric items. Each rubric item should:
 
   - Clearly define what a student's answer must demonstrate or include
   - Be specific, atomic, and independent (not overlapping with other items)
   - Specify the number of points awarded for satisfying the item
   - Be split into multiple items if there are different ways to satisfy it
 
   Consider different point allocations for each item and justify your choices.
 
   Use this format for each rubric item:
   <rubric_item>
   [Rubric text]
   [X] points
   </rubric_item>
 
   Example:
   <rubric_item>
   Correctly identifies the main character's motivation
   2 points
   </rubric_item>
 
3. Review and finalize:
 
   - Ensure each rubric item clearly defines how to earn the points
   - Verify that items are independent and don't overlap
   - Check that the total points match the maximum points allowed
 
4. Output the complete rubric:
   Present all rubric items within <rubric_item> tags.
 
As you work through this process, wrap your reasoning for each step in <rubric_development> tags. This will help ensure a thorough and well-considered rubric. It's OK for this section to be quite long.

Graph View