🎉 Mock Grading Party Guide
← Back to Site

MOCK GRADING PARTY GUIDE

Evaluating AI Feedback Before Student Use

The Scribe Academy

For Teachers, Parents, and Administrators

What is a Mock Grading Party?

A Mock Grading Party is a collaborative session where teachers, parents, and/or administrators review AI-generated feedback on sample essays. The goal is to evaluate the AI's tone, accuracy, and appropriateness before students use the platform.

👀

Preview AI

See feedback first

🎯

Calibrate

Adjust expectations

✅

Build Trust

Confidence in AI

WHY CONDUCT A MOCK GRADING PARTY?

🎓

Teacher Confidence

Teachers can verify that AI feedback aligns with their instructional goals before introducing the tool to students.

👨‍👩‍👧

Parent Buy-In

Parents see exactly what their children will experience, reducing concerns about AI in education.

🔍

Quality Assurance

Identify any edge cases where AI feedback might be confusing, too harsh, or off-target.

📝

Feedback to Us

Your observations help us improve the AI's tone and accuracy for all users.

HOW TO RUN A MOCK GRADING PARTY

1

Gather Sample Essays (5-10)

Use anonymized student essays from previous years, or write sample essays at different quality levels. Include: excellent, good, needs improvement, and struggling examples.

2

Access Sandbox Mode

Request Sandbox access from support@thescribesacademy.com. This provides a safe testing environment with no real student data.

3

Submit Essays for AI Feedback

Enter each sample essay into the platform and generate AI feedback. Save or screenshot each response.

4

Gather Reviewers

Invite 3-5 teachers, parents, or administrators. Provide printed copies of essays + AI feedback, or display on screen.

5

Review & Discuss

For each essay, discuss: Is the feedback accurate? Is the tone appropriate? Would this help a student improve? Any concerns?

6

Document Findings

Use the evaluation rubric below. Share feedback with us so we can improve!

EVALUATION RUBRIC

Rate each AI feedback response on these criteria (1-5 scale):

Criteria Description Score
Accuracy Does the feedback correctly identify strengths and weaknesses? __/5
Tone Is the tone encouraging, constructive, and age-appropriate? __/5
Actionability Does the feedback give specific, actionable suggestions? __/5
Clarity Is the feedback easy for a student to understand? __/5
Alignment Does the feedback align with your instructional goals? __/5

Scoring Guide:

20-25: Excellent - Ready for student use

15-19: Good - Minor adjustments may help

10-14: Fair - Discuss concerns with TSA team

Below 10: Needs review - Contact us before deployment

DISCUSSION QUESTIONS

  • ❓ Would you feel comfortable showing this feedback to a student?
  • ❓ Does the AI catch the same issues you would catch as a teacher?
  • ❓ Is the praise genuine, or does it feel generic?
  • ❓ Would a struggling student feel discouraged or motivated by this feedback?
  • ❓ Are there any factual errors in the AI's suggestions?
  • ❓ Does the feedback align with your school's writing standards?
📬

Share Your Findings!

Your feedback helps us improve the AI for all students. After your Mock Grading Party, please share:

  • • Overall impressions (positive and negative)
  • • Specific examples of feedback that worked well
  • • Specific examples of feedback that needs improvement
  • • Suggestions for tone or content adjustments

Send to: support@thescribesacademy.com

The Scribe Academy | AI-Powered Writing Education

thescribesacademy.com | support@thescribesacademy.com

Document Version: 1.0 | Last Updated: December 2024