Our short response AI scoring solution supports numerous rubric types, allowing the evaluation of fact-based questions, skills-based questions, and those that require multiple ideas or points. 

We currently support four powerful question types: general short response, key points, x from y, and categorize. Please get in touch with us with questions that fall outside of these.

General Short Response

This is for questions that require a short answer or explanation with a single correct answer. The student's response is evaluated based on whether it is correct or incorrect.

Figure 1: A short response general rubric for the question:  A reaction is at equilibrium when some product is removed. What will occur?

Some examples: 

• What are finite resources?
• Where did Caratacus flee with his warriors after the Romans invaded their lands?
• What was the main idea of the passage?

Key Points

This is for questions that require learners to give multiple main ideas or demonstrate more than one step in their response. The student's response is evaluated based on whether they have included all the key points and whether they have provided enough detail or explanation for each key point.

The score for this question type is usually binary (0 or 1) for each point, with 1 indicating that the student has included that key point and provided enough detail, and 0 indicating that they have not, but each point can be assigned a score. The total is calculated by summing up the assigned scores for each achieved key point.

Figure 2: A key points rubric including the question stem, learner response, and Feedback Aide-generated score and feedback.

Figure 3: An example key points rubric for this question stem: Write a one-sentence thesis statement about your position on whether our school should adopt school uniforms. Remember to identify your main argument and three supporting points.

Some examples: 

• What are the five stages of grief?
• Briefly define each element of the marketing mix.
• Write a SMART goal.
• Describe the process of mitosis. 

X from Y

This type is for questions where a learner must provide one or more correct answers (X) from a longer list of valid answers (Y).

The score for this question type is usually binary (0 or 1) for each point, with 1 indicating that the student has included that key point and provided enough detail, and 0 indicating that they have not. 

The rubric for this question type should include a list of the valid points that the student may include in their response.

Figure 4: Figure 2: An x from y rubric including the question stem, learner response, and automated scoring and feedback. 

Figure 5: An example x from y rubric for this question: Identify THREE distinct factors that increased tensions between Great Britain and its North American colonies in the period 1763-1776 .

Some examples: 

• Give 3 reasons why the Treaty of Versailles was historically significant.
• Provide three examples of direct patient care careers.
• Name two of Newton’s Laws.

Categorize 

This type is for questions that evaluate the student's ability to categorize or classify information. The student is given a list of items and asked to categorize them into different groups or categories.

The score for this question type is binary (1 or 0) for each item, with 1 indicating that the student has correctly categorized the item, and 0 indicating that they have not.

Figure 6: A categorize example with the question stem, learner response, and graded rubric. 

Some examples:

• Categorize the following animals as either Mammals or Reptiles: Dolphin, Crocodile, Kangaroo, Tortoise, Bat
• Classify each of the following words as either a Noun, Verb, or Adjective: Swift, Happiness, Run, Tower, Shiny
• Sort the following events into their correct historical era: Ancient, Medieval, or Modern: The Fall of the Roman Empire, The Industrial Revolution, The Signing of the Magna Carta, The Invention of the Printing Press, The Rise of the Egyptian Pyramids

For a breakdown of the JSON structure for Feedback Aide rubrics see here.