What is the learning outcomes report?

The learning outcomes report displays student results according to standards, objectives, and outcomes that are important for your curriculum. The report provides summary and drill down features, for easy browsing of assessment data.

It can be used to easily view and compare results for a class of students.

Figure 1: The Learnosity learning outcomes report.

You can also try out this report for yourself, on our demo site.

The report is powered by the Reports API. For technical information on implementation and configuration options, see the reference documentation page.

Which student sessions will be included in the report?

By default, the report shows a combined result for all assessments taken by each student. It's also possible to filter the included sessions using either activity_id(s) or session tags. Some customers use this to filter between assessment tasks that are assigned by the teacher and practice tasks that are self-assigned by the student.

If a student attempts the same Item multiple times (in different sessions), only the latest attempt of that Item is used. Similarly, if a student attempts the same assessment using the same Activity IDs multiple times (in different sessions), only the latest session is used, even if the status is Incomplete. If the latest attempt of a session is in Incomplete status, using the session_statuses parameter to filter Completed status will not show any results.

Is it possible to show this report based on the school calendar, that is, a group of sessions between the school start and end dates? 

Yes, this is a common use case for the report.

Can you use live data with the learning outcomes report? 

Yes, the report is updated live as students complete their assessments. See our help article on this topic.

How are the columns/categories generated?

The categories are based on the Tags applied to your Learnosity Items. You'll need to use Tags to categorise your content so that the report knows how to present the student scores.

When you implement the report, you choose which Tag Type should be used for the columns of the report. Each Tag within that Tag Type will appear as a column in the report. The student's score is then broken down according to the Tags against the Items they saw.

How does the report's drill down functionality work?

The drill down is configured by specifying an array of column_tag_types. The order of the array corresponds to the levels of the drill down.

Consider the following code:

"column_tag_types": [ 
  "ch_topic", 
  "ch_subtopic", 
  "ch_objective" 
]

Figure 2: JSON configuration for the learning outcomes report.

This specifies that the report's columns will start with topics, drawn from the `ch_topic` Tag Type.

Clicking on a topic will drill down into subtopics. For a subtopic to appear in the drill down, there will need to be at least one Item that has been tagged with both the selected `ch_topic` AND the desired `ch_subtopic`. In other words, your Items need to be tagged with both `ch_topic` AND `ch_subtopic`, and the drill down will filter to show only those subtopics that were tagged within the selected topic.

Clicking on a subtopic will drill into objectives of that subtopic. Similar to the above, there will need to be Items tagged with `ch_topic` AND `ch_subtopic` AND `ch_objective`. The report finds the Items that match the selected topic and subtopic, and then shows a column for each of the objectives it finds on those Items.

The report supports up to five levels in the drill down (ie. five Tag Types).

How are the score percentages calculated? 

Each student's score percentage is based on the Items which that student has seen across the included sessions:

• By default, all sessions are included.
• If one or more activity_ids are provided, sessions from any of the matching activity_ids are included (ie, activity_ids are applied as a boolean OR filter).
• If session_tags are used, sessions must match all the supplied session_tags to be included (ie, session_tags are applied as a boolean AND filter).

The score percentage is calculated as:

sum of scores on included Items
÷
sum of max_scores on those Items

• For a specific tag/column or drill down of the report, the "included items" is filtered to only those Items whose tagging matches that column/drill down.
• If an Item is tagged to multiple columns of the report, its score and max_score contribute to both columns.
• If a student saw the same Item (ie. item_reference) in multiple sessions, only the most recent attempt of the Item is recorded, and it's assigned against the most recent activity_id. This can be unexpected if a student is assigned the same Item in different activities: the Item's score will contribute against the second activity, and disappear from the first activity.

The report's mouseover tooltips show the raw score totals for Items correct, incorrect, unattempted and not yet marked.

How do I start using the learning outcomes report? 

Note: this report is part of our Premium Analytics products - check with your sales person or Learnosity support team to confirm you can use the learning outcomes report.

To get you started, Learnosity will need to create one or more live datasets for you to use with the report. Read about live datasets and how to use them in our guide to Using Live Datasets for Learning Outcomes Reporting.

Once your Live Datasets are created, implement the report using the Reports API. For technical implementation and configuration details, see the reference documentation page.

What are live datasets and how are they created?

Read about live datasets and how to use them in our guide to Using Live Datasets for Learning Outcomes Reporting.

Limitations

• The learning outcomes report does not currently support multiple Item banks.

• The learning outcomes report is not currently integrated with any of our partner item banks.

Next steps

• Help article: Using Live Datasets for Learning Outcomes Reporting
• Reference Documentation: Configuring Reports With Item Scores by Tag by User