Student Analysis and Item Analysis

Section Filter

If you teach the same course for multiple sections, you can look at quiz statistics based on a section or as a whole.

Student Information

Column A: Full name

Column B: Unique student ID generated by Canvas

Column C: Unique student ID generated by UNC SIS

Submission Information

Column G: Ordered by "Year-Month-Day Hour:minute:Second" in Universal Coordinated Time (UTC)

Column H: Each time a student submits a quiz, a new row will appear. If a student submits a quiz more than once, the attempt number will increase by one.

Question Information

Column I & K: Each question has a back-end, Canvas-specific identification. The question text is also included.

Column H & L: Depending on your quiz question settings, students will earn a number of points. 0 = no points

Question Information

Column A - Question ID: Each question has a back-end, Canvas-specific identification.
Column B - Question Title: The entire question is provided via text.
Column C - Answered Student Count: Helpful when using randomized question banks to see how many students received a particular question.

Top / Middle / Bottom Student Count

Column D - F: Canvas automatically sorts the top / middle / bottom count for each question based on the student's total quiz grade. The top / middle / bottom performing students are automatically categorized based on their total quiz score: the top 27%, the middle 46%, and the bottom 27%. 

Column G - Quiz Question Count: Total number of questions within the quiz.

Correct / Wrong Student Count

The sum of both columns (H & I) will equal the Answered Student Count (column C)

Correct / Wrong Student Ratio

Column J - Correct Student Ratio: This number is also found in the Question Breakdown section for each question and is also calculated as the Difficulty Index (column Q). The sum of both proportions will always equal 1.

Correct Top / Middle / Bottom Count

The overall performance automatically sorts each student into one of the three tiers (top / middle / bottom).

Variance / Standard Deviation

The greater the number, the greater the spread. Variance is the standard deviation squared.

Difficulty Index

Column Q - Correct Student Ratio: This number is found in the Question Breakdown section for each question (example below) and is also calculated as the Correct Student Ratio (column J).

Alpha Score

Also considered reliability, the alpha score assesses if multiple questions are measuring the same information in which the student will answer in a similar way. The higher the alpha score, the more reliable the overall quiz. A good alpha score is anything above 0.7.

Point Biserial (Discrimination Index)

Column S - Point Biserial Correct:The calculation is a correlation between the top / middle / bottom performing students who answered the question correctly. The top / middle / bottom performing students are automatically sorted based on their total quiz score: the top 27%, the middle 46%, and the bottom 27%.

Anything above +0.24 is considered to have a good discrimination index. A good discrimination index is a question that the top / middle performing students answered correctly while the low performing students did not answer correctly. A discrimination index of 0 is considered neutral because all students answered the question correctly. If your discrimination index is red (less than +0.24), consider revising the question and / or possible answers.

The image below is a representation of how the discrimination is calculated based on students either answering correctly or incorrectly.