Item and exam statistics

Item bank item statistics reports

There are a few different ways to pull exam/item statistics from the Prolydian platform. Some statistics are compiled on a per-version basis, for the first two reports below you’ll need to select the desired version before proceeding. You can tell which versions are currently being used from Exams > “Exam name” > Deliver. 

Item Analysis Package:

• Go to Exams > “Exam name” > Analyze

• Click “Download item analysis package”

• Choose a version and exam form and enter in the the desired date range

• Click “Save”
   

This will download a zip file with:

• Response frequencies: how often each response option was selected for each question

• Response strings: what response was chosen by each examinee for each question

• Classical Test Theory (CTT) data 

Detailed Exam/Item Stats:

• Go to Exams > “Exam name” > Versions

• Click the menu (three dots) next to the version name and choose “Calculate Stats” 

This will load a page showing the below information. You can also download this data.

• Test descriptive stats:

  • Passing tests

  • Scored item count

  • Total item count (including pilot items)

  • Mean score

  • Median score

  • Variance

  • Standard deviation

  • Minimum score

  • Maximum score

  • Score range

  • Reliability

• Item descriptive stats:

  • Item name

  • Correct choice

  • Form

  • Pilot question

  • Item answered correctly count

  • Item answered incorrectly count

  • Variance

  • Standard deviation

  • Mean item score

  • Point biserial correlation

• Detailed item stats:

  • Correct choice

  • Count

  • Mean

  • Point-Biserial Correlation

  • Variance

  • Standard deviation

  • Quintile Response Frequency

The following reports can be run from the "Reports" page within Prolydian. If you are missing any of the reports mentioned below, please reach out to us at support@prolydian.com and we will add it for you. 

Basic Item Stats

• Log in to your account at https://app.prolydian.com/
• Go to Reports
• Click on the "Basic Item Stats" report
• Chose a test administration
• Select "Export to Excel" to download a spreadsheet, or "Preview" to view the results in the browser window.
• The report will show the following data for each item
  • Item (name/ID)
  • Responses
  • Min
  • Max
  • Average
  • Std dev (Standard Deviation)
  • Correlation

Item Bank Item Statistics Report

• Log in to your account at https://app.prolydian.com/
• Go to Reports
• Click on the Item Bank Item Statistics report
• Choose the desired item bank from the dropdown menu
• Select "Export to Excel" to download a spreadsheet, or "Preview" to view the results in the browser window.
• This report can be run at any time and the item statistics are cumulative. It provides the below information for each item in a given item bank.
  • Name
  • Status
  • Prompt
  • Correct response
  • Variance
  • Standard Deviation
  • Point Biserial Correlation
  • Mean
     

Exam Session Details:

• Log in to your account at https://app.prolydian.com/
• Go to Reports
• Click on the "Exam Session Details" report
• Click “Preview” or “Export to Excel”
• The report will include the following data for each exam session:
  • Candidate
  • Exam
  • Exam started on (UTC)
  • Exam ended on (UTC)
  • Exam time limit
  • Time remaining (Hours:Minutes:Seconds)
  • Exam score

For instructions on Items banking, please see: