In order to perform advanced psychometric analysis on your exams and items, you will need to export response data. Scorpion provides several export formats. You can find these options by clicking on the drop down menu in the top left-hand corner and clicking on Export.
File Format
This data exports as tab-delimited text files (.txt). By default these files will open in your operating system’s text editor. However, they are designed to be opened by spreadsheet programs such as Microsoft Excel or LibreOffice Calc. The simplest way to import these files is to launch the spreadsheet application first and then use the Open menu to find and load the downloaded export file. After that you will be able to save the file in a native spreadsheet format.
Delivery Summary Export
Each row provides summary data for an individual delivery of an exam. Only complete deliveries are exported. At minimum this format provides the following columns:
- Delivery ID: a universally unique identifier (UUID) that can be used to map this delivery summary information to more detailed data in other export formats.
- Date: an ISO formatted timestamp of when the delivery was completed
- Exam Name: the name of the exam
- Score: the adjusted score based on the scale in the exam settings at the time of delivery
- Passed: whether the user achieved at least one cutscore at the time of the delivery (True/False)
- Points Earned: the raw score
- Points Available: the number of points available on the exam at the time of delivery
- Duration: the duration of the delivery in seconds
- Form: the name of the form
This export will also contain columns for each field in the Examinee Schema [NEED LINK TO AN ARTICLE ON EXAMINEE SCHEMAS].
This export provides basic performance statistics for each item in the exam. Each row represents a version of an item.
- Item Name: This first column identifies the item name and version number (<item_name>_v<version_number>)
- P Value: the proportion of examinees who answered the item correctly
- Correlation: the correlation of the user’s score on the item to their score on the exam
- Responses: the number of responses collected for this version of the item
Item Scores Export
As with the Delivery Summary export, this format gives one row to each individual delivery. While it contains some delivery summary data, it provides one column for each item version in the exam and a value representing the score the examinee earned on that item.
- Delivery ID: a universally unique identifier (UUID) that can be used to map this row to more detailed data in other export formats.
- Date: an ISO formatted timestamp of when the delivery was completed
- <item_name>_v<version_number>: Each of these columns represents a version of an item. Values in this column fall between 0 and 1 and represent the score the examinee achieved on the item. Empty cells mean that the examinee did not see that item/version.
Full Responses Export
This is the most comprehensive export of response data. Each row represents an individual response to an item. Note: items can receive multiple responses if mark and review is enabled or it is a DOMC item [LINK TO DOMC ARTICLE OR TRYDOMC.COM].
- delivery_id: a universally unique identifier (UUID) that can be used to map this row to more detailed data in other export formats
- item_id: identifies s the item name and version number (<item_name>_v<version_number>)
- item_type: the type of item
- multiple_choice
- build_list
- domc
- matching
- short_answer
- essay
- status: a string representing the type of response
- final: the final scored response
- changed: a previous response that was changed
- domc_stem: not really a response, but a row representing the time the user spent reading the stem before requesting an option
- domc_option: a response to a single scored option in domc items
- domc_extra: a response to the random additional option in domc items
- block_idx: the position of the page in the exam that this item was presented on (0-indexed)
- block_len: the number of items on the page
- item_idx: the position of the item in the whole exam (0-indexed)
- start: the ISO format timestamp of when the user started working on this response
- end: the ISO format timestamp of when the user submitted this response
- response: a value
- key: a value representing the key for the item
- domc: 0/1 representing whether this option is correct
- multiple_choice: an array of 0/1 values representing which option indexes are correct or not
- build_list: an array of int/null values representing the order of each option
- short_answer: an array of accepted strings
- matching: an array of match indexes for each option
- presented: a value representing the how the options were presented
- domc: the index of the presented option
- multiple_choice, build_list, matching:: an array of option indexes in the order they were presented
- score: value between 0 and 1 that represents the score the examinee achieved on the item
- points: the number of points available for this item
Item Comments
This export includes all comments that examinees have submitted as part of their exam experience.
Note: Additional export formats and columns may be available upon request.
Comments
0 comments
Article is closed for comments.