# Assessment Disaggregation

## What this Does

In the Spring of 2016, [Walstad and Wagner](https://doi.org/10.1080/00220485.2016.1146104) released a paper suggesting that the pretest/posttest delta is insufficient in assessing learning outcomes. In 2018, [Smith and Wagner](https://bensresearch.com/smithwagner) showed that this disaggregation should be adjusted using the probability of correctly guessing. In 2021, [Smith and White](https://doi.org/10.1177/01466216211013905) expanded the analysis with adjusted gain estimators.  As this analysis of learning is extremely useful to both research and assessment, this analysis is common. However, performing such a disaggregation and adjustment is time intensive, especially if the questions appear in a different location (or order) on the pretest and posttest.  

This software automatically performs this analysis from raw exam files (currently supporting Akindi, Scantron, Canvas Quizzes, Quick Key, Moodle, Google Forms quizzes, ZipGrade, and some Blackboard systems).  Questions can be in any order as the optional map file can describe how the same question can appear in different locations. 

<figure><img src="https://3217202095-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-MBVxeWftFJy4W81YOoO%2F-MBpK-_FKe0K8Fl0zGBr%2F-MBpK3JnZ2yRH2BvrkjO%2FScreenshot.png?alt=media&#x26;token=f15c932a-8485-4267-80af-8f69ddb1b144" alt="Main sofware interface"><figcaption><p>Main Software Interface</p></figcaption></figure>

The user of this software simply clicks pretest button and selects the pretest file, and clicks on the posttest button and selects the posttest file.  The user can then (optionally) select an assessment map file if the questions are not in the same order. &#x20;


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.assessmentdisaggregation.org/master.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.