When choosing to integrate the retrospective pre-test design method into your learning program evaluation and measurement methodology, the selection must take place in the after very carefully evaluating arguments both for and against its utility. The method has many advantages for the practitioner-researcher (see Table 1) but one must be cognisant of the threats to validity. However, in the context of the case study method, triangulation of data from other sources (questionnaires, surveys, quantitative analysis of access logs, LMS records, summative assessments and so on) can be used to counteract or balance such threats.
Table 1 Advantages and disadvantages of the retrospective pre-test model
| Advantages | Disadvantages |
| Simple and cost-effective | Possibility that results were due to history in the job or organisation |
| Reduces costs and time for data collection and analysis | Possible distortions in retrospective reports because of response shift bias |
| Gathers data as part of the learning intervention | |
| Compares post-intervention data with retrospective pre-data | |
| Avoids attrition from the sample being measured | |
| Decreases likelihood of testing effects | |
No comments:
Post a Comment