| 来源类型 | Discussion paper |
| 规范类型 | 论文 |
| 来源ID | DP16099 |
| DP16099 Understanding Performance in Test Taking: The Role of Question Difficulty Order | |
| Lina Anaya; Nagore Iriberri; Pedro Rey Biel; Gema Zamarro | |
| 发表日期 | 2021-05-03 |
| 出版年 | 2021 |
| 语种 | 英语 |
| 摘要 | Standardized assessments are widely used to determine access to educational resources with important consequences for later economic outcomes in life. However, many design features of the tests themselves may lead to psychological reactions influencing performance. In particular, the level of difficulty of the earlier questions in a test may affect performance in later questions. How should we order test questions according to their level of difficulty such that test performance offers an accurate assessment of the test taker's aptitudes and knowledge? We conduct a field experiment with about 19,000 participants in collaboration with an online teaching platform where we randomly assign participants to different orders of difficulty and we find that ordering the questions from easiest to most difficult yields the lowest probability to abandon the test, as well as the highest number of correct answers. Consistent results are found exploiting the random variation of difficulty across test booklets in the Programme for International Student Assessment (PISA), a triannual international test, for the years of 2009, 2012, and 2015, providing additional external validity. We conclude that the order of the difficulty of the questions in tests should be considered carefully, in particular when comparing performance between test-takers who have faced different order of questions |
| 主题 | Public Economics |
| URL | https://cepr.org/publications/dp16099 |
| 来源智库 | Centre for Economic Policy Research (United Kingdom) |
| 资源类型 | 智库出版物 |
| 条目标识符 | http://119.78.100.153/handle/2XGU8XDN/545076 |
| 推荐引用方式 GB/T 7714 | Lina Anaya,Nagore Iriberri,Pedro Rey Biel,et al. DP16099 Understanding Performance in Test Taking: The Role of Question Difficulty Order. 2021. |
| 条目包含的文件 | 条目无相关文件。 | |||||
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。
