G2TT
来源类型Publication
Using Paradata for Instrument Evaluation and Refinement (Presentation)
Amanda Reiter; Sarah Forrestal
发表日期2015-05-30
出版者Hollywood, FL: American Association for Public Opinion Research Annual Conference
出版年2015
语种英语
概述Paradata are a potentially useful tool for improving questionnaire design by helping understand the questions that are more or less effective, the significance of question placement, and the length of time spent on questions by respondents.",
摘要

We used paradata in a two-part web survey fielded to WIC agencies to inform recommendations for instrument refinement in future rounds of administration. These findings included:

  • Dropping or changing the format of burdensome questions (for example, from open-ended to close-ended format).
  • Sending detailed instructions to help with complex questions.
  • Placing high-priority topics early in the survey.
  • Encouraging participation among relevant agency staff.

Paradata are a potentially useful tool for improving questionnaire design by helping understand the questions that are more or less effective, the significance of question placement, and the length of time spent on questions by respondents. For a national study of the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC), we used paradata to evaluate instrument burden and the order of topic presentation, as well as identify potentially problematic questions. Our innovative use of paradata informed our recommendations for refining the instrument for future administration.       

We administered a two-part web survey to 90 state-level and approximately 1,800 local WIC agencies (the response rate was 91% to both parts of the survey). In this paper, we will describe how we used paradata to analyze respondent burden, break-offs, and the order in which respondents completed survey modules. Specifically, we will discuss: 1) using question- and module-level burden estimates to identify survey topics to consider revising in future rounds of administration; 2) considering the frequency of break-offs as a marker of problematic questions; 3) examining the number of login attempts as an indicator of how agency respondents shared responsibility for participation; and 4) analyzing the order of module completion to inform their order of presentation to respondents. Using paradata for questionnaire evaluation is a promising approach with the potential to reduce burden and cost and increase data quality in future administrations.

URLhttps://www.mathematica.org/our-publications-and-findings/publications/using-paradata-for-instrument-evaluation-and-refinement
来源智库Mathematica Policy Research (United States)
资源类型智库出版物
条目标识符http://119.78.100.153/handle/2XGU8XDN/488117
推荐引用方式
GB/T 7714
Amanda Reiter,Sarah Forrestal. Using Paradata for Instrument Evaluation and Refinement (Presentation). 2015.
条目包含的文件
文件名称/大小 资源类型 版本类型 开放类型 使用许可
UseOfParadataforInst(372KB)智库出版物 限制开放CC BY-NC-SA浏览
个性服务
推荐该条目
保存到收藏夹
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Amanda Reiter]的文章
[Sarah Forrestal]的文章
百度学术
百度学术中相似的文章
[Amanda Reiter]的文章
[Sarah Forrestal]的文章
必应学术
必应学术中相似的文章
[Amanda Reiter]的文章
[Sarah Forrestal]的文章
相关权益政策
暂无数据
收藏/分享
文件名: UseOfParadataforInstrumentEvaluation ReiterForrestalpresentation.pdf
格式: Adobe PDF
此文件暂不支持浏览

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。