Show Me the Money! Evaluating A Graduated Incentive Structure to Keep Respondents Engaged Through 101 Surveys in 28 Days

We report the results of a survey test conducted in advance of a series of community response tests (CRTs) to evaluate response to noise from NASA’s X-59 aircraft. The CRTs will require a substantial number of observations to generate a dose response curve for noise exposure and related annoyance levels and the timeframe is limited due to resource and scheduling constraints with an experimental aircraft. Within each CRT area, we will recruit a sample of residents in advance and ask them to fill out a brief survey each time the aircraft passes over. Respondents will be asked to fill out the survey either on the web or as part of an application they are able to download onto their mobile phones. Respondents will be notified each time the plane flies over, asking for their reactions. On many days, respondents will be asked to fill out the survey for multiple flights. Typical incentives are used during the recruitment phase (pre-incentive for a household screener and post-paid for a background survey completed by the selected respondent) and post-paid for an end of study survey. To improve response rates over such a demanding survey schedule (101 surveys in 28 days) we will implement a weekly incentive based upon participation rates, with higher incentives for greater participation and increasing rates each week. The survey test will follow the proposed methodology of the CRTs. We will report on the participation rates by incentive amount and the effectiveness of the incentive structure in obtaining and maintaining response rates over the 4 weeks. We will examine how quickly participation fades over the 4-week period and consider whether the incentive schedule could be improved by altering the distribution of payments. Finally, we will compare how these rates varied across web and app respondents. We will use the results of this work to confirm or improve the design of the CRTs, ensuring the collection of data needed by NASA to evaluate the impact of this innovative technology.