Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment

Front Cover
Paul J. Lavrakas, Michael W. Traugott, Courtney Kennedy, Allyson L. Holbrook, Edith D. de Leeuw, Brady T. West
John Wiley & Sons, Oct 8, 2019 - Social Science - 544 pages

A thorough and comprehensive guide to the theoretical, practical, and methodological approaches used in survey experiments across disciplines such as political science, health sciences, sociology, economics, psychology, and marketing

This book explores and explains the broad range of experimental designs embedded in surveys that use both probability and non-probability samples. It approaches the usage of survey-based experiments with a Total Survey Error (TSE) perspective, which provides insight on the strengths and weaknesses of the techniques used.

Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment addresses experiments on within-unit coverage, reducing nonresponse, question and questionnaire design, minimizing interview measurement bias, using adaptive design, trend data, vignettes, the analysis of data from survey experiments, and other topics, across social, behavioral, and marketing science domains.

Each chapter begins with a description of the experimental method or application and its importance, followed by reference to relevant literature. At least one detailed original experimental case study then follows to illustrate the experimental method’s deployment, implementation, and analysis from a TSE perspective. The chapters conclude with theoretical and practical implications on the usage of the experimental method addressed. In summary, this book:

  • Fills a gap in the current literature by successfully combining the subjects of survey methodology and experimental methodology in an effort to maximize both internal validity and external validity
  • Offers a wide range of types of experimentation in survey research with in-depth attention to their various methodologies and applications
  • Is edited by internationally recognized experts in the field of survey research/methodology and in the usage of survey-based experimentation —featuring contributions from across a variety of disciplines in the social and behavioral sciences
  • Presents advances in the field of survey experiments, as well as relevant references in each chapter for further study
  • Includes more than 20 types of original experiments carried out within probability sample surveys
  • Addresses myriad practical and operational aspects for designing, implementing, and analyzing survey-based experiments by using a Total Survey Error perspective to address the strengths and weaknesses of each experimental technique and method

Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment is an ideal reference for survey researchers and practitioners in areas such political science, health sciences, sociology, economics, psychology, public policy, data collection, data science, and marketing. It is also a very useful textbook for graduate-level courses on survey experiments and survey methodology.

 

Contents

Probability SurveyBased Experimentation and the Balancing of Internal
1
4 Threats to Internal Validity
8
A Critical Review and Experimental
23
19
32
3
44
The Challenge
47
Nonresponse
67
1
83
1
270
1
272
Randomized Experiments for WebMail Surveys Conducted Using
275
Design
293
Stata Syntax to Produce Table 15 3 Treatment Allocations
306
Introduction to Section on Trend Data
327
A National Spending Priority Items
339
Vignette Experiments in Surveys
369

Experiments on the Effects of Advance Letters in Surveys
89
23
94
Overview of the Section on the Questionnaire
111
1
112
3
125
Impact of Response Scale Features on Survey Responses to Behavioral
131
3
138
A Question Wording
143
An Experimental
151
Item Nonresponse and Experimental Mortality
167
The Case
181
1
192
Introduction to Section on Interviewers
195
4
212
Investigating Interviewer Effects and Confounds in SurveyBased
225
k
235
Introduction to Section on Adaptive Design
245
6
250
3 5 Independent Randomization
262
Generation of Questionnaire Versions and Allocation to Respondents
375
Response Quality
382
Conclusion
388
Vignettes the Total Survey Error Framework and Cognitive Response Process
394
5
401
7
404
Introduction to Section on Analysis
417
An Answer in Replication
423
Example from Hispanic Women Sample in Tucson AZ
430
Probability Samples Facilitate Estimation of Average Treatment Effects
437
Problems with Statistical Power
443
Stratification for Studying Heterogeneity
444
Implementing Sample Selection
451
Experiments
457
Wald Test
464
Designing the MTME Experiment
487
How can data collection minimize memory effects?
493
397
501
Copyright

Other editions - View all

Common terms and phrases

About the author (2019)

Paul J. Lavrakas, PhD, is Senior Fellow at the NORC at the University of Chicago, Adjunct Professor at University of Illinois-Chicago, Senior Methodologist at the Social Research Centre of Australian National University and at the Office for Survey Research at Michigan State University.

Michael W. Traugott, PhD, is Research Professor in the Institute for Social Research at the University of Michigan.

Courtney Kennedy, PhD, is Director of Survey Research at Pew Research Center in Washington, DC.

Allyson L. Holbrook, PhD, is Professor of Public Administration and Psychology at the University of Illinois-Chicago.

Edith D. de Leeuw, PhD, is Professor of Survey Methodology in the Department of Methodology and Statistics at Utrecht University.

Brady T. West, PhD, is Research Associate Professor in the Survey Research Center at the University of Michigan-Ann Arbor.

Bibliographic information