How low should you go? Low response rates and the validity of inference in IS questionnaire research

    Authors

    S. A. Sivo; C. Saunders; Q. Chang;J. J. Jiang

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    J. Assoc. Inf. Syst.

    Keywords

    response rate; nonresponse errors; external validity; statistical; conclusion validity; INFORMATION-SYSTEMS; MAIL SURVEYS; EXTERNAL VALIDITY; QUALITY; MANAGEMENT; NONRESPONSE BIAS; MIS RESEARCH; SAMPLE-SIZE; MODEL; POWER; IMPACT; Computer Science, Information Systems; Information Science & Library; Science

    Abstract

    We believe IS researchers can and should do a better of job of improving ( assuring) the validity of their findings by minimizing nonresponse error. To demonstrate that there is, in fact, a problem, we first present the response rates reported in six well-regarded IS journals and summarize how nonresponse error was estimated and handled in published IS research. To illustrate how nonresponse error may bias findings in IS research, we calculate its impact on confidence intervals. After demonstrating the impact of nonresponse on research findings, we discuss three post hoc remedies and three preventative measures for the IS researcher to consider. The paper concludes with a general discussion about nonresponse and its implications for IS research practice. In our delimitations section, we suggest directions for further exploring external validity.

    Journal Title

    Journal of the Association for Information Systems

    Volume

    7

    Issue/Number

    6

    Publication Date

    1-1-2006

    Document Type

    Review

    Language

    English

    First Page

    351

    Last Page

    414

    WOS Identifier

    WOS:000246738500001

    ISSN

    1536-9323

    Share

    COinS