The social survey has become an essential tool in modern society, providing crucial measurements of social change, describing social life, and guiding government policy. But the validity of surveys is fragile and depends ultimately upon the accuracy of answers to survey questions. As our dependence on surveys grows, so too have questions about the accuracy of survey responses. Authored by a group of experts in cognitive psychology, linguistics, and survey research, Questions About Questions provides a broad review of the survey response problem. Examining the cognitive and social processes that influence the answers to questions, the book first takes up the problem of meaning and demonstrates that a respondent must share the survey researcher's intended meaning of a question if the response is to be revealing and informative. The book then turns to an examination of memory. It provides a framework for understanding the processes that can introduce errors into retrospective reports, useful guidance on when those reports are more or less trustworthy, and investigates techniques for the improvement of such reports. Questions about the rigid standardization imposed on the survey interview receive a thorough airing as the authors show how traditional survey formats violate the usual norms of conversational behavior and potentially endanger the validity of the data collected. Synthesizing the work of the Social Science Research Council's Committee on Cognition and Survey Research, Questions About Questions emphasizes the reciprocal gains to be achieved when insights and techniques from the cognitive sciences and survey research are exchanged. "these chapters provide a good sense of the range of survey problems investigated by the cognitive movement, the methods and ideas it draws upon, and the results it has yielded." —American Journal of Sociology

The definitive resource for survey questionnaire testing and evaluation Over the past two decades, methods for the development, evaluation, and testing of survey questionnaires have undergone radical change. Research has now begun to identify the strengths and weaknesses of various testing and evaluation methods, as well as to estimate the methods’ reliability and validity. Expanding and adding to the research presented at the International Conference on Questionnaire Development, Evaluation and Testing Methods, this title presents the most up-to-date knowledge in this burgeoning field. The only book dedicated to the evaluation and testing of survey questionnaires, this practical reference work brings together the expertise of over fifty leading, international researchers from a broad range of fields. The volume is divided into seven sections: Cognitive interviews Mode of administration Supplements to conventional pretests Special populations Experiments Multi-method applications Statistical modeling Comprehensive and carefully edited, this groundbreaking text offers researchers a solid foundation in the latest developments in testing and evaluating survey questionnaires, as well as a thorough introduction to emerging techniques and technologies.

To the uninformed, surveys appear to be an easy type of research to design and conduct, but when students and professionals delve deeper, they encounter the vast complexities that the range and practice of survey methods present. To complicate matters, technology has rapidly affected the way surveys can be conducted; today, surveys are conducted via cell phone, the Internet, email, interactive voice response, and other technology-based modes. Thus, students, researchers, and professionals need both a comprehensive understanding of these complexities and a revised set of tools to meet the challenges. In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other "how-to" guides and references texts on survey research, none is as comprehensive as this Encyclopedia, and none presents the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective that considers all aspects of possible survey error from a cost-benefit standpoint. Key Features Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the thorny issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses Presents a Reader′s Guide to organize entries around themes or specific topics and easily guide users to areas of interest Offers cross-referenced terms, a brief listing of Further Readings, and stable Web site URLs following most entries The Encyclopedia of Survey Research Methods is specifically written to appeal to beginning, intermediate, and advanced students, practitioners, researchers, consultants, and consumers of survey-based information.

The use of the cognitive interviewing method for survey question testing has proliferated and evolved over the past 30 years. In more recent years the method has been applied to the evaluation of information letters and leaflets and to research consent forms. This book provides a practical handbook for implementing cognitive interviewing methods in the context of applied social policy research, based on the approach used by the authors at the NatCen Social Research (NatCen) where cognitive interviewing methods have been used for well over a decade. The book provides a justification for the importance of question testing and evaluation and discusses the position of cognitive interviewing in relation to other questionnaire development and evaluation techniques. Throughout the book, the focus is on providing practical and hands-on guidance around elements such as sampling and recruitment, designing probes, interviewing skills, data management and analysis and how to interpret the findings and use them to improve survey questions and other documents. The book also covers cognitive interviewing in different survey modes, in cross national, cross cultural and multilingual settings and discusses some other potential uses of the method.

Survey Methodology is becoming a more structured field of research, deserving of more and more academic attention. The SAGE Handbook of Survey Methodology explores both the increasingly scientific endeavour of surveys and their growing complexity, as different data collection modes and information sources are combined. The handbook takes a global approach, with a team of international experts looking at local and national specificities, as well as problems of cross-national, comparative survey research. The chapters are organized into seven major sections, each of which represents a stage in the survey life-cycle: Surveys and Societies Planning a Survey Measurement Sampling Data Collection Preparing Data for Use Assessing and Improving Data Quality The SAGE Handbook of Survey Methodology is a landmark and essential tool for any scholar within the social sciences.

The work provides general guidance about questionnaire design, development, and pre-testing sequence, with an emphasis on the cognitive interview.

In this first book of the series Survey Methods in Educational Research, we have brought together leading authors and scholars in the field to discuss key introductory concepts in the creation, implementation, evaluation and dissemination of survey instruments and their resultant findings. While there are other textbooks that might introduce these concepts adequately well, the authors here have focused on the pragmatic issues that inevitably arise in the development and administration process of survey instruments. Drawing from their rich experiences, the authors present these potential speed bumps or road blocks a survey researcher in education or the social sciences might encounter. Referencing their own work and practice, the authors provide valuable suggestions for dealing with these issues “your advisor never told you about.” And all of the recommendations are aligned with standard protocols and current research on best practices in the field of research methodology. This book is broken into four broad units on creating survey items and instruments, administering surveys, analyzing the data from surveys, and stories of successful administrations modeling the entire research cycle. Each chapter focuses on a different concept in the survey research process, and the authors share their approaches to addressing the issues. These topics include survey item construction, scale development, cognitive interviewing, measuring change with self-report data, translation issues with surveys administered in multiple languages, working with school and program administrators when implementing surveys, a review of current software used in survey research, the use of weights, response styles, assessing validity of results, and effectively communicating your results and findings … and much more. The intended audience of the volume will be practitioners, administrators, teachers as researchers, graduate students, social science and education researchers not experienced in survey research, and students learning program evaluation. In brief, if you are considering doing survey research, this book is meant for you.

This valuable book examines the complex psychological processes involved in answering different types of survey questions. Drawing on both classic and modern research from cognitive psychology, social psychology, and survey methodology, the authors examine how survey responses are formulated and they demonstrate how seemingly unimportant features of the survey can affect the answers obtained. The book provides a comprehensive review of the sources of response errors in surveys, and it offers a coherent theory of the relation between the underlying views of the public and the results of public opinion polls. Topics include the comprehension of survey questions, the recall of relevant facts and beliefs, estimation and inferential processes people use to answer survey questions, the sources of the apparent instability of public opinion, the difficulties in getting responses into the required format, and the distortions introduced into surveys by deliberate misreporting.

These Guidelines represent the first attempt to provide international recommendations on collecting, publishing, and analysing subjective well-being data.