Title Page

Copyright Page

Contents

Preface

Notes on Contributors

Section I Introduction

Chapter 1 The Promise and Challenge of 3MC Research

1.1 Overview

1.2 The Promise

1.3 The Challenge

1.4 The Current Volume

References

Chapter 2 Improving Multinational, Multiregional, and Multicultural (3MC) Comparability Using the Total Survey Error (TSE) Paradigm

2.1 Introduction

2.2 Concept of Total Survey Error

2.3 TSE Interactions

2.4 TSE and Multiple Surveys

2.5 TSE Comparison Error in Multinational Surveys

2.6 Components of TSE and Comparison Error

2.7 Obtaining Functional Equivalence and Similarity in Comparative Surveys

2.8 Challenges of Multinational Survey Research

2.9 Language

2.10 Structure

2.11 Culture

2.12 Resources for Developing and Testing Cross‐national Measures

2.13 Designing and Assessing Scales in Cross‐national Survey Research

2.14 TSE and the Multilevel, Multisource Approach

2.15 Documentation

2.16 Conclusion

References

Chapter 3 Addressing Equivalence and Bias in Cross‐cultural Survey Research Within a Mixed Methods Framework

3.1 Introduction

3.2 Equivalence and Comparability: Supporting Validity of the Intended Interpretations

3.3 A Comprehensive Approach to Bias Analysis in 3MC Surveys Within a Mixed Methods Research Framework

3.4 Closing Remarks

References

Section II Sampling Approaches

Chapter 4 Innovative Sample Designs Using GIS Technology

4.1 Introduction

4.2 Cluster Selection Stage

4.3 Household Stage

4.4 Discussion

References

GIS and Remote Sensing Data Resources

Chapter 5 Within‐household Selection of Respondents

5.1 Introduction

5.2 Within‐household Respondent Selection Methods

5.3 Within‐household Selection Methods in Cross‐national Surveys: The Case of ESS

5.4 A Few Practical Challenges of Within‐household Sampling in Cross‐national Surveys

5.5 Summary and Recommendations

References

Section III Cross‐cultural Questionnaire Design and Testing

Chapter 6 Overview of Questionnaire Design and Testing

6.1 Introduction

6.2 Review of Questionnaire Design and Testing in a Comparative Context

6.3 Advances in Questionnaire Design and Testing

6.4 Conclusions

References

Chapter 7 Sensitive Questions in Comparative Surveys

7.1 Sensitivity Issues in a Comparative Context

7.2 The Definition of Sensitivity

7.3 Approaches to Minimizing the Effect of Sensitivity

7.4 Measuring Sensitivity in Cross‐national Contexts

7.5 New Evidence of Cross‐national Sensitivity: SQS Project

7.6 Understanding Sensitivity

7.7 Summary

References

Chapter 8 Implementing a Multinational Study of Questionnaire Design

8.1 Introduction

8.2 Scope of the MSQD

8.3 Design of the MSQD

8.4 Experiments Implemented in the MSQD

8.5 Translation Requirements and Procedures

8.6 Findings on Feasibility and Limitations Due to Translations and Required Adaptations

8.7 Example Results

8.8 Conclusion

Acknowledgments

References

Chapter 9 Using Anchoring Vignettes to Correct for Differential Response Scale Usage in 3MC Surveys

9.1 Introduction

9.2 Reporting Heterogeneity

9.3 Anchoring Vignettes: Design and Analysis

9.4 Validity of the Model Assumptions

9.5 Practical Issues

9.6 Empirical Demonstration of the Anchoring Vignette Method

9.7 Sensitivity Analysis: Number of Vignettes and Choices of Vignette Intensity

9.8 Discussion and Conclusion

References

Chapter 10 Conducting Cognitive Interviewing Studies to Examine Survey Question Comparability

10.1 Introduction

10.2 Cognitive Interviewing as a Study in Validity

10.3 Conducting a Comparative Cognitive Interviewing Study

10.4 Real‐World Application

10.5 Conclusion

References

Chapter 11 Setting Up the Cognitive Interview Task for Non‐English‐speaking Participants in the United States

11.1 Introduction

11.2 Differences in Communication Styles Across Languages and Cultures

11.3 Implications of Cross‐cultural Differences in Survey Pretesting

11.4 Setting up the Cognitive Interview Task for Non‐English‐speaking Participants

11.5 Discussion and Recommendations for Future Studies

Disclaimer

Acknowledgment

References

Chapter 12 Working Toward Comparable Meaning of Different Language Versions of Survey Instruments: Do Monolingual and Bilingual Cognitive Testing Respondents Help to Uncover the Same Issues?

12.1 Introduction

12.2 Review of the Literature

12.3 Motivation for the Current Study: US Census Bureau Spanish Usability Testing

12.4 The Monolingual and Bilingual Cognitive Testing Study

12.5 Results of the Cognitive Testing

12.6 Summary and Conclusions

12.7 Future Research

Disclaimer

Acknowledgment

References

Chapter 13 Examining the Comparability of Behavior Coding Across Cultures

13.1 Introduction

13.2 Methods

13.3 Results

13.4 Discussion

Acknowledgments

References

Section IV Languages, Translation, and Adaptation

Chapter 14 How to Choose Interview Language in Different Countries

14.1 Introduction

14.2 The Issue of Multilingualism

14.3 Current Practice of Language Choice in Comparative Surveys

14.4 Using a Language Survey for Decisions About Language Choice for an Interview: Example of Post‐Soviet Region

14.5 The Choice of Interview Language on the Level of Individual Respondent

14.6 Summary

References

Chapter 15 Can the Language of Survey Administration Influence Respondents’ Answers?

15.1 Introduction

15.2 Language, Cognition, and Culture

15.3 Language of Administration in Surveys of Bilingual Bicultural Respondents

15.4 Data and Methods

15.5 Results

15.6 Discussion and Conclusions

References

Chapter 16 Documenting the Survey Translation and Monitoring Process

16.1 Introduction

16.2 Key Concepts

16.3 Case Study: The ESENER‐2 Study

16.4 Translation Documentation from a Project Management Perspective

16.5 Translation Documentation from the Perspective of Translation Teams

16.6 Translation Documentation from the Perspective of Applied Translation Research

16.7 Translation Documentation from the Perspective of Data Analysts

16.8 Summary and Outlook

References

Chapter 17 Preventing Differences in Translated Survey Items Using the Survey Quality Predictor

17.1 Introduction

17.2 Equivalence in Survey Translation

17.3 Cross‐cultural Survey Translation and Translation Assessment

17.4 Formal Characteristics of a Survey Item

17.5 Using SQP: A Five‐step Procedure for Comparing Item Characteristics Across Languages

17.6 Questions Evaluated in the ESS Round 5, Round 6, and Round 7

17.7 Discussion

References

Section V Mixed Mode and Mixed Methods

Chapter 18 The Design and Implementation of Mixed‐mode Surveys

18.1 Introduction

18.2 Consequences of Mixed‐mode Design

18.3 Designing for Mixed Mode

18.4 Auxiliary Data for Assessing and Adjusting Mode Effects

18.5 Conclusions

Acknowledgment

References

Chapter 19 Mixed‐mode Surveys: Design, Estimation, and Adjustment Methods

19.1 Introduction

19.2 Methods

19.3 Results

19.4 Discussion and Conclusions

References

Chapter 20 Mixed Methods in a Comparative Context: Technology and New Opportunities for Social Science Research

20.1 Introduction

20.2 Mixed Methods Data Collection Redefined

20.3 Considerations about Alternate Sources of Data

20.4 Examples of Social Science Research Using New Technologies

20.5 Linking Alternative and Survey Data

20.6 Mixed Methods with Technologically Collected Data in the 3MC Context

20.7 Conclusions

Acknowledgments

References

Section VI Response Styles

Chapter 21 Cross‐cultural Comparability of Response Patterns of Subjective Probability Questions

21.1 Introduction

21.2 State‐of‐art Application of Subjective Probability Questions in Surveys

21.3 Policy Relevance of Subjective Probability Questions

21.4 Measurement Mechanism for Subjective Probability Questions

21.5 Data and Methods

21.6 Results

21.7 Discussion

References

Chapter 22 Response Styles in Cross‐cultural Surveys

22.1 Introduction

22.2 Data and Measures

22.3 OLS Regression Analysis

22.4 Confirmatory Factor Analysis

22.5 Latent Class Analysis

22.6 Multidimensional Unfolding Model

22.7 Discussion and Conclusion

References

Chapter 23 Examining Translation and Respondents’ Use of Response Scales in 3MC Surveys

23.1 Introduction

23.2 Data and Methods

23.3 Results

23.4 Discussion

References

Section VII Data Collection Challenges and Approaches

Chapter 24 Data Collection in Cross‐national and International Surveys:: Regional Case Studies

24.1 Introduction

24.2 Recent Developments in Survey Data Collection

24.3 Data Collection Challenges Faced in Different Regions of the World

24.4 Future Directions

References

Chapter 25 Survey Data Collection in Sub‐Saharan Africa (SSA):: Challenges, Strategies, and Opportunities

25.1 Introduction

25.2 Overview of Common Challenges and Solutions in Data Collection in Sub‐Saharan Africa

25.3 Strategies and Opportunities

25.4 Future Developments

References

Chapter 26 Survey Challenges and Strategies in the Middle East and Arab Gulf Regions

26.1 Introduction

26.2 Household and Within‐household Sampling

26.3 Interviewer–Respondent Gender Matching

26.4 Nationality‐of‐interviewer Effects

26.5 Response Scale Heterogeneity

26.6 Conclusion: Outstanding Challenges and Future Directions

References

Chapter 27 Data Collection in Cross‐national and International Surveys: Latin America and the Caribbean

27.1 Introduction

27.2 Survey Research in the Latin America and Caribbean Region

27.3 Confronting Challenges with Effective Solutions

27.4 New Opportunities

27.5 Conclusion

References

Chapter 28 Survey Research in India and China

28.1 Introduction

28.2 Social Science Surveys in India and China

28.3 Organizational Structure of Surveys

28.4 Sampling for Household Surveys

28.5 Permission and Approvals

28.6 Linguistic Issues

28.7 Future Directions: New Modes of Data Collection

References

Chapter 29 Best Practices for Panel Maintenance and Retention

29.1 Introduction

29.2 Retention Rates

29.3 Panel Maintenance Strategies

29.4 Study Development and the Harmonization of Field Practices

29.5 Conclusion

References

Chapter 30 Collection of Biomeasures in a Cross‐national Setting: Experiences in SHARE

30.1 Introduction

30.2 Background

30.3 Types of Biomeasures Collected

30.4 Logistic Considerations

30.5 Quality Assurance Procedures

30.6 Ethical and Legal Issues Across Countries

30.7 Summary and Conclusions

Acknowledgments

References

Chapter 31 Multinational Event History Calendar Interviewing

31.1 Introduction

31.2 EHC Interviews in a Multinational Setting

31.3 EHC Interview Administration

31.4 EHC Interviewer Training

31.5 Interviewer Monitoring in an International Survey

31.6 Coding Procedures

31.7 Evaluation of Interviewer Behavior

31.8 Feedback Processing Speed

31.9 Effects of Feedback and Interviewer Effects Across Countries

31.10 Use of Different Cross‐checks Across Countries

31.11 Discussion

References

Chapter 32 Ethical Considerations in the Total Survey Error Context

32.1 Introduction

32.2 Ethical Considerations and the TSE Framework

32.3 Origins and Framework of Human Subjects Protection Standards

32.4 The Belmont Report and the Components of Human Subjects Protection

32.5 Final Remarks

Acknowledgment

References

Chapter 33 Linking Auxiliary Data to Survey Data: Ethical and Legal Challenges in Europe and the United States

33.1 Introduction

33.2 Ethical Guidelines and Legal Framework

33.3 What Constitutes Personal Data?

33.4 Confidentiality

33.5 Consent

33.6 Concluding Remarks

References

Section VIII Quality Control and Monitoring

Chapter 34 Organizing and Managing Comparative Surveys

34.1 Introduction

34.2 Background

34.3 Factors That Impact 3MC Survey Organization and Management

34.4 General Considerations and Survey Quality When Applying Project Management to 3MC Surveys

34.5 The Application of Project Management to 3MC Surveys

34.6 Conclusion

References

Chapter 35 Case Studies on Monitoring Interviewer Behavior in International and Multinational Surveys

35.1 Introduction

35.2 Case Studies

35.3 Conclusion

References

Chapter 36 New Frontiers in Detecting Data Fabrication

36.1 Introduction

36.2 Standard Approaches to Detecting Data Falsification

36.3 Approaches to Preventing Falsification

36.4 Additional Challenges

36.5 New Frontiers in Detecting Fraud

36.6 A Way Forward

References

Section IX Nonresponse

Chapter 37 Comparing Nonresponse and Nonresponse Biases in Multinational, Multiregional, and Multicultural Contexts

37.1 Introduction

37.2 Harmonization

37.3 Data Collection Factors

37.4 Assessment of Risk of Nonresponse Bias

37.5 Post‐survey Adjustment

37.6 Conclusion

References

Chapter 38 Geographic Correlates of Nonresponse in California: A Cultural Ecosystems Perspective

38.1 Introduction

38.2 Data and Methods

38.3 Results

38.4 Discussion and Limitations

References

Chapter 39 Additional Languages and Representativeness

39.1 Introduction

39.2 Data

39.3 Methods

39.4 Results

39.5 Summary and Conclusion

References

Section X Multi‐group Analysis

Chapter 40 Measurement Invariance in International Large‐scale Assessments: Integrating Theory and Method

40.1 Introduction

40.2 Measurement Invariance Review

40.3 Advances in Measurement Invariance

40.4 The Stepwise Procedure

40.5 Evaluation Criteria

40.6 An Example

40.7 Conclusion

References

Chapter 41 Approximate Measurement Invariance

41.1 Introduction

41.2 The Multigroup Confirmatory Factor Analysis

41.3 Illustration

41.4 Discussion and Conclusion

Acknowledgment

References

Section XI Harmonization, Data Documentation, and Dissemination

Chapter 42 Data Harmonization, Data Documentation, and Dissemination

Reference

Chapter 43 Basic Principles of Survey Data Recycling

43.1 Introduction

43.2 The Process of Survey Data Recycling

43.3 The Logic of SDR

43.4 Using SDR in Constructing the Harmonized Dataset

43.5 Conclusions

Acknowledgments

References

Chapter 44 Survey Data Harmonization and the Quality of Data Documentation in Cross‐national Surveys

44.1 Introduction

44.2 Standards for Describing the Survey Process from Sampling to Fieldwork

44.3 Basis of Quality Assessment in the SDR Project

44.4 Results

44.5 Concluding Remarks

References

Chapter 45 Identification of Processing Errors in Cross‐national Surveys

45.1 Introduction

45.2 Data and Methods

45.3 Results

45.4 Conclusions

Acknowledgments

References

Chapter 46 Item Metadata as Controls for Ex Post Harmonization of International Survey Projects

46.1 Introduction

46.2 Harmonization Controls and Item Quality Controls

46.3 The Case for Using Item Metadata

46.4 Application: Trust in Parliament and Participation in Demonstrations

46.5 Harmonization Controls

46.6 On the Impact of Harmonization Controls

46.7 Item Quality Controls

46.8 Summary and Conclusions

Acknowledgments

References

Chapter 47 The Past, Present, and Future of Statistical Weights in International Survey Projects: Implications for Survey Data Harmonization

47.1 Introduction

47.2 Weighting as a Procedure of Improving Data Quality

47.3 Availability of Weights and Weight Types in International Survey Projects

47.4 Quality of Statistical Weights and Consequences of Errors

47.5 Comparability of Weights or Weighted Data

47.6 Summary

Acknowledgments

References

Section XII Looking Forward

Chapter 48 Prevailing Issues and the Future of Comparative Surveys

48.1 Introduction

48.2 Examples of 3MC Surveys

48.3 Data Quality and Some Special Features of 3MC Surveys

48.4 Roger Jowell’s Ten Golden Rules for Cross‐national Studies

48.5 Quality Management

48.6 A Changing Survey Landscape

48.7 Big Data

48.8 Summary of Prevailing Problems

48.9 Endnote

References

Wiley Series In Survey Methodology

Index

EULA