Survey Scales :A Guide to Development, Analysis, and Reporting

Publication subTitle :A Guide to Development, Analysis, and Reporting

Author: Johnson> Robert L.; Morgan3> Grant B.  

Publisher: Guilford Publications Inc‎

Publication year: 2016

E-ISBN: 9781462526994

P-ISBN(Paperback): 9781462526970

Subject: C915 social investigation and social analysis

Keyword: 心理学,护理学,临床医学,统计学,教育学,教育

Language: ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Description

Synthesizing the literature from the survey and measurement fields, this book explains how to develop closed-response survey scales that will accurately capture such constructs as attitudes, beliefs, or behaviors. It provides guidelines to help applied researchers or graduate students review existing scales for possible adoption or adaptation in a study; create their own conceptual framework for a scale; write checklists, true-false variations, and Likert-style items; design response scales; examine validity and reliability; conduct a factor analysis; and document the instrument development and its technical quality. Advice is given on constructing tables and graphs to report survey scale results. Concepts and procedures are illustrated with "Not This/But This" examples from multiple disciplines.

Pedagogical Features:
*End-of-chapter exercises with sample solutions, plus annotated suggestions for further reading.
*"Not This/But This" examples of poorly written and strong survey items.
*Chapter-opening overviews and within-chapter summaries.
*Glossary of key concepts.
*Appendix with examples of parametric and nonparametric procedures for group comparisons.

Chapter

Contents

1. Scales in Surveys

Introduction

Closed-Response Items

Open-Response Items

An Overview of the Survey Scale Development Process

Establish the Purpose of a Survey

Define the Construct

Review Potential Instruments

Write Items and Response Scales

Format Survey and Determine the Administration Method

Submit the Survey Scale for Review

Field Test the Instrument and Investigate Item and Scale Quality

Document the Development of the Survey Scale

Attitudes, Knowledge, and Behaviors

Attitudes

Knowledge

Behaviors

Key Qualities of a Survey Scale: Reliability and Validity

Further Reading

Chapter Exercises

2. Adopting or Adapting an Existing Scale

Introduction

Reviewing Potential Instruments for Adoption or Adaptation

Clarify the Instrument’s Purpose

Consider the Research Context

Review Journal Articles and Critiques

Request Copies of Instruments

Summarize Strengths and Weaknesses

Make a Decision about the Instrument

The Mental Measurements Yearbook: A Source for Reviews of Instruments

Test Entry

Description

Development

Technical Qualities

Reviewer Commentary

Summary

Plagiarism and Copyright Infringement

Plagiarism

Copyright Infringement

Further Reading

Chapter Exercises

3. Establishing a Framework for the Development of a Survey Scale

Introduction

Model

Narrative

Elements and Format

Functions of the Conceptual Framework in the Development of a Survey Scale

Construction of a Conceptual Framework

Review the Literature

Construct a Model for the Framework

Write the Narrative for the Framework

Refine the Framework

Further Reading

Chapter Exercises

4. Item-Writing Guidelines

Introduction

Addressing Relevance

The Construct of Interest

Logically Related to the Construct

Multiple Items

Crossover

Concrete and Precise

Item and Word Relevance

Objectivity

Addressing Audience

Cognitive Skills and Communication

Sufficient Information

Recall of Information

Representation of Diversity

Addressing Language

Language Understood by Respondents

Current Language

Multiple-Meaning Words

Choices about Words

Abstractions

Reading Demands

Addressing Item Structure

Brevity

Complete Sentences

Single Idea

Positive Wording

Qualifying Phrases

Eliminating Repetitive Phrasing

Addressing Conventions

Language Conventions

Typographical Errors

Guidelines Specific to Item type

Guidelines Specific to Knowledge-Based Items

Guidelines for Items about Behaviors

Guidelines for Items about Demographics (Personal Background)

Number of Items

Further Reading

Chapter Exercises

5. Development of Response Scales

Introduction

Length of the Item Response Scale

Scale Length and Purpose

Statistical Analyses to Be Used with Data

Respondents’ Discrimination Capability

Respondent Preferences

Numeric and Verbal Response Labels

Numeric and Verbal Labels

Labels for Response Categories

Labels and the Purpose of the Scale

Labels for Two Endpoints That Mean the Opposite of Each Other

Positive Integers for Numeric Labels

The Effect of Bias and Scale Extremes

Labels to Reflect Equal Intervals along a Continuum

Order of Response Scales: Negative to Positive

Response Options in a Logical Order

The Questionable Middle Position

Even Number of Response Categories to Avoid Neutral Responses

Odd Number of Response Categories for Quality or to Support the Status Quo

Moderating Options When Using a Middle Option

“Don’t Know” and “No Opinion”

DK and Unfamiliar Options

Nonsubstantive Options Set Apart from the Other Response Options

Further Reading

Chapter Exercises

6. Formatting and Reviewing

Introduction

Survey Format and Administration Method

Cost

Timeframe

Number of Respondents

Writing Demands

Attractive Protocol

Follow-Up on a Response

Anonymity/Confidentiality

Data Entry

Item Formats Specific to Administration Methods

Equal Spacing of the Response Options on Print and Web Surveys

Each Item on Its Own Screen: Computer-Based Surveys

Radio Buttons for Responding on Web-Based Surveys

Horizontally Positioning Response Scales on Print and Web Surveys

Color and the Continuum of the Response Scale

Complete Reviews and a Pilot of the Survey Scale

Subject Matter Expert Review

Survey Methodologist Review

Translator Review

Editorial Review

Bias Review

Conducting a Pilot Test

Further Reading

Chapter Exercises

7. Analysis of Survey Scale Data

Introduction

Levels of Measurement

Nominal Data

Ordinal Data

Interval Data

Ratio Data

Frequencies

Measures of Central tendency

Mode

Median

Mean

Measures of Variability

Range

Variance

Standard Deviation

Measures of Association

Scatterplots

Pearson Correlation

Spearman’s Rho

Obtaining Descriptive Statistics

Item Statistics

Inter-Item Correlations

Further Reading

Chapter Exercises

8. Investigating Scale Quality

Introduction

Coverage Error

Sampling Error

Nonresponse Error

Measurement Error

Field Testing

Response Distributions: Item Quality

Frequencies

Mean and Standard Deviation

Total Score

Corrected Item–Total Correlation

Analyses by Group

Analyses for Knowledge Items

Investigating Reliability

Internal Consistency Estimates of Reliability

Coefficient of Stability

Parallel Forms Reliability Estimates

Evaluating Reliability Estimates

Investigating Validity

Forms of Validity Evidence

Further Reading

Chapter Exercises

9. Factor Analysis

Introduction

General Purposes and Processes Associated with Factor-Analytic Procedures

Testing Assumptions

Dimensionality

Unidimensionality

Multidimensionality

Extraction: Principal Axis Factoring

Determining the Number of Factors (Model Selection)

Eigenvalues

Scree Plot

Parallel Analysis

Reproduced Residual Matrix

Factor Loadings

Rotation

How to Interpret Factor Solutions

Calculating Factor Scores

Sample Size

Steps after EFA

How to Obtain an EFA Model

Further Reading

Chapter Exercises

10. Documenting the Development of the Survey Scale

Introduction

Determining the Need for a Data Display

Developing Tables

Table Structure

Organization of the Table

Emphasis on the Most Important Pattern

Placement of the Columns

Use of Space

Information to Include in a Table

Consistent Format of Comparable Tables

Table Data

Presentation of Data in Columns

The Order of Statistics

Column and Row Overall Statistics

Rounding to Two Place Values

Reporting Statistics for Negatively Worded Items

Developing Graphs

Structure of a Graph

Choice of a Bar Graph or a Line Graph

x-Axis and y-Axis Labels

Vertical and Horizontal Values for the Scale Axes

Need for Gridlines

Legends

Number of Bars and Lines

Shading

Graphs to Avoid

Organization of Data in a Graph

Ordering Bars and Lines to Highlight Important Patterns

Location of Statistics

Narrative about table or Graph

Concluding Thoughts

Further Reading

Chapter Exercises

Appendix. Analysis of Data: Inferential Statistics

Introduction

Sampling

Inferential Statistics

Hypothesis Testing

Confidence Intervals

Effect Size

Inferential Procedures

One-Sample t-Test

Dependent-Samples t-Test

Independent-Samples t-Test

One-Way Analysis of Variance

Nonparametric Inferential Statistics

Mann–Whitney U Test

Kruskal–Wallis One-Way Analysis of Variance

Further Reading

Appendix Exercises

Glossary of Key Terms

Sample Solutions to Chapter Exercises

References

Author Index

Subject Index

About the Authors

The users who browse this book also browse