Chapter
An Overview of the Survey Scale Development Process
Establish the Purpose of a Survey
Review Potential Instruments
Write Items and Response Scales
Format Survey and Determine the Administration Method
Submit the Survey Scale for Review
Field Test the Instrument and Investigate Item and Scale Quality
Document the Development of the Survey Scale
Attitudes, Knowledge, and Behaviors
Key Qualities of a Survey Scale: Reliability and Validity
2. Adopting or Adapting an Existing Scale
Reviewing Potential Instruments for Adoption or Adaptation
Clarify the Instrument’s Purpose
Consider the Research Context
Review Journal Articles and Critiques
Request Copies of Instruments
Summarize Strengths and Weaknesses
Make a Decision about the Instrument
The Mental Measurements Yearbook: A Source for Reviews of Instruments
Plagiarism and Copyright Infringement
3. Establishing a Framework for the Development of a Survey Scale
Functions of the Conceptual Framework in the Development of a Survey Scale
Construction of a Conceptual Framework
Construct a Model for the Framework
Write the Narrative for the Framework
4. Item-Writing Guidelines
The Construct of Interest
Logically Related to the Construct
Cognitive Skills and Communication
Representation of Diversity
Language Understood by Respondents
Addressing Item Structure
Eliminating Repetitive Phrasing
Guidelines Specific to Item type
Guidelines Specific to Knowledge-Based Items
Guidelines for Items about Behaviors
Guidelines for Items about Demographics (Personal Background)
5. Development of Response Scales
Length of the Item Response Scale
Statistical Analyses to Be Used with Data
Respondents’ Discrimination Capability
Numeric and Verbal Response Labels
Numeric and Verbal Labels
Labels for Response Categories
Labels and the Purpose of the Scale
Labels for Two Endpoints That Mean the Opposite of Each Other
Positive Integers for Numeric Labels
The Effect of Bias and Scale Extremes
Labels to Reflect Equal Intervals along a Continuum
Order of Response Scales: Negative to Positive
Response Options in a Logical Order
The Questionable Middle Position
Even Number of Response Categories to Avoid Neutral Responses
Odd Number of Response Categories for Quality or to Support the Status Quo
Moderating Options When Using a Middle Option
“Don’t Know” and “No Opinion”
DK and Unfamiliar Options
Nonsubstantive Options Set Apart from the Other Response Options
6. Formatting and Reviewing
Survey Format and Administration Method
Anonymity/Confidentiality
Item Formats Specific to Administration Methods
Equal Spacing of the Response Options on Print and Web Surveys
Each Item on Its Own Screen: Computer-Based Surveys
Radio Buttons for Responding on Web-Based Surveys
Horizontally Positioning Response Scales on Print and Web Surveys
Color and the Continuum of the Response Scale
Complete Reviews and a Pilot of the Survey Scale
Subject Matter Expert Review
Survey Methodologist Review
7. Analysis of Survey Scale Data
Measures of Central tendency
Obtaining Descriptive Statistics
8. Investigating Scale Quality
Response Distributions: Item Quality
Mean and Standard Deviation
Corrected Item–Total Correlation
Analyses for Knowledge Items
Investigating Reliability
Internal Consistency Estimates of Reliability
Parallel Forms Reliability Estimates
Evaluating Reliability Estimates
Forms of Validity Evidence
General Purposes and Processes Associated with Factor-Analytic Procedures
Extraction: Principal Axis Factoring
Determining the Number of Factors (Model Selection)
Reproduced Residual Matrix
How to Interpret Factor Solutions
Calculating Factor Scores
How to Obtain an EFA Model
10. Documenting the Development of the Survey Scale
Determining the Need for a Data Display
Organization of the Table
Emphasis on the Most Important Pattern
Information to Include in a Table
Consistent Format of Comparable Tables
Presentation of Data in Columns
Column and Row Overall Statistics
Rounding to Two Place Values
Reporting Statistics for Negatively Worded Items
Choice of a Bar Graph or a Line Graph
Vertical and Horizontal Values for the Scale Axes
Organization of Data in a Graph
Ordering Bars and Lines to Highlight Important Patterns
Narrative about table or Graph
Appendix. Analysis of Data: Inferential Statistics
Independent-Samples t-Test
One-Way Analysis of Variance
Nonparametric Inferential Statistics
Kruskal–Wallis One-Way Analysis of Variance
Sample Solutions to Chapter Exercises