Cover

Preface

TOC$Contents

CH$Chapter 1 . Why Do We Need a New Approach to Evaluation in Distance Education and E-Learning?

Distance Education versus E-Learning

The Rapid Expansion of Distance Education and E-Learning

What Is Evaluation?

Why Do We Need a Professional Approach to Evaluation?

What Does a Professional Approach to Evaluation Look Like?

Responding to the Call for a Professional Evaluation Approach: The Unfolding Model

Conclusions: Our Approach to Evaluation

CH$Chapter 2 . The Theory and Practice of Program Evaluation

Why Are Program Evaluation Models Important?

A Classification Framework for Program Evaluation Models

Alkin and Christie’s Evaluation Tree: The Roots and Branches

Where Do We Diverge with Alkin and Christie?

Conclusions

CH$Chapter 3 . Evaluation Theory and Practice in Distance Education and E-Learning

Evaluation Theory

Models with Scientific Evidence in the Foreground

Models Based on Evidence, Values, and Consequences

Models Based on Messick’s (1989) Framework

A Summary of Evaluation Models in Distance Education

Evaluation Studies

Evaluation Practice

Do Unintended Consequences Emerge in Authentic Evaluation Studies?

Conclusions

CH$Chapter 4 . Messick’s Framework: What Do Evaluators Need to Know?

The Overlap between Test Validity and Program Evaluation

Messick’s Contributions

Messick’s Framework

The Overlap among the Four Facets

The Controversy over Unintended Consequences

Implications for Evaluation

Conclusions

CH$Chapter 5 . Getting Started

Planning the Evaluation Study

The Ethics Review Process

The Political Context of Evaluation

Using the Unfolding Model as a “Road Map”

Mixed Methods: Blending Quantitative and Qualitative Data

What Is Essential to Our Approach?

Tailoring the Unfolding Model to Your Needs

Conclusions

CH$Chapter 6 . The Unfolding Model: Scientific Evidence

Definition of “Scientific Evidence”

Scientific Evidence

How to Write Good Survey Questions

Using the Unfolding Model to Write Survey and Interview Questions

Administering Surveys

Analyzing Survey Data

Qualitative Data: Interviews, Focus Groups, and Online Ethnographies

Qualitative Data Analysis

Outcomes

The Evaluation of Environmental Quality

Relevance

Cost–­Benefit Analysis

Bringing It All Together: Mixed Methods

Conclusions

CH$Chapter 7 . The Unfolding Model: Values and Consequences

Underlying Values

How to Identify the Values Underlying Your Course

Writing Survey/Interview Questions about Underlying Values

Analyzing Data on Underlying Values

Unintended Consequences

How Can You Identify Unintended Consequences?

Writing Survey/Interview Questions about Unintended Consequences

Analyzing Data on Unintended Consequences

Assessing Fit across the Four Facets of the Unfolding Model

How to Enhance the Validity of Your Findings

Recommendations for Course Improvement

Writing the Evaluation Report

Conclusions

CH$Chapter 8 . Findings from Two Authentic Case Studies

Methods and Procedures for Both Studies

Distance Learning: Computing Science 200 (CPSC 200)

E-Learning: Professional Writing 110 (PWRIT 110)

Conclusions

CH$Chapter 9 . Bringing It All Together

Using Messick’s Framework to Evaluate Distance and E-Learning Courses

Using the Unfolding Model to Evaluate Your Courses

Conducting Your Evaluation Study

What Have We Learned from Two Case Studies?

E-Learning and Beyond: Is the Unfolding Model the Last Word?

The Future of Distance Education and E-Learning

The Future of the Unfolding Model

Conclusions

Appendix A . Summary of the 1994 Program Evaluation Standards

Appendix B . Glossary

Appendix C . List of Associations

References

Author Index

IDX$Subject Index

About the Authors