Evaluation Essentials, Second Edition :From A to Z

Publication subTitle :From A to Z

Author: Alkin Marvin C.; Vo Anne T.  

Publisher: Guilford Publications Inc‎

Publication year: 2017

E-ISBN: 9781462532452

P-ISBN(Paperback): 9781462532414

Subject: C91-03 sociological methodology

Keyword: 心理学,政治理论,护理学,社会科学理论与方法论,教育学

Language: ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Description

Thoroughly revised and updated, this engaging text has given thousands of students and new evaluators the practical information and expert advice needed to conduct or use evaluations. In 26 concise sections, the book describes how to articulate answerable evaluation questions, collect and analyze data using both quantitative and qualitative methods, and deal with contingencies that might alter the traditional sequence of an evaluation. Special strengths of the text are its attention to individual, organizational, and community culture and emphasis on building collaborative relationships with stakeholders. An in-depth case study and related end-of-section exercises (including group activities) help students put themselves in the evaluator role. Other pedagogical features include section titles written as questions, bulleted recaps of each section, "Thinking Ahead" and "Next Steps" pointers, cautionary notes, and suggestions for further reading.
 
 New to This Edition
*New and expanded topics: evaluation contracts, budgeting, surveys, data visualization, qualitative coding and memoing, factors affecting evaluation use, and context-sensitive evaluation.
*Revised case study with extended exercises that guide the reader to complete a simulated evaluation.
*End-of-section "Quick Read" links to recommended American Evaluation Association blog posts.
*Four entirely new sections (such as "How Do You

Chapter

Structure

Section A. What Is Evaluation?

Professional Program Evaluation

Evaluation and Research

Evaluation Definition

A Confusion of Terms

RECAP—Section A

Evaluation Purposes

Gaining Additional Understanding

Section B. Why Do Evaluations?

Influences on Increased Understanding and Decision Making

Need for Professional Evaluation

RECAP—Section B

Gaining Additional Understanding

Time-Out: The RUPAS Case

Case Study: The Rural Parents' Support Program

Section C. Who Does Evaluations?

Evaluator Settings

Who Are You?

Multiple Orientations to Doing Evaluation

My View

RECAP—Section C

Gaining Additional Understanding

Section D. Contracting for Evaluations

Acquiring an Evaluation

Writing the Proposal

Preparing the Contract/Agreement

Developing the Budget

RECAP—Section D

Gaining Additional Understanding

Section E. Who Are the Stakeholders for an Evaluation?

Stakeholders, Not Audience

Who Are the Stakeholders?

Focus on Primary Stakeholders

Differences in Stakeholder Participation

RECAP—Section E

Gaining Additional Understanding

Section F. How Do You Strengthen Relationships with Stakeholders?

Cultural Understanding

Credibility, Respect, and Trust

Some Practical Guidelines

RECAP—Section F

Concluding Note

Gaining Additional Understanding

Section G. How Do You Describe the Program?

What Is a Program?

Learning about the Program

RECAP—Section G

Gaining Additional Understanding

Section H. What Is the Organizational, Community, and Political Context of the Program?

Organizational Context

Community Context

Political Context

Impact on the Evaluation

RECAP—Section H

Gaining Additional Understanding

Logic Models

Why Is This Important?

Getting Started

RECAP—Section I

Gaining Additional Understanding

Section I. How Do You "Understand" the Program?

Section J. What Are the Questions/Issues to Be Addressed?

What Motivates Evaluation?

What Kinds of Evaluation Questions Can Be Asked?

Getting Started on Defining Questions

RECAP—Section J

Gaining Additional Understanding

Section K. What Are Instruments for Collecting Quantitative Data?

Types of Instruments for Collecting Quantitative Data

Finding Existing Instruments versus Developing New Ones

Measuring Achievement

RECAP—Section K

Gaining Additional Understanding

Section L. What Are Instruments for Collecting Qualitative Data?

Developing New Instruments

Observations

Interviews and Focus Groups

Surveys and Questionnaires

RECAP—Section L

Gaining Additional Understanding

Section M. How Do Data Collection Issues Impact Potential Evaluability?

Again, Be Clear on the Questions

Focus of the Data

Program Participants

Program Staff

The Program

Selecting Individuals

Gaining Data Access

Collecting Data

Quality of Data

Understanding the Organization's Viewpoints

RECAP—Section M

Gaining Additional Understanding

Section N. Are the Questions Evaluable?

Stage of the Program

Resources

Nature of the Question

Standards for Judgment

Technical Issues

Ethical Concerns

Political Feasibility

RECAP—Section N

Gaining Additional Understanding

Section O. How Do We Plan a Process-Focused Evaluation?

The Evaluation Plan and Evaluation Design

Administrative Processes

Implementation Processes

Program Mechanisms

RECAP—Section O

Gaining Additional Understanding

Section P. How Do We Plan an Outcome-Focused Evaluation?

Outcome Definition

The Evaluation Plan and Evaluation Design

RECAP 1—Section P

An Exercise to Assist Us

Toward Stronger Causal Models

Descriptive Designs

Intensive Case Study Design

Mixed Methods

Summary

RECAP 2—Section P

Gaining Additional Understanding

Section Q. How Do We Manage the Evaluation?

Evaluation Activities: Past, Present, and Upcoming

The Written Evaluation Management Plan

Operational Management

RECAP—Section Q

Gaining Additional Understanding

Section R. How Are Quantitative Data Analyzed?

Types of Data

Describing What’s in Your Data Set

Measures of Central Tendency

Measures of Variability

Other Ways to Describe Your Data

Surprises in Your Data Set and How to Deal with Them

A Note on Population and Sample Statistics

Sampling

Appropriate Statistical Techniques

RECAP—Section R

Gaining Additional Understanding

Section S. How Are Qualitative Data Analyzed?

Coding

Indexing

Memoing

Finding Patterns

Testing the Validity of the Analysis

RECAP—Section S

Gaining Additional Understanding

Section T. How Are Analyzed Data Used to Answer Questions?

Difficulties in Valuing

Valuing in a Formative Context

“Valuing” Redefined

RECAP—Section T

Gaining Additional Understanding

Section U. How Are Evaluation Results Reported?

Communication

Issues Related to Reporting

The Final Written Report

RECAP 1—Section U

Data Visualization Helps

RECAP 2—Section U

Gaining Additional Understanding

Section V. What Is the Evaluator's Role in Helping Evaluations to Be Used?

A Word about “Use”

What Is Use?

What Can You Do?

Guard against Misuse

RECAP—Section V

Gaining Additional Understanding

Section W. What Are the Evaluation Standards and Codes of Behavior?

Judging an Evaluation

The Program Evaluation Standards

American Evaluation Association Guiding Principles for Evaluators

RECAP—Section W

Gaining Additional Understanding

Section X. How Are Costs Analyzed?

Cost‑Effectiveness Analysis

Cost–Benefit Analysis

Cost–Utility

Single Outcome

Multiple Outcomes

And Now to Costs

How to Determine Cost

RECAP—Section X

Gaining Additional Understanding

Section Y. What Is the "Theme" of This Book?

Historical Perspective

My Prescriptive Theory

The Research Origins of My Thinking

Gaining Additional Understanding

Section Z. How Can You Embark on a Program to Learn More about Evaluation?

Getting Feedback on Evaluation

Taking Full Advantage of This Book

Gaining Evaluation Expertise Beyond This Book

Gaining Additional Understanding

Appendix A. Factors Affecting Evaluation Use

Appendix B. An Evaluation Lesson

Appendix C. Use Factors: Relationship to Research Compilations

Index

About the Authors

The users who browse this book also browse