Principles-Focused Evaluation :The GUIDE

Publication subTitle :The GUIDE

Author: Patton Michael Quinn  

Publisher: Guilford Publications Inc‎

Publication year: 2017

E-ISBN: 9781462531929

P-ISBN(Paperback): 9781462531905

Subject: C0 Social Science Theory and Methodology;D0 Political Theory;F2 Economic Planning and Management;G40 pedagogy

Keyword: 心理学,政治理论,社会科学理论与方法论,教育学,经济计划与管理

Language: ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Description

How can programs and organizations ensure they are adhering to core principles--and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises.
 

Chapter

List of Exhibits

Part I. Principles

1. First Principles

First Principles First

Natural Principles versus Human Guidance Principles

Principles Can and Should Be Evaluated

Practice Exercise: Your Baseline

2. Effectiveness Principles

What?

Why?

When?

How?

Who?

Where?

Principles in Simple, Complicated, and Complex Situations and Interventions

Practice Exercise

3. Examples of Principles‑Driven Change Initiatives and Programs

Principles‑Driven Programs

Practice Exercise

4. Evaluating Principles

What Evaluators Do Well

What We Aim to Do, and Know We Should Do, but Are Still Learning to Do Well

Emergent Challenges for Evaluation

Practice Exercise

5. The Niche and Nature of Principles‑Focused Evaluation Serving Diverse Purposes

Utilization‑Focused Evaluation

Developmental Evaluation

Principles‑Focused Evaluation

Comparing Principles of Utilization-Focused Evaluation, Developmental Evaluation, and Principles-Focused Evaluation

Practice Exercise

Part II. GUIDE

6. GUIDE for Effectiveness Principles

The Up‑Front Clarifying Role of Evaluators

Elucidating the GUIDE Criteria and an Example Applying the Criteria

SMART Goals Compared to GUIDE Principles

Practice Exercise

G. Guiding

7. Guidance for Developing and Distinguishing Principles

Quick Review

Principles versus Rules and Recipes

The Rules Test for Clarifying Principles

The Alternative Principles Test to Enhance Clarity

Evaluating Opposites in Principles‑Focused Evaluation

Chapter Summary

Practice Exercise

8. Referring to Something as a Principle Doesn't Make It One: Further Guidance on Distinguishing Effectiveness Principles

Good Examples of Bad Examples

Exemplary Principles

Semantic Principles

Alleged Principles That on Closer Examination Aren't

Practice Exercise

9. Still More Guidance on Developing and Distinguishing Principles: Principles Derived from and Contrasted with Assumptions, Truths, and Lessons

Quick Review

Identifying, Generating, Developing, and Articulating Principles

Assumptions about Skillful Teaching

From Lessons to Principles

Stephen D. Brookfield Responds

Lessons about Developing and Evaluating Principles Basedon Working with Stephen Brookfield's Adult Education Writings

Practice Exercises

10. Conceptual Triangulation: Evaluating the Similarities of Parallel Principles

Cooperative Extension and Evaluation: Parallel Principles

Common Principles, One List

The Value of Comparisons

Practice Exercise

11. Holistic, Sequential, and Pole Star Approaches to Principles

Holistic Set of Principles

Sequential Principles

Pole Star Principles

Advanced Practice Exercise

U. Useful

12. Principles Point the Way to Desired Results

Establishing a Baseline for Assessing Change

Youth Homelessness Programs

Principles Can Integrate Processes and Outcomes

Reframing Processes and Outcomes

Conclusion

Practice Exercise

13. Diverse Uses of Principles across an Organization

Serving Homeless Youth

Transitioning to a Principles-Driven Organization

Developing a Shared Vision

14. Evaluating the Utility of Research‑Derived Principles for Enhancing Online Learning

How to Approach and Evaluate a Set of Principles for Utility

Research Origins of the TEC-VARIETY Principles

From Research‑Derived Principles to Principles‑Focused Evaluation

Evaluating the Principles

Conclusion

Practice Exercise

I. Inspiring

15. Inspirational Principles Are Infused with Values

The Personal Factor: Principles‑Driven People

Inspirational Principles Grounded in Deeply Held Values

Outcomes‑Based versus Principles‑Based Mission Statements

Pushback against Principles as the Basis for Change Efforts and as the Evaluand

Evaluators, Values, and Valuing

Values and Evaluators: Neutrality or Advocacy?

The Heart of Inspiration

Practice Exercise

16. Principles‑Focused Evaluation at the Grassroots in Africa: Inspirational Examples and Reflections

Principles in Support of “Walking the Talk”

The Alliance for Food Sovereignty in Africa

Permaculture Research Institute—Kenya Principles

Context‑Specific Principles

STIPA

Personal Reflections on Principles‑Focused Evaluation

Practice Exercise

17. Inspiring Principles: Distinguishing Overarching Principles from Operational Principles

ChildFund International

Inspiration

Principles Emerge

Practice Exercise

18. Principles‑Focused Pedagogy of Evaluation

Freirean Principles

Freire's Engagement Process

Extrapolation of Freirean Principles

A Holistic Freirean Evaluation Framework

Principles‑Focused Evaluation of Freirean Pedagogy

Matching the Evaluation Approach to the Nature of the Initiatives Being Evaluated

Practice Exercise

D. Developmental

19. The Developmental Nature of Effectiveness Principles

The Intersection of Engagement and Developmental Evaluation

Ongoing Development

Practice Exercise

20. Simple Rules and Minimum Specifications

Simple Rules

The Good, the Bad, and the Confusing

Minimum Specifications

Weaving Together Principles and MIN SPEC Practices

Practice Exercise

E. Evaluable

21. Evaluable Principles

Evaluating the Meaningfulness and Quality of Principles Using the GUIDE Criteria

Evaluating Adherence to Principles

Qualitative Coding of Principles

Rigorous Research on and Evaluation of Principles

Summary and Conclusion

Practice Exercise

22. Principles‑Focused Sampling

Project SPIRIT

Purposeful Principles‑Focused Evaluation Sampling

Diverse Principles‑Focused Sampling Examples

Summary

Practice Exercise

23. Rendering Judgments about the Effectiveness of Principles

Evaluative Reasoning

Warranted Conclusions and Credible Judgments

Rigorous Thinking

Telling the Summative Story through Principles-Focused Contribution Analysis

Contribution Analysis Conclusions about Effectiveness Principles

Making Credible Summative Judgments about the Effectiveness of Principles

Conclusion

Practice Exercise

24. Evaluating Principles for Evidence of Effectiveness

Effective Principles in Contrast to Best Practices

Why This Matters

Practice Exercise

Summary of Parts I and II

Synthesis of Themes for Principles‑Focused Evaluation

Principles Rule

Part III. Principles‑Driven Initiatives with Principles‑Focused Evaluations

Part IIIA. Three Levels of Principles-Based Interventions

25. Principles Driving Reform

The Paris Declaration on Aid Effectiveness

Evaluation Results

Significance and Quality of the Paris Declaration Evaluation

Evaluation Focus, Design, and Methods

The Evaluation Findings

Methodological Approach and Quality

Principles‑Focused Evaluation Process Use

Evaluation Financing and Resources

Lessons from the Paris Declaration Evaluation

Concluding Reflections

26. Discovering and Validating Effectiveness Principles to Help Youth Overcome Homelessness

It Begins with Committed and Principled People

Principles-Focused Evaluation Design and Results

Excerpt from the Report

Outcomes Snapshots

Chapter Review

Lessons from the Youth Homelessness Collaborative Experience

Concluding Reflections

27. Vibrant Communities Canada

A Principles‑Driven Community Change Initiative

The Evaluation

Evaluation Redesign

Evaluating VC

Elaborating on VC Principles in Practice

Lessons from the VC Experience

Concluding Reflections

Part IIIB. Three Different Agriculture-Focused Initiatives

28. Collaborative Principles Supporting Shared Commitment

The Global Alliance for the Future of Food

Application and Implication of the Principles

Lessons from the Global Alliance Experience

Concluding Reflections

29. Principles Enhancing Coherence

Diversity, Complexity, and Contextual Variation

Creating an Integrated Monitoring, Evaluation, and Planning Process

Two Levels of Principles

Process for Developing the Principles

Caveats

Lessons from the Collaborative Crop Research Program

Concluding Reflections

30. Principles Defining the Emergent Field of Agroecology

The Emergence of Agroecology as an Applied Discipline Based on Principles

Tracing the History

Principles of Agroecology

Comprehensive Approach to Agroecology

Agroecological Principles in the CCRP

Principles of Agroecology as an Organizing Heuristic for the Agroecology Knowledge Hub

The Role of Evaluating Principles in Defining a Field

Lessons from Agroecology

Concluding Reflections

Part IV. Principles for Evaluations and Evaluators

31. Evaluating Evaluation Principles

Examples of Evaluation Principles

AEA Guiding Principles

Design Principles for Data Visualization in Evaluation

Principles for Culturally Competent Evaluation Practice

Principles of Evaluative Thinking

Principles for Guiding Collaborative Approaches to Evaluation

Methodological Principles

Evaluating Evaluation Principles

Practice Exercise

32. Outcome Harvesting Evaluation

Outcome Harvesting Evaluation

The Niche for Outcome Harvesting

Six Flexible Steps

Outcome Harvesting as a Principles‑Based Approach

The 10 Principles of Outcome Harvesting

Using Outcome Harvesting in a Principles‑Focused Evaluation

33. Reflections of a Principles‑Focused Evaluator

Engaging with Principles

Grasping Principles‑Focused Evaluation in a Grassroots Organization

Using Principles‑Focused Evaluation with an Explicitly Principled Organization

Using Principles‑Focused Evaluation When Working with a University

Applying Principles‑Focused Evaluation in Place of an Impact Evaluation

Final Reflections

34. Waking Lumina

A Personal Principles‑Based Evaluation Philosophy

Reimagining Myself as an Evaluator

How I Came to Principles-Focused Evaluation

Journey‑Oriented Developmental Evaluation for Social Justice and Equity

Guiding Principles for JODE

How People Are Responding to a Principles-Focused Approach

Conclusion

Part V. Principles-Focused Evaluation in Practice

35. Tools for Principles‑Focused Evaluation

A Word about Tools

Checklist and Guide for Facilitating the Development and Review of Principles

Tool for Rating Principles Based on the GUIDE Framework and Rubric for Rating Effectiveness Principles

Principles Guiding Principles‑Focused Evaluation

Treating Essential Principles as Sensitizing Concepts

Exhibits as Tools

Conclusion

Appendix 35.1. Exhibits as Tools

36. Principles‑Focused Evaluation Checklist

Conclusion and Final Practice Exercise

Next Steps

Epilogue

Questions

Q&A

Practice Exercise

Rights‑Focused Evaluation

Evaluating Moral Principles

References

Author Index

Subject Index

About the Author

The users who browse this book also browse


No browse record.