Chapter
Natural Principles versus Human Guidance Principles
Principles Can and Should Be Evaluated
Practice Exercise: Your Baseline
2. Effectiveness Principles
Principles in Simple, Complicated, and Complex Situations and Interventions
3. Examples of Principles‑Driven Change Initiatives and Programs
Principles‑Driven Programs
What We Aim to Do, and Know We Should Do, but Are Still Learning to Do Well
Emergent Challenges for Evaluation
5. The Niche and Nature of Principles‑Focused Evaluation Serving Diverse Purposes
Utilization‑Focused Evaluation
Principles‑Focused Evaluation
Comparing Principles of Utilization-Focused Evaluation, Developmental Evaluation, and Principles-Focused Evaluation
6. GUIDE for Effectiveness Principles
The Up‑Front Clarifying Role of Evaluators
Elucidating the GUIDE Criteria and an Example Applying the Criteria
SMART Goals Compared to GUIDE Principles
7. Guidance for Developing and Distinguishing Principles
Principles versus Rules and Recipes
The Rules Test for Clarifying Principles
The Alternative Principles Test to Enhance Clarity
Evaluating Opposites in Principles‑Focused Evaluation
8. Referring to Something as a Principle Doesn't Make It One: Further Guidance on Distinguishing Effectiveness Principles
Good Examples of Bad Examples
Alleged Principles That on Closer Examination Aren't
9. Still More Guidance on Developing and Distinguishing Principles: Principles Derived from and Contrasted with Assumptions, Truths, and Lessons
Identifying, Generating, Developing, and Articulating Principles
Assumptions about Skillful Teaching
From Lessons to Principles
Stephen D. Brookfield Responds
Lessons about Developing and Evaluating Principles Basedon Working with Stephen Brookfield's Adult Education Writings
10. Conceptual Triangulation: Evaluating the Similarities of Parallel Principles
Cooperative Extension and Evaluation: Parallel Principles
Common Principles, One List
11. Holistic, Sequential, and Pole Star Approaches to Principles
Holistic Set of Principles
Advanced Practice Exercise
12. Principles Point the Way to Desired Results
Establishing a Baseline for Assessing Change
Youth Homelessness Programs
Principles Can Integrate Processes and Outcomes
Reframing Processes and Outcomes
13. Diverse Uses of Principles across an Organization
Transitioning to a Principles-Driven Organization
Developing a Shared Vision
14. Evaluating the Utility of Research‑Derived Principles for Enhancing Online Learning
How to Approach and Evaluate a Set of Principles for Utility
Research Origins of the TEC-VARIETY Principles
From Research‑Derived Principles to Principles‑Focused Evaluation
Evaluating the Principles
15. Inspirational Principles Are Infused with Values
The Personal Factor: Principles‑Driven People
Inspirational Principles Grounded in Deeply Held Values
Outcomes‑Based versus Principles‑Based Mission Statements
Pushback against Principles as the Basis for Change Efforts and as the Evaluand
Evaluators, Values, and Valuing
Values and Evaluators: Neutrality or Advocacy?
16. Principles‑Focused Evaluation at the Grassroots in Africa: Inspirational Examples and Reflections
Principles in Support of “Walking the Talk”
The Alliance for Food Sovereignty in Africa
Permaculture Research Institute—Kenya Principles
Context‑Specific Principles
Personal Reflections on Principles‑Focused Evaluation
17. Inspiring Principles: Distinguishing Overarching Principles from Operational Principles
18. Principles‑Focused Pedagogy of Evaluation
Freire's Engagement Process
Extrapolation of Freirean Principles
A Holistic Freirean Evaluation Framework
Principles‑Focused Evaluation of Freirean Pedagogy
Matching the Evaluation Approach to the Nature of the Initiatives Being Evaluated
19. The Developmental Nature of Effectiveness Principles
The Intersection of Engagement and Developmental Evaluation
20. Simple Rules and Minimum Specifications
The Good, the Bad, and the Confusing
Weaving Together Principles and MIN SPEC Practices
Evaluating the Meaningfulness and Quality of Principles Using the GUIDE Criteria
Evaluating Adherence to Principles
Qualitative Coding of Principles
Rigorous Research on and Evaluation of Principles
22. Principles‑Focused Sampling
Purposeful Principles‑Focused Evaluation Sampling
Diverse Principles‑Focused Sampling Examples
23. Rendering Judgments about the Effectiveness of Principles
Warranted Conclusions and Credible Judgments
Telling the Summative Story through Principles-Focused Contribution Analysis
Contribution Analysis Conclusions about Effectiveness Principles
Making Credible Summative Judgments about the Effectiveness of Principles
24. Evaluating Principles for Evidence of Effectiveness
Effective Principles in Contrast to Best Practices
Summary of Parts I and II
Synthesis of Themes for Principles‑Focused Evaluation
Part III. Principles‑Driven Initiatives with Principles‑Focused Evaluations
Part IIIA. Three Levels of Principles-Based Interventions
25. Principles Driving Reform
The Paris Declaration on Aid Effectiveness
Significance and Quality of the Paris Declaration Evaluation
Evaluation Focus, Design, and Methods
Methodological Approach and Quality
Principles‑Focused Evaluation Process Use
Evaluation Financing and Resources
Lessons from the Paris Declaration Evaluation
26. Discovering and Validating Effectiveness Principles to Help Youth Overcome Homelessness
It Begins with Committed and Principled People
Principles-Focused Evaluation Design and Results
Lessons from the Youth Homelessness Collaborative Experience
27. Vibrant Communities Canada
A Principles‑Driven Community Change Initiative
Elaborating on VC Principles in Practice
Lessons from the VC Experience
Part IIIB. Three Different Agriculture-Focused Initiatives
28. Collaborative Principles Supporting Shared Commitment
The Global Alliance for the Future of Food
Application and Implication of the Principles
Lessons from the Global Alliance Experience
29. Principles Enhancing Coherence
Diversity, Complexity, and Contextual Variation
Creating an Integrated Monitoring, Evaluation, and Planning Process
Process for Developing the Principles
Lessons from the Collaborative Crop Research Program
30. Principles Defining the Emergent Field of Agroecology
The Emergence of Agroecology as an Applied Discipline Based on Principles
Principles of Agroecology
Comprehensive Approach to Agroecology
Agroecological Principles in the CCRP
Principles of Agroecology as an Organizing Heuristic for the Agroecology Knowledge Hub
The Role of Evaluating Principles in Defining a Field
Part IV. Principles for Evaluations and Evaluators
31. Evaluating Evaluation Principles
Examples of Evaluation Principles
Design Principles for Data Visualization in Evaluation
Principles for Culturally Competent Evaluation Practice
Principles of Evaluative Thinking
Principles for Guiding Collaborative Approaches to Evaluation
Methodological Principles
Evaluating Evaluation Principles
32. Outcome Harvesting Evaluation
Outcome Harvesting Evaluation
The Niche for Outcome Harvesting
Outcome Harvesting as a Principles‑Based Approach
The 10 Principles of Outcome Harvesting
Using Outcome Harvesting in a Principles‑Focused Evaluation
33. Reflections of a Principles‑Focused Evaluator
Grasping Principles‑Focused Evaluation in a Grassroots Organization
Using Principles‑Focused Evaluation with an Explicitly Principled Organization
Using Principles‑Focused Evaluation When Working with a University
Applying Principles‑Focused Evaluation in Place of an Impact Evaluation
A Personal Principles‑Based Evaluation Philosophy
Reimagining Myself as an Evaluator
How I Came to Principles-Focused Evaluation
Journey‑Oriented Developmental Evaluation for Social Justice and Equity
Guiding Principles for JODE
How People Are Responding to a Principles-Focused Approach
Part V. Principles-Focused Evaluation in Practice
35. Tools for Principles‑Focused Evaluation
Checklist and Guide for Facilitating the Development and Review of Principles
Tool for Rating Principles Based on the GUIDE Framework and Rubric for Rating Effectiveness Principles
Principles Guiding Principles‑Focused Evaluation
Treating Essential Principles as Sensitizing Concepts
Appendix 35.1. Exhibits as Tools
36. Principles‑Focused Evaluation Checklist
Conclusion and Final Practice Exercise
Rights‑Focused Evaluation
Evaluating Moral Principles