Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.

"What Counts as Credible Evidence in Applied Research and Evaluation Practice? is the first book of its kind to define and place into greater perspective the meaning of evidence for evaluation professionals and applied researchers. Editors Stewart I. Donaldson, Christina A. Christie, and Melvin M. Mark provide observations about the diversity and changing nature of credible evidence, include lessons from their own applied research and evaluation practice, and suggest ways in which practitioners might address the key issues and challenges of collecting credible evidence." "This book is appropriate for a wide range of courses, including Introduction to Evaluation Research, Research Methods, Evaluation Practice, Program Evaluation, Program Development and Evaluation, and evaluation courses in Social Work, Education, Public Health, and Public Policy."--BOOK JACKET.

The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.

An innovative approach to program evaluation that takes readers behind the scenes of real evaluations and the decisions the evaluators made.

The first comprehensive history of the Obama administration's evidence-based initiatives. From its earliest days, the Obama administration planned and enacted several initiatives to fund social programs based on rigorous evidence of success. Ron Haskins and Greg Margolis tell the story of six—spanning preschool and K-12 education, teen pregnancy, employment and training, health, and community-based programs. Readers will appreciate the fast-moving descriptions of the politics and policy debates that shaped these federal programs and the analysis of whether they will truly reshape federal social policy and greatly improve its impacts on the nation's social problems. Based on interviews with 134 individuals (including advocates, officials at the Office of Management and Budget and the Domestic Policy Council, Congressional staff, and officials in the federal agencies administering the initiatives) as well as Congressional and administration documents and news accounts, the authors examine each of the six initiatives in separate chapters. The story of each initiative includes a review of the social problem the initiative addresses; the genesis and enactment of the legislation that authorized the initiative; and the development of the procedures used by the administration to set the evidence standard and evaluation requirements—including the requirements for grant applications and awarding of grants.

Mixed methods in evaluation have the potential to enhance the credibility of evaluation and the outcomes of evaluation. This issue explores advances in understanding mixed methods in philosophical, theoretical, and methodological terms and presents specific illustrations of the application of these concepts in evaluation practice. Leading thinkers in the mixed methods evaluation community provide frameworks and strategies that are associated with improving the probability of reaching the goals of enhanced credibility for evaluations, the evidence they produce, and the actions taken as a result of the evaluation findings. This is the 138th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Introduction to Theory-Driven Program Evaluation provides a clear guide for practicing evaluation science, and numerous examples of how these evaluations actually unfold in contemporary practice. A special emphasis is placed how to conduct theory-driven program evaluations that are culturally responsive and strengths-focused. In this thoroughly revised new edition, author Stewart I. Donaldson provides a state-of-the art treatment of the basics of conducting theory-driven program evaluations. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. The initial chapters discuss the evolution and popularity of theory-driven program evaluation, as well as step-by-step guide for culturally responsive and strengths-focused applications. Succeeding chapters provide actual cases and discuss the practical implications of theory-driven evaluation science. Reflections, challenges, and lessons learned across numerous cases from practices are discussed. The volume is of significant value to practicing evaluators, professors of introductory evaluation courses and their students, advanced undergraduate and graduate students, and serves as a text or a supplementary text for a wide range of evaluation and applied research courses. It is also of great interest to those interested in the connections between work and health, well-being, career development, human service organizations, and organizational improvement and effectiveness.

Arlene Fink outlines the basic concepts & vocabulary necessary for programme evaluation & illustrates how to review the quality of evaluation research so as to make informed decisions about methods & outcomes.

"Provides both an overall framework and concrete advice for how to conduct useful evaluations that actually get used." - preface.

Each year, organizations spend millions of dollars trying out new innovations and improvements-and millions will be wasted if they can't quickly find out what's working and what is not. The Success Case Method offers a breakthrough evaluation technique that is easier, faster, and cheaper than competing approaches, and produces compelling evidence decision-makers can actually use. Because it seeks out the best stories of how real individuals have actually used innovations, The Success Case Method can ferret out success no matter how small or infrequent. It can salvage the few ''gems'' of success from a larger initiative that is not doing well or find out how to make a partially successful effort even more successful. The practical methods and tools in this book can help those who initiate and foster change, including leaders, executives, managers, consultants, training directors, and anyone else who is trying to make things work better in organizations get the greatest returns for their investments.