Context is a force in evaluation. It shapes our practice, influencing how we approach and design our studies, how we carry them out, and how we report our findings. Context also moderates and mediates the outcomes of the programs and policies we evaluate. This issue focuses squarely on the role that context plays in practice and illuminates its effect on the implementation and outcomes of programs. Exploring the ways in which attending to context may improve the quality of evaluation practice, the contributions span theory, methods, and practice in an effort to move to a more comprehensive conceptualization of context that can guide our work. It: Provides an historical and theoretical view of evaluators’ treatment of context Illustrates how context has influenced evaluation practice Presents a five-area framework for guiding a contextual analysis of evaluations Introduces “context assessment,” which provides a means of integrating context and its implications within the important stages of evaluation. This is the 135th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions is a must-have resource for researchers, students, university professors and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation

More than twenty years after the Earth Summit was held in Rio de Janeiro in 1992, both national and international actors in governmental and nongovernmental fields are still searching for insights into how sustainable development can be advanced and environmental concerns incorporated into the development agenda more effectively. Moreover, climate change has emerged as a preeminent challenge to both the environment and to development. Evaluating Environment in International Development provides international perspectives and in-depth knowledge of evaluating development and the environment and applies evaluation knowledge to climate change mitigation and adaptation. The book focuses on the approaches and experiences of leading international organizations, not-for-profits, and multilateral and bilateral aid agencies to illustrate how systematic evaluation is an essential tool for providing evidence for decision-makers. It provides novel and in-depth perspectives on evaluating environment and sustainability issues in developing countries. Moving beyond projects and programmes, it considers aspects such as evaluating normative work on the environment and evaluating environmental consequences of economic and social development efforts. This original collection should be of interest to scholars of environment studies, development studies, international relations, sustainable development and evaluation, as well as practitioners in international organizations and development and environmental NGOs.

Although environmental policy and program evaluation emerged rather late compared to many other areas of public policy, an energetic evaluation community in the environmental field has emerged during the last decade. This is a community of evaluators with diverse backgrounds in environmental sciences, social sciences, and general evaluation. Evaluation in the environmental field is characterized by complex policies and programs around wicked problems. They exist within complex systems composed of interacting environmental and socioeconomic systems. In furthering the state of evaluation in the environmental field, this issue of focuses on key methodological challenges: time horizons scaling data credibility research designs and counterfactuals Contributors look at each challenge with two chapters, to enhance a pluralistic discourse for development of the theory and practice of environmental evaluation. The authors?from Australia, Europe, and North America?represent the diversity of the community with respect to their formal training, personal experiences, and institutional affiliations. The issue concludes with two commentaries reflecting on the discussions in relation to that of contemporary evaluation in general and a summary of the insights for the future of environmental evaluation. These chapters cumulatively hold promise for furthering the quality of evaluations not only in the environmental field but in other fields as well. This is the 122nd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

With the growing number, complexity, and importance of environmental problems come demands to include a full range of intellectual disciplines and scholarly traditions to help define and eventually manage such problems more effectively. Decision Making for the Environment: Social and Behavioral Science Research Priorities is the result of a 2-year effort by 12 social and behavioral scientists, scholars, and practitioners. The report sets research priorities for the social and behavioral sciences as they relate to several different kinds of environmental problems.

Monitoring and evaluation (M&E) of climate change adaptation (CCA) poses an assortment of thorny methodological challenges. Individually, none are unique to CCA, but together they represent a very distinctive conundrum facing practitioners and policy makers. Adding to this complexity further, climate change may be global in nature but its impacts, and how we respond to them through adaptation efforts, cut across scales, sectors, and levels of intervention. As investments in climate adaptation increase, organizations are seeking to measure, assess and understand an array of adaptation initiatives, and derive learnings to inform policy and praxis. This issue presents findings from many of the most important contemporary CCA program evaluation research initiatives. The chapters represent the most coherent and current collection of CCA M&E research in this emerging and important field, written by many of its leading experts. Filled with examples and insights in formulating coherent responses to methodological challenges, it will be of interest to M&E scholars and practitioners globally. This is the 147th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

New York City's municipal water supply system provides about 1 billion gallons of drinking water a day to over 8.5 million people in New York City and about 1 million people living in nearby Westchester, Putnam, Ulster, and Orange counties. The combined water supply system includes 19 reservoirs and three controlled lakes with a total storage capacity of approximately 580 billion gallons. The city's Watershed Protection Program is intended to maintain and enhance the high quality of these surface water sources. Review of the New York City Watershed Protection Program assesses the efficacy and future of New York City's watershed management activities. The report identifies program areas that may require future change or action, including continued efforts to address turbidity and responding to changes in reservoir water quality as a result of climate change.

Sensitivity to scales is one of the key challenges in environmental governance. Climate change, food production, energy supply, and natural resource management are examples of environmental challenges that stretch across scales and require action at multiple levels. Governance systems are typically ill-equipped for this task due to organisational and jurisdictional specialisation and short-term planning horizons. Further to this, scientific knowledge is fragmented along disciplinary lines and research traditions in academia and research institutions. State-of-the-art, Scale-Sensitive Governance of the Environment addresses these challenges by establishing the foundation for a new, trans-disciplinary research field. It brings together and reframes a variety of disciplinary approaches, using the idea of scales to create a conceptual and methodological basis for scale-sensitive governance of the environment from both a natural and social science perspective. This volume presents new visions, methods and innovative applications of thinking and decision making across scales in space and time to develop a holistic view on the subject. It is unique in providing: F analysis on how spatial, temporal, and governance scales are constructed, politically and scientifically defined, institutionalized in governance practices, and strategically used in policy discourses F details on how current environmental governance practices can be enriched by the use of theory on scale, with specific research themes to show the benefits of recognizing scales in empirical research F insightful case studies drawn from countries in the Americas, Eastern and Southern Africa, Europe, and South and Southeastern Asia, covering a wide range of environmental topics including biodiversity, climate change, commodities (tea and palm oil), cultural landscapes, energy, forestry, natural resource management, pesticides, urban development, and water management. With its comprehensive coverage of scale and scaling issues and convergence of widely different scientific approaches, this book is essential for environmental scientists, policy makers and planners, also conservation biologists and ecologists who are involved in modeling climate change impacts and sustainability. This reference will also benefit students of environmental studies, and all those who seek a response to the urgent environmental governance challenges for the decades ahead.

This book provides a balanced critique of a range of international sustainability certification schemes across nine agricultural and natural resource industries. Certification schemes set standards through intramarket private and multi-stakeholder mechanisms, and while third-party verification is often compulsory, certification schemes are regulated voluntarily rather than legislatively. This volume examines the intricacies of certification schemes and the issues they seek to address and provides the context within which each scheme operates. While a distinction between sustainability certifications and extra-markets or intrabusiness codes of conducts is made, the book also demonstrates how both are often working towards similar sustainability objectives. Each chapter highlights a different sector, including animal welfare, biodiversity, biofuels, coffee, fisheries, flowers, forest management and mining, with the contributions offering interdisciplinary perspectives and utilising a wide range of methodologies. The realities, achievements and challenges faced by varying certification schemes are discussed, identifying common outcomes and findings and concluding with recommendations for future practice and research. The book is aimed at advanced students, researchers and professionals in agribusiness, natural resource economics, sustainability assessment and corporate social responsibility.