Public programs are designed to reach certain goals and beneficiaries. Methods to understand whether such programs actually work, as well as the level and nature of impacts on intended beneficiaries, are main themes of this book.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

There are many reasons why strategic intelligence is required to support policy decisions. These primarily stem from the nature of today's kno- edge society with two contrasting trends. On the one hand, there is a trend of increasing human intelligence in the economic, social and political s- tems. On the other hand, there is a trend towards dissolving certainties about the problems and solutions of today's society. Clearly, more inf- mation does not necessary imply more certainties on how to act. What is more, the same facts are often interpreted in markedly different ways: the same policy relevant information can – and often does – results in confli- ing framing of a problem by different stakeholders. This is mainly due to competing assumptions, rather then because of inconsistent facts. The- fore, it is not surprising that policy-makers are calling for strategic intel- gence to support their understanding of today's challenges, including the relevant aspects of science and technology, their impact and their possible future developments. Over the last 15 years, Europe has rapidly adopted the practice of dev- oping and using Impact Assessment (IA) tools to support decision-making. Formal procedures and guidance for IA are well established within the European Commission and in most EU Member States. The adoption of IA procedures alone, however, does not guarantee that every policy domain is actually using the full potential of these assessment tools in the preparation of policies and legislation.

‘Represents the culmination of an 18-month-long project that aims to be the definitive review of this important topic. Accompanied by a scholarly literature review, some new analysis, and a wealth of evidence and insight... the report is a tour de force; a once-in-a-generation opportunity to take stock.’ – Dr Steven Hill, Head of Policy, HEFCE, LSE Impact of Social Sciences Blog ‘A must-read if you are interested in having a deeper understanding of research culture, management issues and the range of information we have on this field. It should be disseminated and discussed within institutions, disciplines and other sites of research collaboration.’ – Dr Meera Sabaratnam, Lecturer in International Relations at the School of Oriental and African Studies, University of London, LSE Impact of Social Sciences Blog Metrics evoke a mixed reaction from the research community. A commitment to using data and evidence to inform decisions makes many of us sympathetic, even enthusiastic, about the prospect of granular, real-time analysis of our own activities. Yet we only have to look around us at the blunt use of metrics to be reminded of the pitfalls. Metrics hold real power: they are constitutive of values, identities and livelihoods. How to exercise that power to positive ends is the focus of this book. Using extensive evidence-gathering, analysis and consultation, the authors take a thorough look at potential uses and limitations of research metrics and indicators. They explore the use of metrics across different disciplines, assess their potential contribution to the development of research excellence and impact and consider the changing ways in which universities are using quantitative indicators in their management systems. Finally, they consider the negative or unintended effects of metrics on various aspects of research culture. Including an updated introduction from James Wilsdon, the book proposes a framework for responsible metrics and makes a series of targeted recommendations to show how responsible metrics can be applied in research management, by funders, and in the next cycle of the Research Excellence Framework. The metric tide is certainly rising. Unlike King Canute, we have the agency and opportunity – and in this book, a serious body of evidence – to influence how it washes through higher education and research.

Impact evaluation aims to answer whether and to what extent a development intervention has delivered its intended effects, thus enabling evidence-based policy making. The desire for more hard evidence of the effectiveness of development interventions has fueled a growing interest in rigorous impact evaluation in the international development community. This report discusses the fundamental challenge of impact evaluation, which is to credibly attribute the impact, if any, to the intervention concerned. It then discusses the merits and limitations of various impact evaluation methods. It also presents a survey of recent applications of impact evaluation, focusing on the typical evaluation problems looked at, methods used, and key findings. The report includes six case studies and outlines practical steps in implementing an impact evaluation.

Impact evaluation is an empirical approach to estimating the causal effects of interventions, in terms of both magnitude and statistical significance. Expanded use of impact evaluation techniques is critical to rigorously derive knowledge from development operations and for development investments and policies to become more evidence-based and effective. To help backstop more use of impact evaluation approaches, this book introduces core concepts, methods, and considerations for planning, designing, managing, and implementing impact evaluation, supplemented by examples. The topics covered range from impact evaluation purposes to basic principles, specific methodologies, and guidance on field implementation. It has materials for a range of audiences, from those who are interested in understanding evidence on "what works" in development, to those who will contribute to expanding the evidence base as applied researchers.

Around the globe, ex ante evaluation of legislation has become an established rationalisation of legislative processes. Legislators, politicians, and the public at large increasingly demand new laws to have a particular effect and no unwanted side effects. Various instruments are being applied that all have in common that they must predict the effect of new legislation. Until now, most publications on regulatory impact assessment praise such instruments as being extremely useful. Scepticism, however, is in order as well. Is it not as difficult to predict the future effect of a new set of rules in our complex society as it is to predict where our society as a whole is going? The search for an answer to this sceptical question is at the heart of the book. The newly established Research Group for Methodology of Law and Legal Research at Tilburg University (the Netherlands) brought together some of Europe s top specialists in the field of ex ante evaluation of legislation, with backgrounds in law, social science, political science, and law and economics. The result of their collaborative effort is a comprehensive and critical book on the pros and cons and on the opportunities, limitations, and challenges of ex ante assessment of legislation.