While improvement science has experienced a surge of interest over the past 30 years, applications of it are rare in the evaluation literature. This issue promotes the cross-fertilization of ideas, techniques, and tools between evaluation and improvement science. There are at least four areas where this cross-fertilization is particularly relevant: learning from error, examining variation, appreciating context, and focusing on systems change. This volume considers: the conceptual similarities and distinctions between improvement science and evaluation; the intellectual foundations, methods, and tools that collectively comprise improvement science; and case chapters that offer an inspiring review of state-of-the-art improvement science applications. Cutting across all of these applications is a shared grounding in systems thinking, a determination to capture and better understand variation and contextual complexity, as well as a sustained commitment to generative learning about projects and programs—all issues of great concern to evaluators. The issue offers producers and users of evaluations the potential benefits of a closer engagement with improvement science. This is the 153rd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication ofthe American Evaluation Association.

While improvement science has experienced a surge of interest over the past 30 years, applications of it are rare in the evaluation literature. This issue promotes the cross-fertilization of ideas, techniques, and tools between evaluation and improvement science. There are at least four areas where this cross-fertilization is particularly relevant: learning from error, examining variation, appreciating context, and focusing on systems change. This volume considers: the conceptual similarities and distinctions between improvement science and evaluation; the intellectual foundations, methods, and tools that collectively comprise improvement science; and case chapters that offer an inspiring review of state-of-the-art improvement science applications. Cutting across all of these applications is a shared grounding in systems thinking, a determination to capture and better understand variation and contextual complexity, as well as a sustained commitment to generative learning about projects and programs—all issues of great concern to evaluators. The issue offers producers and users of evaluations the potential benefits of a closer engagement with improvement science. This is the 153rd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication ofthe American Evaluation Association.

Economic, academic, and social forces are causing undergraduate schools to start a fresh examination of teaching effectiveness. Administrators face the complex task of developing equitable, predictable ways to evaluate, encourage, and reward good teaching in science, math, engineering, and technology. Evaluating, and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics offers a vision for systematic evaluation of teaching practices and academic programs, with recommendations to the various stakeholders in higher education about how to achieve change. What is good undergraduate teaching? This book discusses how to evaluate undergraduate teaching of science, mathematics, engineering, and technology and what characterizes effective teaching in these fields. Why has it been difficult for colleges and universities to address the question of teaching effectiveness? The committee explores the implications of differences between the research and teaching cultures-and how practices in rewarding researchers could be transferred to the teaching enterprise. How should administrators approach the evaluation of individual faculty members? And how should evaluation results be used? The committee discusses methodologies, offers practical guidelines, and points out pitfalls. Evaluating, and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics provides a blueprint for institutions ready to build effective evaluation programs for teaching in science fields.

This new edition of this bestselling guide offers an integrated approach to process improvement that delivers quick and substantial results in quality and productivity in diverse settings. The authors explore their Model for Improvement that worked with international improvement efforts at multinational companies as well as in different industries such as healthcare and public agencies. This edition includes new information that shows how to accelerate improvement by spreading changes across multiple sites. The book presents a practical tool kit of ideas, examples, and applications.

Improvement Science as a Tool for School Enhancement: Solutions for Better Educational Outcomes is a collection of equity-focused improvement science-in-action, school-based case studies led by practitioners. Chapter authors tell us how and why improvement science principles make system-wide improvements in classroom practice, how they learned from the problems encountered and, further, how they were then able to make changes within a school or district. A core principle of improvement science is variability in context (what works for whom and under what conditions)--a critical concept for improvement in each of the case studies. Each team analyzed their problem of practice from the perspective of the unique conditions in their context, considering what might work, and what might not work, and when the changes could be expanded for implementation school- or district-wide. Early chapters describe the actions of school personnel to embed social and emotional learning as well as how to serve historically underserved students during disasters. Trauma-informed and restorative practices embraced by all staff enhanced student outcomes and reduced educational disparities in classrooms and throughout the school. The content then explores how improvement science change processes improve chronic absenteeism and discipline issues through whole-school practices related to school climate. Centering student and family perception, developing representative systems, and facilitating collaborative improvement projects were found to measurably improve the experience of students, increase equity, reinforce democratic principles, and empower school stakeholders, especially those whose voices have historically been ignored, to create meaningful system-wide school improvement. Finally, the material in the book provides concrete examples of improvement science as it applies in real-setting to address high school advisories, graduation rates, services for multi-lingual learners, students with disabilities, and reading clubs. Each chapter has an equity focus. The editors and contributors provide examples of how to use the processes and tools of improvement science to increase equity system-wide. How to use improvement science to address educational disparities system-wide with urgency, commitment, and a belief in the success of every child, of every race, every ethnicity, gender, ability, and cultural identity, is the essence of this book.

In Mixed Methods Design in Evaluation, the first volume of SAGE's Evaluation in Practice Series, best-selling author Donna M. Mertens explores the meaning of mixed methods evaluation, its evolution over the last few decades, and the dominant philosophical frameworks that are influencing thought and practice in the field today. Four chapters explore evaluation of the effectiveness of interventions, development of instruments, systematic reviews, and policy evaluations, while an additional chapter covers evaluation approaches often required in specific contexts including gender responsive evaluations, needs assessment, and evaluations in conflict zones. Practical in nature, the book guides readers’ thinking about the design of mixed methods evaluations through the use of illustrative examples and explanations for further applications.

Program Theory-Driven Evaluation Science fills the gap between 21st century literature on evaluation and what is happening in practice. It features detailed examples of how evaluations actually unfold in practice to develop people, programs, and organizations. Commonly accepted strategies for practicing evaluation are outlined, followed by comprehe

Quality of care is a priority for U.S. Agency for International Development (USAID). The agency's missions abroad and their host country partners work in quality improvement, but a lack of evidence about the best ways to facilitate such improvements has constrained their informed selection of interventions. Six different methods - accreditation, COPE, improvement collaborative, standards-based management and recognitions (SBM-R), supervision, and clinical in-service training - currently make up the majority of this investment for USAID missions. As their already substantial investment in quality grows, there is demand for more scientific evidence on how to reliably improve quality of care in poor countries. USAID missions, and many other organizations spending on quality improvement, would welcome more information about how different strategies work to improve quality, when and where certain tools are most effective, and the best ways to measure success and shortcomings. To gain a better understanding of the evidence supporting different quality improvement tools and clarity on how they would help advance the global quality improvement agenda, the Institute of Medicine convened a 2-day workshop in January 2015. The workshop's goal was to illuminate these different methods, discussing their pros and cons. This workshop summary is a description of the presentations and discussions.

The past half-century has witnessed a dramatic increase in the scale and complexity of scientific research. The growing scale of science has been accompanied by a shift toward collaborative research, referred to as "team science." Scientific research is increasingly conducted by small teams and larger groups rather than individual investigators, but the challenges of collaboration can slow these teams' progress in achieving their scientific goals. How does a team-based approach work, and how can universities and research institutions support teams? Enhancing the Effectiveness of Team Science synthesizes and integrates the available research to provide guidance on assembling the science team; leadership, education and professional development for science teams and groups. It also examines institutional and organizational structures and policies to support science teams and identifies areas where further research is needed to help science teams and groups achieve their scientific and translational goals. This report offers major public policy recommendations for science research agencies and policymakers, as well as recommendations for individual scientists, disciplinary associations, and research universities. Enhancing the Effectiveness of Team Science will be of interest to university research administrators, team science leaders, science faculty, and graduate and postdoctoral students.

The definitive work in D&I research -- now completely updated and expanded The application of scientific research to the creation of evidence-based policies is a science unto itself -- and one that is never easy. Dissemination and implementation research (D&I) is the study of how scientific advances can be implemented into everyday life, and understanding how it works has never been more important for students and professionals across the scientific, academic, and governmental communities. Dissemination and Implementation Research in Health is a practical guide to making research more consequential, a collection assembled and written by today's leading D&I researchers. Readers of this book are taught to: � Evaluate the evidence base in an effective intervention � Choose a strategy that produces the greatest impact � Design an appropriate and effectual study � Track essential outcomes � Account for the barriers to uptake in communities, social service agencies, and health care facilities The challenges to moving research into practice are universal, and they're complicated by the current landscape's reliance on partnerships and multi-center research. In this light, Dissemination and Implementation Research in Health is nothing less than a roadmap to effecting change in the sciences. It will have broad utility to researchers and practitioners in epidemiology, biostatistics, behavioral science, economics, medicine, social work, psychology, and anthropology -- both today and in our slightly better future.