What are students learning? Throughout the world, governments striving to improve educational quality are turning to national assessments to provide this much-needed information in key curriculum areas. The capacity for carrying out national assessments has grown remarkably in recent years, but it has not been matched by widespread use of their findings. This book seeks to maximize an appreciation for the value of such data and to assist countries in exploiting the knowledge that national assessments yield. Using the Results of a National Assessment of Educational Achievement identifies the main factors affecting the use of national assessment findings. These include the political context in which an assessment is carried out, the nature of the assessment (census based or sample based), the assignment of accountability for the results, and the quality of assessment instruments. The book describes the type of information that the main report of a national assessment should contain, as well as other means of communicating findings to technical and nontechnical audiences. It outlines general considerations in translating national assessment results into policy and action, and examines specific procedures for using the data in policy making, educational management, teaching, and promoting public awareness. The topics addressed in this volume should be of interest to policy makers, educators, researchers, and development practitioners.

This volume provides step-by-step details on how to analyze data collected in a national assessment, with an introduction to statistical analyses normally carried out in these large-scale assessments, item and test analysis, and a CD contains with analysis software (IATA), exercises and supporting data files.

The National Assessments of Educational Achievement Series introduces readers to key concepts and issues related to assessments of student achievement levels. The first volume focuses on policy issues which should be addressed when designing and carrying out a national assessment. It features country case studies, and descriptions of major international and regional assessment programs. The remaining books in the series cover test development, sampling, data cleaning, statistics, report writing and using national assessment results to improve educational quality.

The issues surrounding the comparability of various tests used to assess performance in schools received broad public attention during congressional debate over the Voluntary National Tests proposed by President Clinton in his 1997 State of the Union Address. Proponents of Voluntary National Tests argue that there is no widely understood, challenging benchmark of individual student performance in 4th-grade reading and 8th-grade mathematics, thus the need for a new test. Opponents argue that a statistical linkage among tests already used by states and districts might provide the sort of comparability called for by the president's proposal. Public Law 105-78 requested that the National Research Council study whether an equivalency scale could be developed that would allow test scores from existing commercial tests and state assessments to be compared with each other and with the National Assessment of Education Progress. In this book, the committee reviewed research literature on the statistical and technical aspects of creating valid links between tests and how the content, use, and purposes of education testing in the United States influences the quality and meaning of those links. The book summarizes relevant prior linkage studies and presents a picture of the diversity of state testing programs. It also looks at the unique characteristics of the National Assessment of Educational Progress. Uncommon Measures provides an answer to the question posed by Congress in Public Law 105-78, suggests criteria for evaluating the quality of linkages, and calls for further research to determine the level of precision needed to make inferences about linked tests. In arriving at its conclusions, the committee acknowledged that ultimately policymakers and educators must take responsibility for determining the degree of imprecision they are willing to tolerate in testing and linking. This book provides science-based information with which to make those decisions.

Implementation of a National Assessment of Educational Achievement focuses on the practical tasks involved in running a large-scale national assessment program. It has four parts. Part I provides an overview of the tasks involved - how the essential activities of an assessment are organized and implemented, the personnel and resources that are required, and the tasks that follow the collection of data. In Part II, a methodology for selecting a sample of students that will be representative of students in the education system is presented. Principles underlying sampling are described, as well as step-by-step procedures that can be implemented in nearly any national assessment. An accompanying CD contains supporting data files. Part III describes procedures for cleaning and managing data collected in a national assessment, essential elements of a quality assurance process. It also describes how to export and import data, that is, make data available in a format that is appropriate for users of statistical software such as Access, SPSS, WesVar, and Excel. The primary objective of this section is to enable the national assessment team develop and implement a systematic set of procedures to help ensure that the assessment data are accurate and reliable. Following sampling, test administration, data entry, and cleaning, the next step is to prepare data for analysis. In Part IV, a series of important pre-analysis steps, including producing estimates, computing and using survey weights, and computing estimates are described. The section dealing with the computation of estimates describes how they and their sampling errors are computed from simple and complex samples. Finally, a range of special topics, including nonresponse and issues relating to over-and under-size schools, is addressed.

To improve their education systems, countries around the world have increasingly initiated national largescale assessment programs or participated in international or regional large-scale assessment studies for the first time. Well-constructed large-scale assessments can provide credible information on student achievement levels, which, in turn, can promote better resource allocation to schools, stronger education service delivery, and improved learning outcomes. The World Bank developed this Primer on Large-Scale Assessments of Educational Achievement as a firststop resource for those wanting to understand how to design, administer, analyze, and use the results from these assessments of student achievement. The book addresses frequently asked questions from people working on large-scale assessment projects and those interested in making informed decisions about them. Each chapter introduces a stage in the assessment process and offers advice, guidelines, and country examples. This book also reports on emerging trends in large-scale assessment and provides updated information on regional and international large-scale assessment programs. DIRK HASTEDT, Executive Director of the International Association for the Evaluation of Educational Achievement (IEA) “A special feature of the publication is that it not only gives an overview of technical specifications, but also includes examples from around the world on how countries are conducting large-scale assessments, what they found, and how the results were used. With this perspective, the Primer on Large-Scale Assessments of Educational Achievement is an excellent and easy-to-read publication to get a comprehensive overview of large-scale assessments and how and why they are conducted.†? SILVIA MONTOYA, Director of UNESCO Institute for Statistics (UNESCO UIS) “If you are responsible for learning assessment in a country and are searching for a comprehensive, yet readable, guide on large-scale assessment, this is your book. Extremely well structured and written, this primer is easy to follow, and makes points clearly and concisely. It is an excellent resource that explores the steps for a good large-scale assessment with examples from all international large-scale assessment programs.†? ANDREAS SCHLEICHER, Director for the Directorate of Education and Skills and Special Advisor on Education Policy to the Organization for Economic Cooperation and Development’s (OECD) Secretary- General “Many countries have joined international educational assessments to benchmark quality, equity, and efficiency in their education systems. But what does it take to design and implement those efforts well and to draw value from this to help students learn better, teachers teach better, and schools to work more effectively? This Primer on Large-Scale Assessments of Educational Achievement helps policy makers and their technical teams to find answers to these questions.†? ANDREI VOLKOV, Director of the Institute for Public Strategy, Moscow School of Management SKOLKOVO “In 2008, when the Russia Education Aid for Development (READ) Program was launched, we determined its main goal as the improvement of the quality of basic education. Today, the READ Program keeps setting trends as the largest Russian initiative promoting educational assessment. Approaches developed within the READ Program, from building institutional and expert capacity to influencing educational reforms, have proven their efficacy in many countries. The Primer on Large-Scale Assessments of Educational Achievement brings together in a practical format the best experience and case studies in conducting assessments under the READ Program. An especially important feature of the book is an integrated capacity building component, which makes it a practical tutorial ready for use in different cultural contexts. Through this book, we hope that our collective experience gathered during READ will be widely shared, bringing us closer to achievement of the Sustainable Development Goal on education.†? evelopment Goal on Education.†?

Since 1969, the National Assessment of Educational Progress (NAEP) has been providing policymakers, educators, and the public with reports on academic performance and progress of the nation's students. The assessment is given periodically in a variety of subjects: mathematics, reading, writing, science, the arts, civics, economics, geography, U.S. history, and technology and engineering literacy. NAEP is given to representative samples of students across the U.S. to assess the educational progress of the nation as a whole. Since 1992, NAEP results have been reported in relation to three achievement levels: basic, proficient, and advanced. However, the use of achievement levels has provoked controversy and disagreement, and evaluators have identified numerous concerns. This publication evaluates the NAEP student achievement levels in reading and mathematics in grades 4, 8, and 12 to determine whether the achievement levels are reasonable, reliable, valid, and informative to the public, and recommends ways that the setting and use of achievement levels can be improved.

Data from 20 years (1970-90) of the National Assessment of Educational Progress (NAEP) are summarized. The NAEP represents the nation's only ongoing assessment of the academic achievement of American students. Its assessments of educational achievement of students in grades 4, 8, and 12 are presented as "The Nation's Report Card". Chapter 1 of this report contains information about the students' competency in subject matter across the curriculum and their ability to use their minds well. Chapters 2 and 3 include information about the trends across time related to the performance of elementary school, middle school, and secondary school students in higher-order reasoning, problem solving, and communication skills as well as information about the academic achievement of minority students. Chapter 4 summarizes information about background variables related to education. In general, the data indicate that the educational performance of U.S. students is low and not improving. It is estimated that more than half of the nation's elementary through high school students are unable to demonstrate competency in challenging subject matter in English, mathematics, science, history, and geography. Fewer than half of all U.S. students appear to be able to use their minds well. Although considerable progress has been made in closing the performance gaps among different racial/ethnic and gender groups, the gaps still remain too large to meet the nation's objective of close parallels between the performance of minority students and the student population as a whole. Much that research has identified as effective in improving education is still not being implemented in the nation's schools. Nineteen tables and five figures summarize NAEP data. (SLD)