This book provides a unifying structure for the activities that fall under the process typically called "standard setting" on tests of proficiency. Standard setting refers to the methodology used to identify performance standards on tests of proficiency. The results from standard setting studies are critical for supporting the use of many types of tests. The process is frequently applied to educational, psychological, licensure/certification, and other types of tests and examination systems. The literature on procedures for standard setting is extensive, but the methodology for standard setting has evolved in a haphazard way over many decades without a unifying theory to support the evaluation of the methods and the validation of inferences made from the standards. This text provides a framework for going beyond specific standard setting methods to gain an understanding of the goals for the methods and how to evaluate whether the goals have been achieved. The unifying structure provided in this text considers policy that calls for the existence of performance standards, the relationship of proficiency test design to the policy, and tasks assigned to subject matter experts to help them convert the policy to estimates of locations on the reporting score scale for the test. Guidance is provided for how to connect the psychometric aspects of the standard setting process to the intentions of policy makers as expressed in policy statements. Further, the structure is used support validity arguments for inferences made when using standards. Examples are provided to show how the unifying structure can be used to evaluate and improve standard setting methodology.

Publisher description

The growing interest in new methods of assessing learning shows a dynamic progression towards a better understanding of the way assessment influences how teachers teach and how students learn However. despite greater awareness of the importance of precise and rigorous assessment, many practitioners are still uninformed of the Importance of psychometric or test theories which underlle the essential qualities of educational and psychological assessment, and the fundamental role they play in ensuring accurate and fair measurement. Without a thorough understanding of the principles of measurement and the use of defensible psychometric or test theories, even the best assessment methods cannot provide accurate and useful information about student learning, progress, and attainment. This introductory book was written with the hope to provide those involved in assessment and psychometric testing, a better understanding of psychometric theories, objective measurement, essential psychometric properties of cognitive tests and other psychological measurement instruments, errors in rater-mediated assessment methods and Issues in standard setting, and their impact on fair and equitable assessment and measurement.

Grounded in current knowledge and professional practice, this book provides up-to-date coverage of psychometric theory, methods, and interpretation of results. Essential topics include measurement and statistical concepts, scaling models, test design and development, reliability, validity, factor analysis, item response theory, and generalizability theory. Also addressed are norming and test equating, topics not typically covered in traditional psychometrics texts. Examples drawn from a dataset on intelligence testing are used throughout the book, elucidating the assumptions underlying particular methods and providing SPSS (or alternative) syntax for conducting analyses. The companion website presents datasets for all examples as well as PowerPoint slides of figures and key concepts. Pedagogical features include equation boxes with explanations of statistical notation, and end-of-chapter glossaries. The Appendix offers extensions of the topical chapters with example source code from SAS, SPSS, IRTPRO, BILOG-MG, PARSCALE, TESTFACT, and DIMTEST.

Which types of validity evidence should be considered when determining whether a scale is appropriate for a given measurement situation? What about reliability evidence? Using clear explanations illustrated by examples from across the social and behavioral sciences, this engaging text prepares students to make effective decisions about the selection, administration, scoring, interpretation, and development of measurement instruments. Coverage includes the essential measurement topics of scale development, item writing and analysis, and reliability and validity, as well as more advanced topics such as exploratory and confirmatory factor analysis, item response theory, diagnostic classification models, test bias and fairness, standard setting, and equating. End-of-chapter exercises (with answers) emphasize both computations and conceptual understanding to encourage readers to think critically about the material. ÿ

This new text provides the most current coverage of measurement and psychometrics in a single volume. Authors W. Holmes Finch and Brian F. French first review the basics of psychometrics and measurement, before moving on to more complex topics such as equating and scaling, item response theory, standard setting, and computer adaptive testing. Also included are discussions of cutting-edge topics utilized by practitioners in the field, such as automated test development, game-based assessment, and automated test scoring. This book is ideal for use as a primary text for graduate-level psychometrics/measurement courses, as well as for researchers in need of a broad resource for understanding test theory. Features: "How it Works" and "Psychometrics in the Real World" boxes break down important concepts through worked examples, and show how theory can be applied to practice. End-of-chapter exercises allow students to test their comprehension of the material, while suggested readings and website links provide resources for further investigation. A collection of free online resources include the full output from R, SPSS, and Excel for each of the analyses conducted in the book, as well as additional exercises, sample homework assignments, answer keys, and PowerPoint lecture slides.

Psychometrics and Psychological Assessment: Principles and Applications reports on contemporary perspectives and models on psychological assessment and their corresponding measures. It highlights topics relevant to clinical and neuropsychological domains, including cognitive abilities, adaptive behavior, temperament, and psychopathology.Moreover, the book examines a series of standard as well as novel methods and instruments, along with their psychometric properties, recent meta-analytic studies, and their cross-cultural applications. - Discusses psychometric issues and empirical studies that speak to same - Explores the family context in relation to children's behavioral outcomes - Features major personality measures as well as their cross cultural variations - Identifies the importance of coping and resilience in assessing personality and psychopathology - Examines precursors of aggression and violence for prediction and prevention

In An Introduction to Psychological Assessment and Psychometrics, Keith Coaley outlines the key ingredients of psychological assessment, providing case studies to illustrate their application, making it an ideal textbook for courses on psychometrics or psychological assessment. New to the Second Edition: Includes occupational and educational settings Covers ethical and professional issues with a strong practical focus Case study material related to work selection settings End of chapter self-assessments to facilitate students’ progress Compliant with the latest BPS Certificate of Testing curriculum

Today psychometrics plays an increasingly important role in all our lives as testing and assessment occurs from preschool until retirement. This book introduces the reader to the subject in all its aspects, ranging from its early history, school examinations, how to construct your own test, controversies about IQ and recent developments in testing on the internet. In Part one of Modern Psychometrics, Rust and Golombok outline the history of the field and discuss central theoretical issues such as IQ, personality and integrity testing and the impact of computer technology and the internet. In Part two a practical step-by-step guide to the development of a psychometric test is provided. This will enable anyone wishing to develop their own test to plan, design, construct and validate it to a professional standard. This third edition has been extensively updated and expanded to take into account recent developments in the field, making it the ideal companion for those studying for the British Psychological Society’s Certificates of Competence in Testing. Modern Psychometrics combines an up to date scientific approach to the subject with a full consideration of the political and ethical issues involved in the large scale implementation of psychometrics testing in today’s highly networked society, particularly in terms of issues of diversity and internationalism. It will be useful to students and practictioners at all levels who are interested in psychometrics.

"Prepared by the Joint Committee on Standards for Educatioanl and Psychological Testing of the American Educational Research Association, American Psychological Association and National Council on Measurement in Education"--T.p. verso.