Over the years, various approaches to validation have emerged in psychological and educational assessment research, which can be classified into traditional approaches and modern approaches. Traditional approaches view validity as a multicomponential concept including, for example, content, construct, and predictive validity, while modern approaches conceptualize it as a unitary concept evaluated through argumentation. Drawing on the modern approach, this book builds a validity argument for an International English Language Testing System (IELTS) listening test sample. The book provides some insights into the listening sub-skills that the test engages, the psychometric dimensionality of the test, variables that predict item difficulty parameters, bias across age, nationality, test experience, and gender, as well as predictive-referenced evidence of validity. A variety of techniques including the Rasch model and structural equation modelling are used to answer the research questions and to build a validity argument framework; this argument organizes the thematically related findings into a coherent treatment of the validity of the listening test. The book presents the first treatment of validity argument and related analytical tools in one volume and maps the psychometric/statistical analysis tools onto the validity argument framework. It also provides an extensive literature review of listening comprehension, validation, and psychometric modeling and proposes both methods for developing and validating self-assessment instruments and novel approaches to improving the quality of language assessments.

With examples of validation studies, this book demonstrates how to design research investigating the validity of language tests.

Building a Validity Argument for the Test of English as a Foreign LanguageTM is distinctive in its attempt to develop a coherent story of the rationale for a test or its revision, explain the research and development process, and provide the results of the validation process. This volume is particularly relevant for professionals and graduate students in educational measurement, applied linguistics, and second language acquisition as well as anyone interested in assessment issues.

The Test of English as a Foreign Language TM (TOEFL®) is used by more universities worldwide than any other test to assess English language proficiency for academic admission and placement decisions, and to guide English language instruction. This landmark volume provides a detailed description and analysis of Educational Testing Service’s research and development efforts to develop a major revision of the TOEFL® test. The result is a book that serves as a case study of test design drawing upon theory in the complex domain of English language proficiency while attempting to meet standards of educational measurement. Building a Validity Argument for the Test of English as a Foreign LanguageTM is distinctive in its attempt to develop a coherent story of the rationale for a test or its revision, explain the research and development process, and provide the results of the validation process. Through its treatment of one test, it expands on and tests principles and approaches to educational measurement, providing an in-depth, integrated perspective on the overall process of test revision. Moreover, because the conceptual foundation and history are presented alongside the empirical studies and validity argument, these sometimes disparate areas are presented in a way that demonstrates their connections – an approach which represents a departure from, or extension of, conventional materials on test revision. This volume is particularly relevant for professionals and graduate students in educational measurement, applied linguistics, and second language acquisition as well as anyone interested in assessment issues.

Winner of the 2018 Distinguished Book Award from the Communication and Social Cognition Division of the National Communication Association. Essential reading for listening researchers across a range of disciplines, The Sourcebook of Listening Research: Methodology and Measures is a landmark publication that defines the field of listening research and its best practices. the definitive guide to listening methodology and measurement with contributions from leading listening scholars and researchers Evaluates current listening methods and measures, with attention to scale development, qualitative methods, operationalizing cognitive processes, and measuring affective and behavioral components A variety of theoretical models for assessing the cognitive, affective, and behavioral facets of listening are presented alongside 65 measurement profiles Outlines cutting-edge trends in listening research, as well as the complexities involved in performing successful research in this area

This eBook is a collection of articles from a Frontiers Research Topic. Frontiers Research Topics are very popular trademarks of the Frontiers Journals Series: they are collections of at least ten articles, all centered on a particular subject. With their unique mix of varied contributions from Original Research to Review Articles, Frontiers Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author by contacting the Frontiers Editorial Office: frontiersin.org/about/contact.

This book examines the relationship between Chinese college-level test takers' strategy use and reading test performance using a Structural Equation Modelling Approach. With a large sample of Chinese college-level test takers, the book investigates the underlying structure of the EFL reading test. It suggests implications for classroom teachers and testing researchers about the relationship between metacognitive and cognitive strategy use in testing contexts.

Quantitative Data Analysis for Language Assessment Volume II: Advanced Methods demonstrates advanced quantitative techniques for language assessment. The volume takes an interdisciplinary approach and taps into expertise from language assessment, data mining, and psychometrics. The techniques covered include Structural Equation Modeling, Data Mining, Multidimensional Psychometrics and Multilevel Data Analysis.Volume II is distinct among available books in language assessment, as it engages the readers in both theory and application of the methods and introduces relevant techniques for theory construction and validation. This book is highly recommended to graduate students and researchers who are searching for innovative and rigorous approaches and methods to achieve excellence in their dissertations and research. It is also a valuable source for academics who teach quantitative approaches in language assessment and data analysis courses.

Despite prodigious developments in the field of language assessment in the Middle East and the Pacific Rim, research and practice in these areas have been underrepresented in mainstream literature. This volume takes a fresh look at language assessment in these regions, and provides a unique overview of contemporary language assessment research. In compiling this book, the editors have tapped into the knowledge of language and educational assessment experts whose diversity of perspectives and experience has enriched the focus and scope of language and educational assessment in general, and the present volume in particular. The six ‘trends’ addressed in the 26 chapters that comprise this title consider such contemporary topics as data mining, in-class assessment, and washback. The contributors explore new approaches and techniques in language assessment including advances resulting from multidisciplinary collaboration with researchers in computer science, genetics, and neuroscience. The current trends and promising new directions identified in this volume and the research reported here suggest that researchers across the Middle East and the Pacific Rim are playing—and will continue to play—an important role in advancing the quality, utility, and fairness of language testing and assessment practices.

Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.