Research for Practical Issues and Solutions in Computerized Multistage Testing

Research for Practical Issues and Solutions in Computerized Multistage Testing
Author: Alina von Davier
Publisher: Routledge
Total Pages: 0
Release: 2025-01-03
Genre: Computers
ISBN: 9780367207809
GET BOOK

Download Research for Practical Issues and Solutions in Computerized Multistage Testing Book in PDF, Epub and Kindle

This volume presents a comprehensive collection of the latest research findings supporting the current and future implementations and applications of computerized multistage testing (MST). As a sequel to the widely acclaimed "Computerized Multistage Testing: Theory and Applications" (2014) by Yan, von Davier, and Lewis, this volume delves into the experiences, considerations, challenges, and lessons learned over the past years. It also offers practical approaches and solutions to the issues encountered. The topics covered include: purposeful MST designs, practical approaches for optimal design, assembly strategies for accuracy and efficiency, Hybrid designs, MST with natural language processing, practical routing considerations and methodologies, item calibration and proficiency estimation methods, routing and classification accuracy, added value of process data, prediction and evaluation of MST performance, cognitive diagnostic MST, differential item functioning, robustness of statistical methods, simulations, test security, the new digital large-scale SAT, software for practical assessment and simulations, AI impact, and the future of adaptive multistage testing. This volume is intended for students, faculty, researchers, practitioners, and education officers in the fields of educational measurement and evaluation, both in the United States and internationally.

Practical Considerations in Computer-Based Testing

Practical Considerations in Computer-Based Testing
Author: Cynthia G. Parshall
Publisher: Springer Science & Business Media
Total Pages: 233
Release: 2012-12-06
Genre: Social Science
ISBN: 1461300835
GET BOOK

Download Practical Considerations in Computer-Based Testing Book in PDF, Epub and Kindle

This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.

An Investigation on Computer-adaptive Multistage Testing Panels for Multidimensional Assessment

An Investigation on Computer-adaptive Multistage Testing Panels for Multidimensional Assessment
Author: Xinrui Wang
Publisher:
Total Pages: 82
Release: 2013
Genre: Computer adaptive testing
ISBN:
GET BOOK

Download An Investigation on Computer-adaptive Multistage Testing Panels for Multidimensional Assessment Book in PDF, Epub and Kindle

"The computer-adaptive multistage testing (ca-MST) has been developed as an alternative to computerized adaptive testing (CAT), and been increasingly adopted in large-scale assessments. Current research and practice only focus on ca-MST panels for credentialing purposes. The ca-MST test mode, therefore, is designed to gauge a single scale. The present study is the first step to investigate ca-MST panels for diagnostic purposes, which involve the assessment of multiple attributes in the same test. This study employed computer simulation to compare multidimensional ca-MST panels and their unidimensional counterparts, and to explore the factors that affect the accuracy and efficiency of multidimensional ca-MST. Nine multidimensional ca-MST panel designs - which differed in configuration and test length - were simulated under varied attribute correlation scenarios. In addition, item pools with different qualities were studied to suggest appropriate item bank design. The comparison between the multidimensional ca-MST and a sequential of unidimensional ca-MST suggested that when attributes correlated moderate to high, employing a multidimensional ca-MST provided more accurate and efficient scoring decisions than several unidimensional ca-MST with IRT scoring. However, a multidimensional ca-MST did not perform better than its unidimensional counterpart with MIRT scoring. Nevertheless, multidimensional panels are still promising for diagnostic purposes given practical considerations. The investigation on multidimensional ca-MST design indicated the following: Higher attribute correlation was associated with better scoring decision because more information carried by a correlation matrix was available for estimation. This held true across all item pool conditions. An optimal item pool would be the one that was discriminative, appropriately located and specifically designed for a configuration. The accuracy and efficiency of a multidimensional ca-MST panel would be diminished if its item pool was too easy, or not informative. According to the results, the 1-2-3 configuration design was most promising. In terms of test length, an appropriate decision would largely depend on the attribute correlation and the item pool characteristics."--Abstract from author supplied metadata.

Computerized Multistage Testing

Computerized Multistage Testing
Author: Duanli Yan
Publisher: CRC Press
Total Pages: 532
Release: 2016-04-19
Genre: Mathematics
ISBN: 146650580X
GET BOOK

Download Computerized Multistage Testing Book in PDF, Epub and Kindle

Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.

Computer-Based Testing and the Internet

Computer-Based Testing and the Internet
Author: Dave Bartram
Publisher: John Wiley & Sons
Total Pages: 272
Release: 2005-09-27
Genre: Psychology
ISBN: 0470861932
GET BOOK

Download Computer-Based Testing and the Internet Book in PDF, Epub and Kindle

No topic is more central to innovation and current practice in testing and assessment today than computers and the Internet. This timely publication highlights four main themes that define current issues, technical advances and applications of computer-based testing: Advances in computer-based testing -- new test designs, item selection algorithms, exposure control issues and methods, and new tests that capitalize on the power of computer technology. Operational issues -- systems design, test security, and legal and ethical matters. New and improved uses -- for tests in employment and credentialing. The future of computer-based testing -- identifying potential issues, developments, major advances and problems to overcome. Written by internationally recognized contributors, each chapter focuses on issues of control, quality, security and technology. These issues provide the basic structure for the International Test Commission's new Guidelines on Computer-Based Testing and Testing on the Internet. The contributions to this book have played a key role in the development of these guidelines. Computer-Based Testing and the Internet is a comprehensive guide for all professionals, academics and practitioners working in the fields of education, credentialing, personnel testing and organizational assessment. It will also be of value to students developing expertise in these areas.

Computerized Adaptive Testing

Computerized Adaptive Testing
Author: David J. Weiss
Publisher: Guilford Publications
Total Pages: 388
Release: 2024-04-29
Genre: Social Science
ISBN: 1462554520
GET BOOK

Download Computerized Adaptive Testing Book in PDF, Epub and Kindle

Used worldwide in assessment and professional certification contexts, computerized adaptive testing (CAT) offers a powerful means to measure individual differences or make classifications. This authoritative work from CAT pioneer David J. Weiss and Alper Şahin provides a complete how-to guide for planning and implementing an effective CAT to create a test unique to each person in real time. The book reviews the history of CAT and the basics of item response theory used in CAT. It walks the reader through developing an item bank, pretesting and linking items, selecting required CAT options, and using simulations to design a CAT. Available software for CAT delivery is described, including links to free and commercial options. Engaging multidisciplinary examples illustrate applications of CAT for measuring ability, achievement, proficiency, personality, attitudes, perceptions, patients’ reports of their symptoms, and academic or clinical progress.

Handbook of Automated Scoring

Handbook of Automated Scoring
Author: Duanli Yan
Publisher: CRC Press
Total Pages: 581
Release: 2020-02-26
Genre: Computers
ISBN: 1351264796
GET BOOK

Download Handbook of Automated Scoring Book in PDF, Epub and Kindle

"Automated scoring engines [...] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public." From the Foreword by Alina von Davier, ACTNext Senior Vice President Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.

Application of Artificial Intelligence to Assessment

Application of Artificial Intelligence to Assessment
Author: Hong Jiao
Publisher: IAP
Total Pages: 223
Release: 2020-03-01
Genre: Computers
ISBN: 1641139536
GET BOOK

Download Application of Artificial Intelligence to Assessment Book in PDF, Epub and Kindle

The general theme of this book is to present the applications of artificial intelligence (AI) in test development. In particular, this book includes research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing. By utilizing artificial intelligence, the efficiency of item development, test form construction, test delivery, and scoring could be dramatically increased. Chapters on automated item generation offer different perspectives related to generating a large number of items with controlled psychometric properties including the latest development of using machine learning methods. Automated scoring is illustrated for different types of assessments such as speaking and writing from both methodological aspects and practical considerations. Further, automated test assembly is elaborated for the conventional linear tests from both classical test theory and item response theory perspectives. Item pool design and assembly for the linear-on-the-fly tests elaborates more complications in practice when test security is a big concern. Finally, several chapters focus on computerized adaptive testing (CAT) at either item or module levels. CAT is further illustrated as an effective approach to increasing test-takers’ engagement in testing. In summary, the book includes both theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to automate the process of test development. While some of these automation processes have become common practices such as automated test assembly, automated scoring, and computerized adaptive testing, some others such as automated item generation calls for more research and exploration. When new AI methods are emerging and evolving, it is expected that researchers can expand and improve the methods for automating different steps in test development to enhance the automation features and practitioners can adopt quality automation procedures to improve assessment practices.

Computerized Adaptive Testing: Theory and Practice

Computerized Adaptive Testing: Theory and Practice
Author: Wim J. van der Linden
Publisher: Springer
Total Pages: 0
Release: 2010-12-01
Genre: Education
ISBN: 9789048155118
GET BOOK

Download Computerized Adaptive Testing: Theory and Practice Book in PDF, Epub and Kindle

This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.