Assessing Performance ：Designing, Scoring, and Validating Performance Tasks

Publication subTitle ：Designing, Scoring, and Validating Performance Tasks

Author： Johnson> Robert L.; Penny3> James A.  

Publisher： Guilford Publications Inc‎

Publication year： 2008

E-ISBN: 9781606230794

P-ISBN(Paperback): 9781593859893

Subject： F243 劳动组织和管理

Keyword： 心理学,预防医学、卫生学,教育学,教育,经济计划与管理

Language： ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Description

A comprehensive resource for assessment practitioners, this book provides step-by-step guidance for developing, administering, scoring, and validating a range of performance tasks, including literacy and other types of proficiency assessments. The authors explore how to establish the purpose of the assessment and how to develop scoring tools, train raters, reduce rater bias, review scores and report results, and use item-level and test-level analyses to optimize reliability and validity. Clearly written and well organized, the book includes many practical examples and accessible explanations of concepts and statistical procedures. It encompasses the breadth of applications of performance assessment today, from educational testing and the credentialing of professionals to research and program evaluation.

 

User-friendly features include:

*Checklists of activities to complete at each stage of a performance assessment

*End-of-chapter questions to facilitate self-study

*Annotated suggestions for further reading

*A quick-reference glossary of terms

*Examples drawn from multiple educational and professional licensure contexts

Chapter

Cover

Preface

TOC$Contents

CH$Chapter 1 An Overview of Performance Assessment

INTRODUCTION

DEFINING PERFORMANCE AND PERFORMANCE ASSESSMENT

TYPES OF PERFORMANCE ASSESSMENTS

APPLICATIONS

WHY PERFORMANCE ASSESMENT?

ORIGINS OF PERFORMANCE ASSESSMENT

ISSUES OF RELIABILITY AND VALIDITY IN PERFORMANCE ASSESSMENT

CH$Chapter 2 Designing the Assessment

INTRODUCTION

PURPOSE OF THE ASSESSMENT

FRAMEWORK

TEST SPECIFICATIONS

ADVISORY COMMITTEES

DOCUMENTATION

CH$Chapter 3 Construction of a Performance Task

INTRODUCTION

ELEMENTS OF A PERFORMANCE ASSESSMENT TASK

QUALITIES TO REVIEW

CH$Chapter 4 An Example of Constructing a Performance Assessment

INTRODUCTION

REVIEW OF LANGUAGE ARTS CONTENT STANDARDS

ALIGNMENT OF WRITING PROMPTS, SCO RING RUBRICS, AND ADMINIS TRATION CONDITIONS WITH THE STANDARDS

DESIGN FEATURES AND REVIEW CRITERIA FOR PROMPT DEVELOPMENT

SENSITIVITY AND BIAS REVIEW

FIELD-TESTING WRITING PROMPTS

CH$Chapter 5 Administration

INTRODUCTION

STANDARDIZATION

CH$Chapter 6 Developing Tools for Scoring

SCENARIO

DEVELOPMENT OF SCORING GUIDES

DEVELOPMENT OF A SCORING GUIDE FRAMEWORK

AN EXAMPLE OF RUBRIC DEVELOPMENT

RANGEFINDING AND SELECTION OF EXEMPLAR RESPONSES

ADDITIONAL RATING TOO LS

DECISION RULES AND NONSCORABLE RESPONSES

CH$Chapter 7 Training Raters and Staff

INTRODUCTION

TRAINING RATERS TO EVALUATE PERFORMANCE ASSESSMENTS

DESIGNING THE TRAINING SESIONS

READING FOR EVIDENCE

RATER BIAS AND SCORE VARIABILITY

TRAINING MATERIALS AND PROCEDURES AND SCORE VARIABILITY

TRAINING SCRIPTS

MONITORING OF TRAINING

DISMISSING TRAINEES

THE ROLE OF EXPERT TRAINING STAFF

CH$Chapter 8 Scoring and Monitoring

INTRODUCTION

FACILITY AND LOGISTICS

MONITORING THE QUALITY OF RATINGS

MONITORING PROCEDURES

SCORE RESOLUTION MODELS

EFFICACY OF RESOLUTION METHODS

CH$Chapter 9 Forming Scores and Item-Level Analyses

INTRODUCTION

THE ORAL CLINICAL EXAMINATION

FORMING OPERATIONAL SCORES

DEFINING A PASSING STANDARD FOR USE WITH PERFORMANCE ASSESSMENT

CH$Chapter 10 Test-Level Analyses

INTRODUCTION

INDICES OF RELIABILITY

EVALUATION OF RELIABILITY ESTIMATES

STANDARD ERROR OF MEASURE

AN EXAMPLE OF ESTIMATING RELIABILITY

VALIDITY

Glossary

References

Author Index

IDX$Subject Index

About the Authors

The users who browse this book also browse


No browse record.