Acknowledgments vii About the Authors ix Introduction: Getting from Here to There 1 I MAKING THE BIG DECISIONS 15 1 Building Support for Better Observer Training 17 2 Finding Enough Observers 25 3 Deciding on Training Delivery Methods 35 4 Setting Priorities for Observer Training 45 II PRE-SCORING VIDEO 51 5 Understanding Pre-Scoring Video 53 6 Planning a Pre-Scoring Process 59 7 Getting the Right Video to Pre-Score 75 8 Recruiting and Training Master Coders 85 9 Ensuring the Quality of Pre-Scoring 101 III BUILDING THE KNOWLEDGE AND SKILLS FOR OBSERVATION 113 10 Knowing the Rubric 115 11 Collecting Evidence 127 12 Understanding Bias 139 13 Recognizing Evidence 149 14 Using Criteria for Rating 167 15 Coaching Teachers 187 16 Organizing a Training Program 211 IV USING DATA TO IMPROVE TRAINING AND SUPPORT OF OBSERVERS 221 17 Collecting and Using Data from Training 223 18 Assessing Observers to Ensure and Improve Quality 233 19 Monitoring Your Observation System 267 Concluding Thoughts: Getting It Right 285 Appendix 287 Observer Training Checklist 287 Planning Worksheet 291 Tools Referenced in This Book 304 Tool 7-1: DCPS Video Quality Checklist 305 Tool 8-1: RIFT Master Coding Worksheet 307 Tool 8-2: DCPS Advice for Facilitating Reconciliation 308 Tool 8-3: DCPS Guidelines for Score Rationales 311 Tool 13-1: DCPS Evidence Collection Template 314 Tool 14-1: Partnerships to Uplift Communities (PUC) Evidence Record Rubric 318 Tool 14-2: Literacy Design Collaborative (LDC)/(TCRP) Top Ten Principles of True Scoring 320 Tool 14-3: RIDE Calibration Session Protocol 322 Tool 15-1: RIDE Feedback Quality Review Tool 327 Tool 15-2: Hillsborough County Public Schools (HCPS) Post-Observation Assessment Checklist 328 Tool 17-1: DCPS Feedback Rubric with Annotated Example 331 Tool 18-1: Minneapolis Public Schools (MPS) Rubric for Rating Use of Evidence 337 Tool 19-1: RIDE Teacher Survey Items on Observation 338 Notes 341 References 343 Index 345.