Associate Director, Score Validity Process and Test Security

Associate Director, Score Validity Process and Test Security

The Test Security team at College Board is a highly skilled group of 21 professionals dedicated to maintaining the fairness and integrity of our assessments. Through innovative, data-driven policies and tools, we work to prevent, detect, and resolve security threats, ensuring the credibility of SAT and AP exam scores. As part of this mission, the Score Validity Teamcomprising 10 team membersleads investigations into potential score irregularities and violations of our terms and conditions using advanced analytics and investigative techniques. We collaborate closely with internal teams, who provide essential support and infrastructure, and partner with external vendors to ensure comprehensive security measures and scalable solutions are in place prior to the administration of each exam. Together, we uphold the highest standards of test security, reinforcing the trust and reliability of our assessment programs.

As the Associate Director of Test Security, Score Validity, you will lead investigations into student score validity, plagiarism, improper use of artificial intelligence, and test-day irregularities for the College Readiness Assessments (CRA) and Advanced Placement (AP) exams. Your primary responsibility will be to ensure these investigations adhere to a structured, evidence-based process, determining whether there is substantial cause to question a student's score. You will analyze statistical and forensic evidence, review test-day reports, and examine test materials, while effectively communicating with students, parents, legal representatives, and educators to ensure fair resolutions. Additionally, your role involves enhancing policies, refining processes, and collaborating across teams to strengthen test security standards.

In this role, you will :

• Investigate and communicate (80%) :
• Analyze and investigate individual student score validity cases using data forensics, statistical analyses, test day reports, and interview findings.
• Maintain detailed and accurate records of all investigations, ensuring thorough documentation of notes, findings, and communications.
• Ensure timely and thorough management of score validity investigations, maintaining clear and consistent communication with students, parents, educators, and representatives, and articulating investigation processes, evidence, and dispositions clearly to all stakeholders.
• Regularly review and provide feedback on policies, processes, and protocols related to score validity and testing irregularities, contributing to continuous improvement.
• Coordinate tasks across internal and external stakeholders, providing subject-matter expertise on test security investigations, and ensuring cohesive collaboration.
• Maintain robust communication with critical system and product owners within Test Security Operations to ensure coordination with Technology, Operations, and Program teams.
• Formulate and vet recommendations for score validity, plagiarism, and irregularity cases, handling sensitive data and urgent timelines with discretion.
• Track and report key performance metrics for operational test security functions, integrating data from internal teams and security vendors to support informed decision-making.
• Actively support the use of data forensics and algorithms to detect patterns of anomalous testing behavior, facilitating further investigation.
• Project management (20%) :
• Lead and manage projects related to test security investigations, ensuring timely completion and alignment with strategic goals.
• Coordinate across teams for smooth execution of initiatives and clear stakeholder alignment.
• Allocate and manage resources effectively to meet project milestones.
• Communicate effectively with stakeholders and ensure staff are trained on new programs and initiatives.
• Develop detailed project plans, including scope, timelines, tasks, dependencies, and milestones, while identifying and mitigating potential risks.
• Implement quality assurance processes, continuously monitor progress, and maintain thorough documentation and reporting.

You have :

All roles at College Board require :

Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. While the hiring process may vary, it generally includes : resume and application submission, recruiter phone / video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

At College Board, we offer more than a paycheck-we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We're a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market. A thoughtful approach to compensation includes a hiring range of $56,000-$90,000. Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board. We adjust salaries by location to ensure fairness, no matter where you live. You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process.