Senior Content Development Administrator

Job Title : Evaluation

Education, Skills and Knowledge Required : Bachelor's degree. Excellent internal and external customer service skills. Excellent communication interpersonal skills (including phone skills for distributed projects and customer / program team meetings). Excellent writing skills, including the ability to write accurate and effective scorer training and to teach and coach content staff to write quality annotations, scoring decisions and other content- / project-related documentation. Strong content-specific knowledge and the ability to develop, coach, and provide feedback to content staff assigned to projects. Clear understanding of scoring concepts such as frequency distribution, validity, calibration and other industry terminology, as well as the ability to apply that knowledge to scoring situations. Strong computer skills, including use of common Microsoft Office applications (e.g. Word, Excel, PowerPoint), Google tools (e.g. Gmail, Google Drive, etc), and ability to handle multiple computer applications simultaneously. Ability to supervise large groups. Strong initiative and organizational and leadership skills, including the ability to prioritize and multi-task and make sound business decisions under tight deadlines. Ability to maintain a confidential work environment. Preferred : Two (2) years of experience as a Scoring Director or (5) years Scoring Supervisor in open-ended scoring preferred. Background / experience in educational measurement, including knowledge of common scoring industry practices. Experience directing both regional and distributed supervisors and scoring directors. Strong working knowledge and understanding of Scoring System reports, ability to manage data, and ability to drive scoring management decisions and continuous improvement. Desired : Advanced degree. Degree in education, English, mathematics, science, or language. Teaching experience in grades K-12.

Basic Purpose and Objectives

Guide and supervise scoring directors assigned to projects. Ensure that customers' scoring decisions are applied consistently to all student responses.

Organizational Relationships

Direction Received : Receives general direction on Pearson and Scoring Services policy and procedures from the Content Manager. Direction of Others : Advises scoring directors on content- and item-level scoring and quality issues. Evaluates scoring directors and provides feedback on job performance. Contacts : Works closely within and across departments (e.g., Online Scorer Training Development Team, Project Support, Project Management, Client Services) as required for the assigned project(s) to ensure overall project success. Attends departmental, program team, and customer meetings to exchange ideas and information, discuss issues, plan actions, review costs, and provide technical guidance. May also participate in departmental strategic initiative and continuous improvement activities.

Overall Functions and Responsibilities

1. Works with the project manager to complete quality management plans, rangefinding plans, and other project documentation, as required. 2. Plans content hours for assigned projects. 3. Identifies potential scoring directors from the pool of scoring supervisors. Guides, trains, and develops scoring directors and supervisors for future content roles. 4. Conducts interventions and coaches scoring directors as needed. 5. Completes Scoring Director Feedback Forms and provides timely feedback to scoring directors and scoring managers. 6. Works with scoring directors to create online training modules for assigned projects. 7. Reviews training sets and annotations and provides feedback to scoring directors. 8. Ensures proper documentation of, sign-off on, and archival of all scoring decisions and final training materials. 9. Guides scoring directors in completing project item evaluations (e.g., for field tests) and reviews them prior to submission to customers. 10. Monitors reports across grades and items to verify quality expectations are met and project completes on time. Works with scoring directors to address quality issues, and communicates plans / issues to content manager and project manager. 11. Obtains, analyzes, and reports on information concerning the strengths and weaknesses of scoring performance. Performs / participates in root-cause analysis, identifies inefficiencies, and recommends and implements improvements as necessary. 12. Attends all relevant project status and customer meetings and compiles appropriate reports on assigned activities as requested. 13. Functions as primary customer contact for oral and written communication involving content for assigned project. 14. Performs the role of scoring director when necessary. 15. May be asked to support new bids and proposals by analyzing customer requirements and providing insight on time and cost estimates for content-related activities. 16. May be asked to mentor or advise other projects' content specialists and / or scoring directors. 17. May be asked to review and edit work of other projects' content specialists and / or scoring directors. 18. May assist project manager in project-specific budget / cost estimate process. 19. Ensures that quality records are compiled and archived in accordance with Control of Records.

Working Conditions

Office environment that is safe and favorable to good working conditions. May work in warehouse conditions on occasion. Ability to travel and work evening and / or weekend shifts as necessary is required.