Talent.com
Evaluation Scenario Writer
Evaluation Scenario WriterVirtualVocations • Astoria, New York, United States
Evaluation Scenario Writer

Evaluation Scenario Writer

VirtualVocations • Astoria, New York, United States
15 hours ago
Job type
  • Full-time
Job description

A company is looking for an Evaluation Scenario Writer - QA.

Key Responsibilities

Reviewing and validating test scenarios from Evaluation Writers

Spotting logical inconsistencies, ambiguities, or missing checks

Collaborating with infrastructure and tool developers to automate parts of the review

Required Qualifications

Strong QA background (manual or automation) in complex testing environments

Understanding of test design, regression testing, and edge case detection

Experience reviewing and debugging structured test case formats (JSON, YAML)

Familiarity with Python and JS scripting for test automation or validation

Experience testing AI-based systems or NLP applications is preferred

Create a job alert for this search

Evaluation • Astoria, New York, United States

Related jobs
K-12 ELA Content Writer

K-12 ELA Content Writer

VirtualVocations • Newark, New Jersey, United States
Full-time
A company is looking for an ELA Content Writer - Assessment Focus (Freelance).Key Responsibilities Research informational topics for a school-aged audience Source and write passages for online a...Show more
Last updated: 3 days ago • Promoted
Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • New Brunswick, New Jersey
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Content Strategist and Writer

Content Strategist and Writer

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for a Content Strategist & Writer.Key Responsibilities Strategize and coach senior leaders to enhance communication effectiveness Oversee the writing and editing process, co...Show more
Last updated: 30+ days ago • Promoted
Workday Adaptive Planning Lead

Workday Adaptive Planning Lead

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for a Workday FIN - Adaptive Planning Lead to manage the implementation of financial planning solutions in the higher education sector. Key Responsibilities Lead a team in imp...Show more
Last updated: 2 days ago • Promoted
Curriculum Writer, ELD (Contract)

Curriculum Writer, ELD (Contract)

Amplify • Brooklyn, NY, United States
Full-time
A pioneer in K-12 education since 2000, Amplify is leading the way in next-generation curriculum and assessment.Our core and supplemental programs in ELA, math, and science engage all students in r...Show more
Last updated: 30+ days ago • Promoted
Spanish Speaker for AI Evaluation

Spanish Speaker for AI Evaluation

VirtualVocations • Jamaica, New York, United States
Full-time
A company is looking for a Spanish Speaker to test voice modes of AI models.Key Responsibilities Engage with AI using voice mode on a mobile app, following a predefined prompt to achieve conversa...Show more
Last updated: 2 days ago • Promoted
Evaluation Scenario Writer

Evaluation Scenario Writer

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for an Evaluation Scenario Writer - QA.Key Responsibilities Reviewing and validating test scenarios from Evaluation Writers Spotting logical inconsistencies, ambiguities, or...Show more
Last updated: 15 hours ago • Promoted • New!
Early Modern Literature and its Global Legacy Tenure Track Position - Fall 2026

Early Modern Literature and its Global Legacy Tenure Track Position - Fall 2026

InsideHigherEd • Bronxville, New York, United States
Full-time
Early Modern Literature and its Global Legacy Tenure Track Position - Fall 2026.The Literature Department at Sarah Lawrence College invites applications for a full-time, tenure-track faculty positi...Show more
Last updated: 2 days ago • Promoted
KCS Coach Lead and Technical Writer

KCS Coach Lead and Technical Writer

VirtualVocations • Jamaica, New York, United States
Full-time
A company is looking for a KCS Coach Lead & Technical Writer (Remote).Key Responsibilities Lead the KCS coaching program by training and mentoring internal teams on KCS principles Collaborate wi...Show more
Last updated: 4 days ago • Promoted
Temporary Content Writer

Temporary Content Writer

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for a Content Writer for a temporary assignment covering maternity leave.Key Responsibilities Produce high-quality blog posts, website copy, and occasional social media conte...Show more
Last updated: 4 days ago • Promoted
Senior Regulatory Writer

Senior Regulatory Writer

Novartis Group Companies • East Hanover, NJ, United States
Full-time
Title : Senior Regulatory Writer, Remote.This position can be based remotely anywhere in the U.Please note that this role would not provide. The expectation of working hours and travel will be defin...Show more
Last updated: 5 days ago • Promoted
QA Evaluation Scenario Writer

QA Evaluation Scenario Writer

VirtualVocations • Jackson Heights, New York, United States
Full-time
A company is looking for an Evaluation Scenario Writer - QA.Key Responsibilities Reviewing and validating test scenarios from Evaluation Writers Spotting logical inconsistencies, ambiguities, or...Show more
Last updated: 27 days ago • Promoted
Curriculum Tech Writer

Curriculum Tech Writer

VirtualVocations • Jackson Heights, New York, United States
Part-time
A company is looking for a Part Time Curriculum Tech Writer.Key Responsibilities Research content for courses and design fully accessible course deliverables Contribute to all phases of the deve...Show more
Last updated: 2 days ago • Promoted
Course Curriculum Writer

Course Curriculum Writer

VirtualVocations • Elizabeth, New Jersey, United States
Full-time
A company is looking for a Course Curriculum Writer to create a course addressing Indigenous People Discrimination in Canada. Key Responsibilities Develop and manage course content focused on Indi...Show more
Last updated: 1 hour ago • Promoted • New!
Japanese Voice AI Evaluator

Japanese Voice AI Evaluator

VirtualVocations • Paterson, New Jersey, United States
Full-time
A company is looking for Japanese Speakers to test voice modes of AI models.Key Responsibilities Engage with AI using voice mode on a mobile app, following a predefined prompt to achieve conversa...Show more
Last updated: 2 days ago • Promoted
Spanish AI Voice Evaluator

Spanish AI Voice Evaluator

VirtualVocations • Yonkers, New York, United States
Full-time
A company is looking for Spanish Speakers to test voice modes of AI models.Key Responsibilities Engage in conversations with AI using voice mode and predefined prompts Rate the interaction on a ...Show more
Last updated: 2 days ago • Promoted
Workday Certified Planning Lead

Workday Certified Planning Lead

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for a Workday FIN - Adaptive Planning Lead to oversee the implementation of Workday financial solutions in higher education. Key Responsibilities Lead a team in implementing W...Show more
Last updated: 2 days ago • Promoted
Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • New Brunswick, New Jersey
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Psychiatric Evaluations

Psychiatric Evaluations

Apex Therapeutic Services • Hicksville, NY, US
Full-time
Our mental health center is seeking a qualified individual for the position of Psychiatric Evaluations.In this role, you will be responsible for performing comprehensive psychiatric evaluations of ...Show more
Last updated: 30+ days ago • Promoted
Taxonomy and Content Analyst

Taxonomy and Content Analyst

VirtualVocations • Elizabeth, New Jersey, United States
Full-time
A company is looking for a Taxonomy and Content Curation Analyst to provide expertise in taxonomy and content curation for enterprise information management. Key Responsibilities Assess existing c...Show more
Last updated: 4 days ago • Promoted