Talent.com
Evaluation Scenario Writer
Evaluation Scenario WriterVirtualVocations • Flushing, New York, United States
Evaluation Scenario Writer

Evaluation Scenario Writer

VirtualVocations • Flushing, New York, United States
1 day ago
Job type
  • Full-time
Job description

A company is looking for an Evaluation Scenario Writer - QA.

Key Responsibilities

Reviewing and validating test scenarios from Evaluation Writers

Spotting logical inconsistencies, ambiguities, or missing checks

Collaborating with infrastructure and tool developers to automate parts of the review

Required Qualifications

Strong QA background (manual or automation) in complex testing environments

Understanding of test design, regression testing, and edge case detection

Experience reviewing and debugging structured test case formats (JSON, YAML)

Familiarity with Python and JS scripting for test automation or validation

Experience testing AI-based systems or NLP applications is preferred

Create a job alert for this search

Evaluation • Flushing, New York, United States

Related jobs
Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • White Plains, New York
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Certification Exam Item Writer

Certification Exam Item Writer

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for a Corporate Certifications / Exam Writer.Key Responsibilities Write items specifically for corporate certification exams, ensuring alignment with best practices Create com...Show more
Last updated: 12 hours ago • Promoted • New!
Content Writer

Content Writer

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for a Content Writer to support its content needs.Key Responsibilities Support content production by publishing and updating articles / pages on the blog and website Ensure al...Show more
Last updated: 30+ days ago • Promoted
Scientific Content Coordinator

Scientific Content Coordinator

VirtualVocations • Jamaica, New York, United States
Full-time
A company is looking for a Scientific Content Coordinator.Key Responsibilities Research, purchase, catalog, and distribute reference materials and publications Update editorial databases and edu...Show more
Last updated: 4 days ago • Promoted
Curriculum Writer, ELD (Contract)

Curriculum Writer, ELD (Contract)

Amplify • Brooklyn, NY, United States
Full-time
A pioneer in K-12 education since 2000, Amplify is leading the way in next-generation curriculum and assessment.Our core and supplemental programs in ELA, math, and science engage all students in r...Show more
Last updated: 30+ days ago • Promoted
Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Norwalk, Connecticut
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Data Annotation • Norwalk, Connecticut
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Travel Board Certified Behavioral Analyst (BCBA)

Travel Board Certified Behavioral Analyst (BCBA)

Princeton Staffing Solutions • Norwalk, CT, US
Full-time +1
Princeton Staffing Solutions is seeking a travel Board Certified Behavioral Analyst (BCBA) for a travel job in Norwalk, Connecticut. Job Description & Requirements.Board Certified Behavioral Ana...Show more
Last updated: 30+ days ago • Promoted
QA Evaluation Scenario Writer

QA Evaluation Scenario Writer

VirtualVocations • Yonkers, New York, United States
Full-time
A company is looking for an Evaluation Scenario Writer - QA.Key Responsibilities Reviewing and validating test scenarios from Evaluation Writers Spotting logical inconsistencies, ambiguities, or...Show more
Last updated: 28 days ago • Promoted
K-12 ELA Content Writer

K-12 ELA Content Writer

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for an ELA Content Writer - Assessment Focus (Freelance).Key Responsibilities Research informational topics for a school-aged audience Source and write passages for online a...Show more
Last updated: 4 days ago • Promoted
Spanish AI Voice Evaluator

Spanish AI Voice Evaluator

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for Spanish Speakers to test voice modes of AI models.Key Responsibilities Engage in conversations with AI using voice mode and predefined prompts Rate the interaction on a ...Show more
Last updated: 3 days ago • Promoted
Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • White Plains, New York
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 5 days ago • Promoted
Evaluation Scenario Writer

Evaluation Scenario Writer

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for an Evaluation Scenario Writer - QA.Key Responsibilities Reviewing and validating test scenarios from Evaluation Writers Spotting logical inconsistencies, ambiguities, or...Show more
Last updated: 1 day ago • Promoted
Taxonomy and Content Analyst

Taxonomy and Content Analyst

VirtualVocations • Yonkers, New York, United States
Full-time
A company is looking for a Taxonomy and Content Curation Analyst to provide expertise in taxonomy and content curation for enterprise information management. Key Responsibilities Assess existing c...Show more
Last updated: 4 days ago • Promoted
Grant Writer

Grant Writer

VirtualVocations • Flushing, New York, United States
Full-time
A company is looking for a Social Justice Grant Writer to research funding opportunities and write grant proposals.Key Responsibilities Write and submit concise and persuasive grant proposals and...Show more
Last updated: 13 days ago • Promoted
Manager, Content Analytics

Manager, Content Analytics

Amazon.com • Clifton, NJ, USA
Full-time
At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...Show more
Last updated: 8 days ago • Promoted
Curriculum Tech Writer

Curriculum Tech Writer

VirtualVocations • Yonkers, New York, United States
Part-time
A company is looking for a Part Time Curriculum Tech Writer.Key Responsibilities Research content for courses and design fully accessible course deliverables Contribute to all phases of the deve...Show more
Last updated: 3 days ago • Promoted
Content Strategist and Writer

Content Strategist and Writer

VirtualVocations • Yonkers, New York, United States
Full-time
A company is looking for a Content Strategist & Writer.Key Responsibilities Strategize and coach senior leaders to enhance communication effectiveness Oversee the writing and editing process, co...Show more
Last updated: 30+ days ago • Promoted
Manager of Proposal Writing

Manager of Proposal Writing

VirtualVocations • Bronx, New York, United States
Full-time
A company is looking for a Manager, Proposal Writing to lead their proposal development function in the public safety technology sector. Key Responsibilities Lead and manage a team of proposal wri...Show more
Last updated: 30+ days ago • Promoted
Japanese Voice AI Evaluator

Japanese Voice AI Evaluator

VirtualVocations • Yonkers, New York, United States
Full-time
A company is looking for Japanese Speakers to test voice modes of AI models.Key Responsibilities Engage with AI using voice mode on a mobile app, following a predefined prompt to achieve conversa...Show more
Last updated: 3 days ago • Promoted