Talent.com
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierTempe, AZ, United States
14 hours ago
Job type
  • Full-time
  • Remote
Job description

Earn up to $15 / hour + performance bonuses. Work remotely and flexibly.

Outlier, a platform owned and operated by Scale AI, is looking for English speakers to contribute their expertise toward training and refining cutting-edge AI systems. If you're passionate about improving models and excited by the future of AI, this is your opportunity to make a real impact.

What You’ll Do

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Evaluate AI outputs by reviewing and ranking responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What We’re Looking For

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Have

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Pay & Logistics

  • Base Rate : Up to $15 / hour USD, depending on experience.
  • Bonuses : Additional pay available based on project performance.
  • Type : Freelance / 1099 contract — not an internship.
  • Location : 100% remote
  • Schedule : Flexible hours — you choose when and how much to work.
  • Payouts : Weekly via our secure platform.
  • This is a freelance position that is paid on a per-hour basis. We don’t offer internships as this is a freelance role. You also must be authorized to work in your country of residence, and we will not be providing sponsorship since this is a 1099 contract opportunity. However, if you are an international student, you may be able to sign up if you are on a visa. You should contact your tax / immigration advisor with specific questions regarding your circumstances. We are unable to provide any documentation supporting employment at this time. Please be advised that compensation rates may differ for non-US locations.

    Create a job alert for this search

    Evaluator • Tempe, AZ, United States

    Related jobs
    • Promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data AnnotationApache Junction, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
    • Promoted
    Senior AI Research Engineer

    Senior AI Research Engineer

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for a Senior AI Research Engineer.Key Responsibilities Architect, implement, and optimize large-scale post-training systems and data processing pipelines Lead the developmen...Show moreLast updated: 16 days ago
    • Promoted
    AI Agent Engineer

    AI Agent Engineer

    VirtualVocationsGlendale, Arizona, United States
    Full-time
    A company is looking for an AI Agent Engineer to design, deploy, and manage AI agents across its operations.Key Responsibilities Develop, deploy, and maintain AI agents to enhance enterprise work...Show moreLast updated: 1 day ago
    • Promoted
    AI Solutions Engineer

    AI Solutions Engineer

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for an AI Solutions Engineer - Remote.Key Responsibilities : Manage the full technical lifecycle of AI-driven solutions from prototype to production Assess and implement AI p...Show moreLast updated: 9 days ago
    • Promoted
    Staff AI Research Scientist

    Staff AI Research Scientist

    VirtualVocationsGilbert, Arizona, United States
    Full-time
    A company is looking for a Staff AI Research Scientist - Evaluation.Key Responsibilities Lead research teams to produce original methodologies for evaluating large language models (LLMs) Develop...Show moreLast updated: 2 days ago
    • Promoted
    Data Science Practitioner

    Data Science Practitioner

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for a Data Science Practitioner to join their team remotely.Key Responsibilities Design and implement innovative AI and machine learning models to enhance decision-making and...Show moreLast updated: 2 days ago
    • Promoted
    Transcription Quality Evaluator

    Transcription Quality Evaluator

    VirtualVocationsGilbert, Arizona, United States
    Full-time
    A company is looking for a transcription project evaluator.Key Responsibilities Evaluate the quality and accuracy of voiceovers, transcriptions, and translations in advertisement videos Assess a...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Gen AI Evaluation Analyst

    Gen AI Evaluation Analyst

    VirtualVocationsGilbert, Arizona, United States
    Full-time
    A company is looking for an English Language / Gen AI Specialist.Key Responsibilities : Evaluate outputs generated by LLMs across multiple modalities Assess quality against project-specific criteri...Show moreLast updated: 22 hours ago
    • Promoted
    Biology AI Trainer

    Biology AI Trainer

    VirtualVocationsPhoenix, Arizona, United States
    Full-time
    A company is looking for a Freelance Biology Expert - AI Trainer.Key Responsibilities Generate prompts that challenge AI Define comprehensive scoring criteria to evaluate the accuracy of the AI'...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    VirtualVocationsGlendale, Arizona, United States
    Full-time
    A company is looking for an AI Engineer to lead the development of scalable real-time applications utilizing AI / ML models. Key Responsibilities Understand customer challenges and integrate AI capa...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AI Technical Content Creator

    Senior AI Technical Content Creator

    VirtualVocationsChandler, Arizona, United States
    Full-time
    A company is looking for a Senior AI Technical Content Creator II.Key Responsibilities Create articles and complex tutorials on AI for developers Stay updated on AI developments and generate con...Show moreLast updated: 2 days ago
    • Promoted
    Remote Financial Planner - AI Trainer

    Remote Financial Planner - AI Trainer

    Data AnnotationApache Junction, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationGilbert, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
    • Promoted
    AI Delivery Developer

    AI Delivery Developer

    VirtualVocationsGlendale, Arizona, United States
    Full-time
    A company is looking for an AI Delivery Developer / Engineer.Key Responsibilities Develop automation and AI models Integrate AI tools into existing systems Support full-stack development for AI a...Show moreLast updated: 1 day ago
    • Promoted
    Remote Finance Director - AI Trainer

    Remote Finance Director - AI Trainer

    Data AnnotationMaricopa, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
    • Promoted
    Senior AI Observability Engineer

    Senior AI Observability Engineer

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for a Senior AI Observability Engineer to lead the observability strategy for AI / ML systems and features. Key Responsibilities Lead end-to-end observability design for AI / ML f...Show moreLast updated: 30+ days ago
    • Promoted
    AI Enablement Engineer

    AI Enablement Engineer

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for an AI Enablement Engineer.Key Responsibilities Identify and scope high-impact use cases for productivity improvement using advanced AI technologies Deploy and configure ...Show moreLast updated: 13 days ago
    • Promoted
    Conversational AI Product Manager

    Conversational AI Product Manager

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for a Conversation AI Product Manager to lead their Conversational AI strategy for Lending and Servicing. Key Responsibilities Define and articulate the conversational AI prod...Show moreLast updated: 1 day ago
    • Promoted
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data AnnotationGoodyear, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
    • Promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data AnnotationAvondale, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago