Talent.com
Remote Text Quality Evaluator
Remote Text Quality EvaluatorOutlier • Philadelphia, PA, United States
Remote Text Quality Evaluator

Remote Text Quality Evaluator

Outlier • Philadelphia, PA, United States
1 day ago
Job type
  • Full-time
  • Remote
Job description

Earn up to $15 / hour + performance bonuses. Work remotely and flexibly.

Outlier, a platform owned and operated by Scale AI, is looking for English speakers to contribute their expertise toward training and refining cutting-edge AI systems. If you're passionate about improving models and excited by the future of AI, this is your opportunity to make a real impact.

What You’ll Do

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Evaluate AI outputs by reviewing and ranking responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What We’re Looking For

  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Have

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Pay & Logistics

  • Base Rate : Up to $15 / hour USD, depending on experience.
  • Bonuses : Additional pay available based on project performance.
  • Type : Freelance / 1099 contract — not an internship.
  • Location : 100% remote
  • Schedule : Flexible hours — you choose when and how much to work.
  • Payouts : Weekly via our secure platform.
  • This is a freelance position that is paid on a per-hour basis. We don’t offer internships as this is a freelance role. You also must be authorized to work in your country of residence, and we will not be providing sponsorship since this is a 1099 contract opportunity. However, if you are an international student, you may be able to sign up if you are on a visa. You should contact your tax / immigration advisor with specific questions regarding your circumstances. We are unable to provide any documentation supporting employment at this time. Please be advised that compensation rates may differ for non-US locations.

    Create a job alert for this search

    Evaluator • Philadelphia, PA, United States

    Related jobs
    Audio Generalist Evaluator Expert

    Audio Generalist Evaluator Expert

    Mercor • Philadelphia, Pennsylvania, US
    Remote
    Full-time
    Mercor is seeking detail-oriented writing experts to contribute to a high-impact audio AI research project with a leading lab. Freelancers will author prompt–golden answer pairs that train and evalu...Show more
    Last updated: 16 hours ago • Promoted • New!
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPA • Pitman, New Jersey, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Director- Integrated Data Quality

    Director- Integrated Data Quality

    Philadelphia Staffing • Philadelphia, PA, US
    Full-time
    Reference # : 11157 Working with us takes a certain kind of person; we want someone who identifies with our values and is willing to challenge themselves both personally and professionally.We seek e...Show more
    Last updated: 5 days ago • Promoted
    Large-Scale Text Analyst - 95482

    Large-Scale Text Analyst - 95482

    Swoon • Philadelphia, PA, US
    Full-time
    I'm working with a scientific publisher and data analytics company that provides tools and services to support researchers, looking to add a Large Scale Text Analyst to their team!.Location : Re...Show more
    Last updated: 8 days ago • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    Outlier • Philadelphia, PA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    Staff Applied Scientist

    Staff Applied Scientist

    Relativity • Philadelphia, PA, United States
    Full-time
    At Relativity, we're building a world-class Applied Science team to push the boundaries of intelligent systems in the legal domain. We're looking for a Staff Applied Scientist to join our team.Agent...Show more
    Last updated: 30+ days ago • Promoted
    Remote Product Tester - $25-45 per hour

    Remote Product Tester - $25-45 per hour

    Online Consumer Panels America • Philadelphia, Pennsylvania, US
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Work-From-Home Online Product Tester - $45 per hour

    Work-From-Home Online Product Tester - $45 per hour

    Online Consumer Panels America • Camden, New Jersey, US
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Expert Prompt Curators for Advanced AI Evaluation Dataset

    Expert Prompt Curators for Advanced AI Evaluation Dataset

    Mercor • Camden, New Jersey, US
    Remote
    Full-time
    Role Overview • • Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge a...Show more
    Last updated: 16 hours ago • Promoted • New!
    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Philadelphia, Pennsylvania
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
    Last updated: 30+ days ago • Promoted
    Work From Home -Remote Text Quality Evaluator

    Work From Home -Remote Text Quality Evaluator

    Outlier • Philadelphia, PA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    AI Trainer -Remote Writing Evaluator

    AI Trainer -Remote Writing Evaluator

    Outlier • Philadelphia, PA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    Quality Improvement Specialist

    Quality Improvement Specialist

    Pacer Group • Philadelphia, PA, US
    Full-time
    Hybrid – 3 days onsite, 2 days remote.AM – 5 : 30 PM EST, Monday–Friday (some weekends may be required).The HEDIS Data Reviewer supports quality reporting by reviewing and abstracti...Show more
    Last updated: 25 days ago • Promoted
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • Williamstown, New Jersey, US
    Remote
    Temporary
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...Show more
    Last updated: 30+ days ago • Promoted
    AI Trainer -Remote Text Quality Evaluator

    AI Trainer -Remote Text Quality Evaluator

    Outlier • Philadelphia, PA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    Data Entry-Remote

    Data Entry-Remote

    Altec Industries, Inc. • Philadelphia, PA, US
    Remote
    Full-time
    The Data Entry Specialist and QC personnel facilitate the production process of accurate documentation provided to our process servers teams. As a Data Entry Specialist you will review and confirm w...Show more
    Last updated: 1 day ago • Promoted
    Senior / Staff Code Review Experts

    Senior / Staff Code Review Experts

    Mercor • Philadelphia, Pennsylvania, US
    Remote
    Full-time
    Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp expe...Show more
    Last updated: 16 hours ago • Promoted • New!
    Senior Specialist, Quality Control Lab Technical Support Analytical

    Senior Specialist, Quality Control Lab Technical Support Analytical

    Iovance Biotherapeutics • Philadelphia, Pennsylvania, USA
    Full-time
    Iovance Biotherapeutics is a growing late-stage company focused on the development and commercialization of novel cancer immunotherapies. TheSenior Quality Control Analyst Lab Technical Support-Anal...Show more
    Last updated: 5 days ago • Promoted