Talent.com
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)Mercor • Grand Rapids, Michigan, US
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Mercor • Grand Rapids, Michigan, US
Hace 6 días
Tipo de contrato
  • A tiempo completo
  • Teletrabajo
Descripción del trabajo

##

  • 1\. Role Overview

Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge across diverse fields to design extremely challenging prompts that cannot be solved by existing AI systems without internet search or browsing capabilities. The goal is to create a benchmark dataset that pushes the limits of current AI reasoning and retrieval. This is a short-term research engagement with significant impact on AI evaluation. ##

  • 2\. Key Responsibilities
  • Create original, expert-level prompts that require tool use (e.g., search, browse, or code execution). - Ensure prompts are objective, self-contained, and yield clear, unambiguous answers. - Test prompts against advanced AI models and document failures / successes. - Provide reasoning steps and solutions for each prompt. - Classify prompts into subject domains for dataset organization. - Collaborate with reviewers for expert validation and prompt refinement. ##
  • 3\. Ideal Qualifications
  • Advanced academic or professional expertise in a specialized subject (STEM, law, finance, history, cultural studies, etc.). - Strong ability to design precise, high-difficulty questions requiring deep knowledge and external references. - Experience in academic research, benchmarking, or test question design preferred. - Attention to detail and ability to provide concise reasoning explanations. - Familiarity with AI models and their limitations is a plus. ##
  • 4\. More About the Opportunity
  • Remote and asynchronous — set your own hours. - Expected commitment : ~10–20 hours / week. - Project duration : ~2 months, with possible extensions based on dataset needs. - Opportunity to contribute to high-impact AI safety and evaluation research. ##
  • 5\. Compensation & Contract Terms
  • Competitive hourly compensation based on expertise. - Independent contractor engagement. - Payments for services rendered processed weekly via Stripe Connect. ##
  • 6\. Application Process
  • Submit your resume or CV highlighting your subject matter expertise. - Complete a brief questionnaire about your background and areas of specialization. - Selected applicants may be asked to draft a short test prompt. - You’ll receive follow-up within a few days regarding next steps. ##
  • 7\. About Mercor
  • Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations. - Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey. - Thousands of professionals across domains like law, creatives, engineering, and research have joined Mercor to work on frontier projects shaping the next era of AI.
  • Crear una alerta de empleo para esta búsqueda

    Curator • Grand Rapids, Michigan, US

    Ofertas relacionadas
    Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

    Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

    Mercor • Wyoming, Michigan, US
    Teletrabajo
    A tiempo completo
    Role Overview • • Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge a...Mostrar más
    Última actualización: hace 6 días • Oferta promocionada
    Restaurant Delivery - Be Your Own Boss

    Restaurant Delivery - Be Your Own Boss

    DoorDash • Newaygo, MI, United States
    A tiempo completo +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Registered Nurse ( RN ) - Behavorial Health Unit

    Registered Nurse ( RN ) - Behavorial Health Unit

    Trinity Health Michigan • Bailey, MI, US
    A tiempo completo
    Great opportunity for a Registered Nurse, RN professional to work in an organization that focuses on treating the whole person, physically, emotionally and spiritually! •What you will do : • Registe...Mostrar más
    Última actualización: hace 1 día • Oferta promocionada
    Remote Research Contributor (Hiring Immediately)

    Remote Research Contributor (Hiring Immediately)

    Maxion Research • Belmont, Michigan, US
    Teletrabajo
    A tiempo parcial
    Join Our Part-Time Research Studies Today!.Are you eager to earn extra income from the comfort of your home? We are looking for motivated individuals to participate in paid research studies includi...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Remote AI Data Reviewer

    Remote AI Data Reviewer

    VirtualVocations • Grand Rapids, Michigan, United States
    Teletrabajo
    A tiempo completo
    A company is looking for a Remote AI Data Reviewer (No Experience Needed).Key Responsibilities Review, evaluate, and label content according to detailed guidelines Maintain accuracy and quality ...Mostrar más
    Última actualización: hace 13 horas • Oferta promocionada • Nueva oferta
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPA • Solon township, Michigan, us
    Teletrabajo
    A tiempo parcial +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Test Products from Home – $25-$45 / hr + Freebies

    Test Products from Home – $25-$45 / hr + Freebies

    OCPA • Solon township, Michigan, us
    A tiempo parcial +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Travel Nurse RN - Psych - $2,053 to $2,100 per week in Kent, MI

    Travel Nurse RN - Psych - $2,053 to $2,100 per week in Kent, MI

    TravelNurseSource • Kent, MI, US
    A tiempo completo
    TravelNurseSource is working with MUVE Healthcare LLC to find a qualified Psych RN in Kent, Michigan, 49548!.Join our team for an exciting travel nursing opportunity!. As a member of the interdiscip...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Conversational AI Engineer

    Conversational AI Engineer

    VirtualVocations • Grand Rapids, Michigan, United States
    A tiempo completo
    Engineer - Conversational AI & Front-End (Contract-to-Hire).Key Responsibilities Develop conversational bots using platforms like ServiceNow Virtual Agent, Microsoft Copilot, and Genesys Cloud CX...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    AI Trainer -Remote Content Reviewer

    AI Trainer -Remote Content Reviewer

    Outlier • Walker, MI, United States
    Teletrabajo
    A tiempo completo
    Earn up to $16 USD / hourly and work remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the future of ...Mostrar más
    Última actualización: hace 8 días • Oferta promocionada
    Aesthetic Expert- Cosmetic Nurse Injector

    Aesthetic Expert- Cosmetic Nurse Injector

    United Aesthetics Alliance • Byron Center, MI, US
    A tiempo completo
    The Bengtson Center for Aesthetics and Plastic Surgery.New Location in Byron Center, MI.The Bengtson Center is one of the most sought after aesthetic medical destinations in the country.The Bengtso...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPA • Solon township, Michigan, us
    Teletrabajo
    A tiempo parcial +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Online Survey Taker. Earn up to $25 per survey. - Remote (Byron Center)

    Online Survey Taker. Earn up to $25 per survey. - Remote (Byron Center)

    Earn Haus • Byron Center, MI, US
    Teletrabajo
    A tiempo completo +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Mostrar más
    Última actualización: hace 20 horas • Oferta promocionada • Nueva oferta
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Kentwood, Michigan
    Teletrabajo
    A tiempo completo +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más
    Última actualización: hace 29 días • Oferta promocionada
    Statistician AI Trainer

    Statistician AI Trainer

    VirtualVocations • Grand Rapids, Michigan, United States
    A tiempo completo
    A company is looking for a Statistician with Python - Freelance AI Trainer.Key Responsibilities Generate prompts that challenge AI Define comprehensive scoring criteria to evaluate the accuracy ...Mostrar más
    Última actualización: hace 3 días • Oferta promocionada
    Registered Nurse ( RN ) Medical Surgical Unit - $11,000 Sign on Bonus

    Registered Nurse ( RN ) Medical Surgical Unit - $11,000 Sign on Bonus

    Trinity Health Michigan • Bailey, MI, US
    A tiempo completo
    Registered Nurse ( RN ) Medical Surgical Unit - $11,000 Sign on Bonus 72hrs per pp 7p-7 : 30a - weekends and holidays to be scheduled in accordance with CBA. Great opportunity for a Registered Nurse, ...Mostrar más
    Última actualización: hace 13 horas • Oferta promocionada • Nueva oferta
    Travel Licensed Clinical Social Worker (LCSW) - $1,912 to $2,216 per week in Byron Center, MI

    Travel Licensed Clinical Social Worker (LCSW) - $1,912 to $2,216 per week in Byron Center, MI

    AlliedTravelCareers • Byron Center, MI, US
    A tiempo completo +1
    AlliedTravelCareers is working with Aya Healthcare to find a qualified Licensed Clinical Social Worker in Byron Center, Michigan, 49315!. Aya Education has an immediate opening for the following pos...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Telemedicine Physician

    Telemedicine Physician

    QuickMD • Dorr, MI, US
    A tiempo completo
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada