Talent.com
Freelance Agent Evaluation Engineer
Freelance Agent Evaluation EngineerMindrift • Houston, TX, US
No longer accepting applications
Freelance Agent Evaluation Engineer

Freelance Agent Evaluation Engineer

Mindrift • Houston, TX, US
30+ days ago
Job type
  • Part-time
  • Permanent
  • Remote
  • Quick Apply
Job description

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation isproject-based, not permanent employment.

What this opportunity involves

You’ll create challenging coding test cases that push AI coding systems to their limits:

  • Review and refine realistic coding tasks based on provided production codebases with realistic scope, requirements and information sources
  • Write comprehensive functional tests that validate actual end-to-end behavior and edge-cases, not just superficial checks
  • Craft “fair but hard” challenges where the AI has all the context it needs, but has to work for it (information scattered across files and external sources, complex reasoning required)
  • Analyze AI failures to understand what the model struggles with vs. what it masters
  • Iterate based on feedback from expert QA reviewers who score your work on 7 quality criteria

What we look for

This opportunity is a good fit for experienced developers, software engineers, and/or test automation specialists open to part-time, non-permanent projects. Ideally, contributors will have:

  • Degree in Computer Science, Software Engineering or related fields
  • 5+ years in software development, primarily Python (pytest, async/await, subprocess, file operations)
  • Background in Full-Stack development, with an equal focus on building React-based interfaces and robust Back-end systems
  • Experience writing tests (functional, integration – not just running them)
  • Docker containers (running evaluations locally in containers)
  • CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
  • English proficiency - B2

How it works

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Effort estimate

Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Payment

  • Paid contributions, with rates up to $80/hour*
  • Fixed project rate or individual rates, depending on the project
  • Some projects include incentive payments

*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.

Create a job alert for this search

Freelance Agent Evaluation Engineer • Houston, TX, US

Similar jobs

Nondestructive Evaluation (NDE) Engineer

Bastion TechnologiesHouston, TX, USA
Full-time +1
Quick Apply

Nondestructive Evaluation (NDE) Engineer.This position serves as a senior-level nondestructive evaluation (NDE) and materials engineer.The Engineer will specialize in some of the NDE methods, such ...Show more

Sr. Market Development Engineer

Kuraray AmericaPasadena, TX, USA
Full-time
Quick Apply

Voted one of the Nation's Best and Brightest Companies to Work for, Kuraray America, Inc.With top-of-the-line research and production facilities and a vast network of supplies from around the world...Show more

Automotive Luxury Brand Evaluator - Houston, TX

CXGHouston, TX, US
Full-time
Quick Apply

Do you have a refined appreciation for high-end performance vehicles and the customer experience that surrounds them? Are you familiar with the standards, service, and atmosphere expected in luxury...Show more

Customs Compliance Engineer(A Group MLB._.SCM)-Houston,TX

FoxconnHouston, TX, United States
Full-time

Ensure compliant and efficient U.Overseeing quotation and cost control.Managing bonded inventory for OEM processes.Classify products using HS codes.Process equipment import/export clearance.Manage ...Show more

 • Promoted

AI Enablement Engineer

Perry HomesHouston, TX, US
Full-time
Quick Apply

The AI Enablement Engineer serves as a force multiplier for the Software Development organization and, over time, IT as a whole.Using discretion and independent judgment, this engineer builds AI de...Show more

Associate Engineer

Element Materials TechnologyHouston, Texas, United States
Full-time

Element has an opportunity for an.As a member of the operations team, the Engineer position performs a variety of routine and non-routine testing assignments within the department assigned and insu...Show more

 • Promoted • New!

Solutions Engineer, Remote

Aperia TechnologiesHouston, TX, United States
Remote
Full-time

Aperia is unlocking a new era of efficiency and sustainability for commercial vehicle fleets, by developing innovative hardware and data analytics solutions.Inventors of the award- winning and disr...Show more

 • Promoted

Nondestructive Evaluation (NDE) Engineer

Mclaurin AerospaceHouston, TX, USA
Full-time
Quick Apply

Are you passionate about human space exploration, understanding the origins of the universe, and working with a passionate and diverse team to make a difference? If you are, we need you!.We need yo...Show more

Supplier Quality Engineer

LivaNovaHouston, Texas, United States
Full-time

As a global medtech company, we are driven by our Vision of changing the trajectory of lives for a new day and our Mission to create ingenious solutions that ignite patient turnarounds.Our relentle...Show more

 • Promoted

QA Engineer

SkillHouston, Texas, United States
Temporary

We are partnering with a leading organization in the energy sector, committed to delivering essential services and innovative solutions that power communities.This forward-thinking company is dedic...Show more

 • Promoted

AI-Native Engineering Lead for Enterprise Agents

AccentureHouston, TX, United States
Full-time

A leading services firm in Houston is seeking an experienced AI Native Engineer to design and deploy innovative solutions for enterprise clients.The ideal candidate will have at least 3 years of ex...Show more

 • Promoted

Freelance English Writer - AI Trainer

MindriftHouston, TX, US
Remote
Part-time +1
Quick Apply

Please submit your resume in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing,...Show more

Supplier Quality Engineer (A Group QA)-Houston,TX

Q-Edge Corporation, FoxconnHouston, TX, US
Full-time
Quick Apply

Purpose of the position Supplier Quality Development & Auditing Supplier Corrective Actions & Issue Resolution Incoming Material Quality Control Duties and Responsibilities 1.Supplier Quality Devel...Show more

Become a Luxury Brand Evaluator in Texas, TX

CXGHouston, TX, United States
Full-time

Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.Join CXG, the global leader in custo...Show more

 • Promoted

Freelance Annotator (English) - AI Trainer

Toloka AnnotatorsHouston, TX, US
Remote
Part-time
Quick Apply

Please submit your resume in English and indicate your level of English.The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators.Our mission is to unlock ...Show more

Project Engineer

TradeJobsWorkForce77053 Houston, TX, US
Full-time

Project Engineer Job Duties: Completes engineering projects by organizing and controlling project elements.Develops project objectives by reviewing project proposals and plans and conferring with m...Show more

 • Promoted

SCADA Engineer, Advisor

ENGIE North America Inc.Houston, Texas, United States
Full-time

As a SCADA Engineer, Advisor in Houston, you will play a key role in supporting the systems that keep ENGIE's renewable generation assets operating safely and efficiently across North America.You w...Show more

 • Promoted

EMI/EMC Analysis, Design, and Test Engineer – Space Exploration Avionics Systems

MRI TechnologiesHouston, TX, USA
Permanent
Quick Apply

MRI Technologies has an exciting opportunity for an EMI/EMC Analysis, Design, and Test Engineer on the JETS II contract at NASA Johnson Space Center.In this role, you will plan, execute, and analyz...Show more