Data Scientist (Remote Part-Time | $100 –$120 / hr)

Data Scientist (Remote Part-Time | $100–$120 / hr)

Work with Mercor, partnering with a leading AI research lab to conduct AI task evaluation and statistical analysis. This is a part-time, hourly contract position based at 20–25 hours per week, remote and asynchronous, starting immediately.

About the Role

As an AI Task Evaluation & Statistical Analysis Specialist, you will perform comprehensive failure analysis on AI agent performance across finance‑sector tasks, identify systemic patterns, diagnose bottlenecks, and improve evaluation frameworks.

Key Responsibilities

• Statistical Failure Analysis : Identify recurring patterns in AI agent failures across task components (prompts, rubrics, file types, tags, etc.).
• Root Cause Analysis : Determine whether issues stem from task design, rubric clarity, file complexity, or agent limitations.
• Dimensional Analysis : Examine performance variations across finance sub‑domains, file structures, and evaluation criteria.
• Visualization & Reporting : Build dashboards and analytical reports that highlight edge cases, performance clusters, and improvement opportunities.
• Framework Enhancement : Recommend refinements to rubric design, evaluation metrics, and task structures based on empirical findings.
• Stakeholder Communication : Present key insights to data labeling teams, ML engineers, and research collaborators.

Required Qualifications

Preferred Qualifications

More About the Opportunity

Compensation & Contract Terms

Seniority Level

Mid‑Senior level

Employment Type

Part-time

Job Function

Engineering, Information Technology, and Finance

#J-18808-Ljbffr