Talent.com
Evaluator/Reviewer - Statistical Assistants
Evaluator/Reviewer - Statistical AssistantsSepal • San Francisco, CA, United States
No longer accepting applications
Evaluator / Reviewer - Statistical Assistants

Evaluator / Reviewer - Statistical Assistants

Sepal • San Francisco, CA, United States
23 days ago
Job type
  • Full-time
  • Part-time
Job description

Role Overview

The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.

Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.

Key Responsibilities

  • Review submissions requiring professional or technical domain knowledge
  • Validate factual accuracy, terminology, and real-world applicability within the domain
  • Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance
  • Evaluate alignment with professional standards, norms, and best practices
  • Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts
  • Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise
  • Identify high-risk errors related to safety, ethics, or misuse
  • Escalate ambiguous or high-impact issues appropriately
  • Maintain clear documentation of review decisions and reasoning

Required Qualifications

  • Advanced degree, professional certification, or equivalent experience in the relevant occupation or field
  • 5+ years of professional experience practicing in that domain
  • Demonstrated experience with :
  • Evaluation, review, auditing, or supervisory responsibilities OR

    Teaching, mentoring, training, or assessing professional work

  • Strong understanding of professional boundaries, risk, and compliance considerations
  • Excellent written communication skills suitable for formal feedback
  • Preferred Qualifications

  • Prior experience reviewing AI-generated or training data content
  • Familiarity with compliance, regulatory, or ethical standards in the field
  • Experience translating expert knowledge into clear, structured explanations
  • Comfort working with evolving guidelines and iterative feedback cycles
  • Key Competencies

  • Subject matter expertise
  • Risk awareness and safety judgment
  • Guideline fidelity
  • Clear, corrective feedback
  • Professional integrity
  • Expectations

  • Strict adherence to confidentiality and data protection requirements
  • Consistent application of guidelines across all reviews
  • Willingness to update evaluation approach as standards evolve
  • Professional, unbiased, and respectful communication at all times
  • Compensation & Logistics

  • $50 to $75 per hour, depending on expertise and relevance, with bonuses for key contributions
  • Begins with a paid trial period
  • Paid every two weeks based on approved and tracked hours
  • Fully remote and async friendly, work at your own pace within flexible deadlines
  • Employment type : Contract, flexible hours (part-time and full-time options).
  • Location : United States or Canada
  • Create a job alert for this search

    EvaluatorReviewer Statistical Assistants • San Francisco, CA, United States

    Similar jobs
    Statistical Evaluation & Sampling Engineer

    Statistical Evaluation & Sampling Engineer

    Waymo • San Francisco, CA, United States
    Full-time
    A leading autonomous driving technology company is looking for an engineer to develop importance sampling techniques for their evaluation pipelines. The role requires skills in probability, statisti...Show more
    Last updated: 20 days ago • Promoted
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Together AI • San Francisco, CA, United States
    Full-time
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis.Together AI is building the fastest, most capable open‑source‑aligned LLMs and inference stack in the world.As part of the Turbo org...Show more
    Last updated: 30+ days ago • Promoted
    Research Engineer, Model Evaluations

    Research Engineer, Model Evaluations

    Menlo Ventures • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 30+ days ago • Promoted
    Quantitative UX Researcher, Search

    Quantitative UX Researcher, Search

    Google • San Francisco, CA, United States
    Full-time
    Applicants in San Francisco : Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Francisco Fair Chance Ordinance for Employers and ...Show more
    Last updated: 22 days ago • Promoted
    Research Scientist : AI Evaluation & Alignment

    Research Scientist : AI Evaluation & Alignment

    Patronus AI • San Francisco, CA, United States
    Full-time
    A leading AI company is seeking a Research Scientist to develop cutting-edge AI evaluation systems and conduct transformative research in language models. Candidates should have a background in empi...Show more
    Last updated: 22 days ago • Promoted
    Research Associate

    Research Associate

    VirtualVocations • Oakland, California, United States
    Full-time
    A company is looking for a Research Associate to conduct analytical work and contribute to higher education policy discussions. Key Responsibilities Conduct quantitative analyses on trends in coll...Show more
    Last updated: 16 days ago • Promoted
    Research Engineer, Model Evaluations

    Research Engineer, Model Evaluations

    Anthropic • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 30+ days ago • Promoted
    Director, AI DataOps & Evaluation

    Director, AI DataOps & Evaluation

    Arcade • San Francisco, CA, United States
    Full-time
    A leading AI product company is seeking a Director of Data Operations to revolutionize e-commerce with generative AI.In this foundational role, you will define the company's data strategy, establis...Show more
    Last updated: 29 days ago • Promoted
    Researcher

    Researcher

    SEIU Local 1021 • Oakland, CA, US
    Full-time
    SEIU Local 1021 was founded in 2007 when ten local unions came together in Northern California to form one larger, more powerful union. Together our members are building a true 21st century union fi...Show more
    Last updated: 9 days ago • Promoted
    Stock Analysis Subject Matter Experts - AI Model Evaluator (US-Remote)

    Stock Analysis Subject Matter Experts - AI Model Evaluator (US-Remote)

    Braintrust • San Francisco, CA, United States
    Remote
    Part-time
    Stock Analysis Subject Matter Experts - AI Model Evaluator (US-Remote).Stock Analysis Subject Matter Experts - AI Model Evaluator (US-Remote). We are seeking multiple Stock Analysis Subject Matter E...Show more
    Last updated: 30+ days ago • Promoted
    Senior Staff Data Scientist, Behavioral Evaluation

    Senior Staff Data Scientist, Behavioral Evaluation

    Waymo • San Francisco, California, United States
    Full-time
    An innovative autonomous technology company is seeking a Senior Staff Data Scientist to lead a specialized data science team. The candidate should possess a strong background in statistical methods ...Show more
    Last updated: 19 days ago • Promoted
    Staff Research Associate - translational research

    Staff Research Associate - translational research

    University of California - San Francisco • San Francisco, CA, United States
    Full-time
    Staff Research Associate - translational research.HDF Comprehensive Cancer Center.David Oh conducts translational research focusing on the intersection of immunology and oncology.The research assoc...Show more
    Last updated: 10 days ago • Promoted
    Lecturer - Department of Statistics - College of Computing, Data Science and Society

    Lecturer - Department of Statistics - College of Computing, Data Science and Society

    University of California-Berkeley • Berkeley, CA, United States
    Full-time
    The UC academic salary scales set the minimum pay at appointment.See the following table(s) for the current salary scale(s) for the Lecturer position : https : / / www. The current full-time salary range...Show more
    Last updated: 30+ days ago • Promoted
    Staff Research Associate III

    Staff Research Associate III

    University of California - San Francisco Campus and Health • San Francisco, CA, United States
    Full-time
    One of the main goals of the Memory and Aging Center (MAC) is to make biospecimens banked at the Sample Processing Laboratory (SPL) / Biospecimen Core (BC) available to researchers who are performi...Show more
    Last updated: 30+ days ago • Promoted
    Stock Analysis SME - AI Model Evaluator (Remote)

    Stock Analysis SME - AI Model Evaluator (Remote)

    Braintrust • San Francisco, CA, United States
    Remote
    Part-time
    A technology consulting company is seeking Stock Analysis Subject Matter Experts to evaluate AI-generated responses and provide structured feedback. This part-time role involves collaborating with A...Show more
    Last updated: 30+ days ago • Promoted
    Lead Research Engineer, Model Evaluations Platform

    Lead Research Engineer, Model Evaluations Platform

    Anthropic • San Francisco, CA, United States
    Full-time
    A leading AI research organization in San Francisco seeks a Research Engineer to lead the design and implementation of its evaluation platform. You will ensure the safety and effectiveness of AI mod...Show more
    Last updated: 30+ days ago • Promoted
    Associate Director Data Standards & Statistical Programming

    Associate Director Data Standards & Statistical Programming

    California Staffing Service • South San Francisco, CA, United States
    Full-time
    Associate Director Data Standards & Statistical Programming.The Associate Director of Data Standards & Statistical Programming is tasked with planning and tracking statistical programming activitie...Show more
    Last updated: 3 days ago • Promoted
    Senior Statistical Programmer

    Senior Statistical Programmer

    Olema Oncology • San Francisco, CA, United States
    Full-time
    Olema Oncology is dedicated to developing better medicines for breast cancer and beyond.Our lead program, palazestrant (OP-1250), is a complete estrogen receptor antagonist (CERAN) currently in dev...Show more
    Last updated: 30+ days ago • Promoted