Role Overview
The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.
Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.
Key Responsibilities
- Review submissions requiring professional or technical domain knowledge
- Validate factual accuracy, terminology, and real-world applicability within the domain
- Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance
- Evaluate alignment with professional standards, norms, and best practices
- Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts
- Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise
- Identify high-risk errors related to safety, ethics, or misuse
- Escalate ambiguous or high-impact issues appropriately
- Maintain clear documentation of review decisions and reasoning
Required Qualifications
Advanced degree, professional certification, or equivalent experience in the relevant occupation or field5+ years of professional experience practicing in that domainDemonstrated experience with :Evaluation, review, auditing, or supervisory responsibilities OR
Teaching, mentoring, training, or assessing professional work
Strong understanding of professional boundaries, risk, and compliance considerationsExcellent written communication skills suitable for formal feedbackPreferred Qualifications
Prior experience reviewing AI-generated or training data contentFamiliarity with compliance, regulatory, or ethical standards in the fieldExperience translating expert knowledge into clear, structured explanationsComfort working with evolving guidelines and iterative feedback cyclesKey Competencies
Subject matter expertiseRisk awareness and safety judgmentGuideline fidelityClear, corrective feedbackProfessional integrityExpectations
Strict adherence to confidentiality and data protection requirementsConsistent application of guidelines across all reviewsWillingness to update evaluation approach as standards evolveProfessional, unbiased, and respectful communication at all timesCompensation & Logistics
$50 to $75 per hour, depending on expertise and relevance, with bonuses for key contributionsBegins with a paid trial periodPaid every two weeks based on approved and tracked hoursFully remote and async friendly, work at your own pace within flexible deadlinesEmployment type : Contract, flexible hours (part-time and full-time options).Location : United States or Canada