Talent.com
Data Annotation AI Specialist
Data Annotation AI SpecialistBiogensys • NJ, United States
Data Annotation AI Specialist

Data Annotation AI Specialist

Biogensys • NJ, United States
1 day ago
Job type
  • Full-time
  • Quick Apply
Job description

We are hiring a Data Annotation AI Specialist for one of our clients .

Overview

  • Client AI group is seeking a Data Annotation AI Specialist to be part of a team that will be dedicated to build and support Generative AI, Machine learning, Deep Learning and Data science solutions across the organization.
  • The position could be based out of our Chicago or NY offices. We are seeking a Data Annotation AI Specialist to lead the evaluation, selection, and onboarding of a data annotation platform, and to establish best-in-class annotation workflows for our NLP and CV initiatives.
  • This role will bridge product, data science, MLOps, and compliance to ensure high-quality labeled datasets that accelerate model development for tasks such as text classification, entity extraction, unstructured data extraction, document summarization, and prompt / response curation.

What We Offer :

  • This will be a high impact role with significant visibility where the candidate will work on some flagship Fitch products
  • The candidate will have an excellent opportunity to work in the cutting-edge field of AI, NLP, Computer vision and MLOPs / LLMOps
  • Fitch promotes an excellent work culture and is known for providing a good work life balance
  • We ll Count on You To :

  • Platform Evaluation and Onboarding :
  • Assess and compare data annotation platforms (e.g., Labelbox, Prodigy, Snorkel, Scale AI, SuperAnnotate, LightTag, custom open-source stacks) against business and technical requirements.
  • Lead proof-of-concept trials; define evaluation criteria (quality, throughput, cost, security, privacy, compliance, UI / UX, workflow features, integrations, auditability).
  • Drive vendor due diligence, security reviews, and coordinate procurement / contracting with Legal, Security, and Procurement.
  • Plan and execute platform deployment, integrations (SSO, data lakes, MLOps pipelines), and role-based access controls.
  • Workflow and Taxonomy Design :
  • Collaborate with NLP and CV scientists and product owners to define labeling taxonomies, guidelines, and rubrics for tasks such as NER, data extraction, intent classification, topic modeling, toxicity / BI risk tagging, and document QA.
  • Establish annotation protocols, inter-annotator agreement measures (IAA), and quality gates; design multi-pass review processes and adjudication steps.
  • Develop gold standards and calibration sets; maintain versioning and change management of label schemas.
  • Quality Management :
  • Implement QA metrics and dashboards (precision / recall on labeled subsets, IAA, disagreement analysis, drift detection, sampling strategies).
  • Design active learning and human-in-the-loop strategies to continually improve data quality and labeling efficiency.
  • Conduct audits, bias checks, and error analyses; enforce data governance and documentation (data sheets, model cards inputs).
  • Operations and Scale :
  • Build and manage a hybrid workforce model (in-house annotators, expert reviewers, external vendors) including training, SLAs, throughput planning, and budget tracking.
  • Create training materials and onboarding programs for annotators, SMEs, and reviewers; run calibration sessions and periodic refreshers.
  • Optimize throughput and cost with workflow automation, pre-labeling, heuristics, and annotation tooling features.
  • Integration and MLOps :
  • Integrate the annotation platform with data pipelines, model training loops, experiment tracking, and storage (e.g., Databricks, Snowflake, AWS / GCP / Azure, MLflow).
  • Implement programmatic interfaces (APIs / SDKs) for data ingestion / export, schema management, and reproducibility.
  • Collaborate on dataset curation, splitting strategies, and governance (PII handling, encryption, retention policies).
  • What You Need to Have :

  • 4 7+ years of experience in data annotation, data operations, or applied NLP / CV / ML, with direct responsibility for building and managing labeling programs.
  • Hands-on experience with annotation platforms and workflows for NLP tasks; familiarity with enterprise deployment considerations (SSO, RBAC, audit, SOC2).
  • Strong understanding of NLP and CV techniques : tokenization, embeddings, NER, text classification, sentiment, summarization, prompt engineering, and evaluation.
  • Proficiency in Python and data tooling (Pandas, spaCy, Hugging Face, NLTK); experience using APIs / SDKs to automate annotation and active learning loops.
  • Experience defining label taxonomies, guidelines, and measuring IAA; practical knowledge of QA methodologies and error / bias analysis.
  • Familiarity with cloud platforms (AWS / GCP / Azure), data governance, and secure data handling.
  • Excellent communication skills; ability to collaborate with data scientists, product managers, engineers, SMEs, and vendors.
  • What Would Make You Stand Out :

  • Experience with large language model (LLM) data curation, RLHF / RLAIF pipelines, and prompt / response quality evaluation.
  • Background in financial services, risk analytics, or regulated industries with strong compliance requirements.
  • Prior experience building hybrid annotation teams and managing external vendors.
  • Knowledge of annotation for multilingual NLP and document-heavy workflows (PDF parsing, OCR)
  • About Us :

    We are specialized in recruiting and deliver the best professional talent of industry and we are committed to deliver best experience for our clients and job seekers. With over two decades of experience in the recruitment industry, we proudly help you to find the next job that matches your professional skills. Our team understands your needs or requirement before starting the recruitment, that enables to find the high quality of talent with high success rate of talent delivery, keeps us continue to be the best in the industry. By responding to this job posting, you are consenting to receive text / SMS messages from us. Thank you.

    Create a job alert for this search

    Ai Specialist • NJ, United States

    Related jobs
    Associate Director AI

    Associate Director AI

    Life Science Solutions Provider • Princeton, NJ, United States
    Full-time
    Associate Director / AI, Life Science Solutions Provider, Princeton, 220k plus bonus, Hybrid Model.MUST HAVE FIVE YEARS AI / DATA ANALYTICS. MUST HAVE STRONG API / CLOUD SKILLSET.The ideal candidate will ...Show more
    Last updated: 1 day ago • Promoted
    Remote Equity Research Analyst - AI Trainer ($50-$60 / hour)

    Remote Equity Research Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Sayreville, NJ, United States
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
    Last updated: 15 hours ago • Promoted • New!
    VP, AI Engineering and Applied Research

    VP, AI Engineering and Applied Research

    Wolters Kluwer • Princeton, NJ, US
    Full-time
    VP, AI Engineering and Applied Research.Be among the first 25 applicants.VP, AI Engineering and Applied Research.VP of AI Engineering and Applied Research. Generative AI capabilities across our prod...Show more
    Last updated: 7 days ago • Promoted
    Medical Assistant

    Medical Assistant

    Advocare LLC • Hammonton, NJ, US
    Full-time
    We are seeking a skilled and compassionate Medical Assistant to join our healthcare team.The ideal candidate will provide high-quality, direct patient care and support to providers and clinical sta...Show more
    Last updated: 30+ days ago • Promoted
    Treasury Specialist Lead

    Treasury Specialist Lead

    South Jersey Industries • Hammonton, NJ, US
    Full-time
    We are looking for an individual who thrives in a fast-paced, team-oriented environment, embraces challenges, and values the opportunity to make a difference. Ideal candidates are collaborative prof...Show more
    Last updated: 30+ days ago • Promoted
    Director of Artificial Intelligence Services

    Director of Artificial Intelligence Services

    Alpine Solutions Group • Princeton, NJ, United States
    Full-time
    Position : Director / Senior Director of AI Services.Compensation : Competitive Base + bonus + FTE benefits.Location : Princeton NJ- onsite when clients are in town but primarily remote.IT experience wi...Show more
    Last updated: 21 hours ago • Promoted • New!
    Director of Artificial Intelligence Services (Princeton)

    Director of Artificial Intelligence Services (Princeton)

    Alpine Solutions Group • Princeton, NJ, US
    Part-time
    Position : Director / Senior Director of AI Services.Compensation : Competitive Base + bonus + FTE benefits.Location : Princeton NJ- onsite when clients are in town but primarily remote.IT experience wi...Show more
    Last updated: 21 hours ago • Promoted • New!
    Associate Director AI (Princeton)

    Associate Director AI (Princeton)

    Life Science Solutions Provider • Princeton, NJ, US
    Part-time
    Associate Director / AI, Life Science Solutions Provider, Princeton, 220k plus bonus, Hybrid Model.MUST HAVE FIVE YEARS AI / DATA ANALYTICS. MUST HAVE STRONG API / CLOUD SKILLSET.The ideal candidate will ...Show more
    Last updated: 1 day ago • Promoted
    Special Agent, $40,000 Recruitment Incentive

    Special Agent, $40,000 Recruitment Incentive

    The United States Secret Service • Cologne, NJ, US
    Full-time
    Recruitment Incentive : Applicants may be eligible for a $40,000 recruitment incentive in accordance with regulatory requirements. Click apply for complete details on the recruitment incentive detail...Show more
    Last updated: 17 days ago • Promoted
    Audit & Risk Mgmt Consultant (Remote EST CST or MST)

    Audit & Risk Mgmt Consultant (Remote EST CST or MST)

    Lexis Nexis • Long Beach Township, NJ, US
    Remote
    Full-time
    LexisNexis Risk Solutions is the essential partner in the assessment of risk.Within our Government vertical, our solutions assist government agencies and law enforcement to drive insights from comp...Show more
    Last updated: 7 days ago • Promoted
    Control Account Management Lead

    Control Account Management Lead

    Leidos Inc • Egg Harbor City, NJ, United States
    Full-time
    Leidos is seeking a Control Account Management (CAM) Lead - Air Traffic who will support the Federal Aviation Administration (FAA)'s Terminal Flight Data Manager (TFDM) program.TFDM is a management...Show more
    Last updated: 6 days ago • Promoted
    Content Intelligence & AI Innovation Manager

    Content Intelligence & AI Innovation Manager

    ISMG - Information Security Media Group • Princeton, NJ, US
    Full-time
    Quick Apply
    About Us ISMG is a global intelligence firm and media powerhouse, leading the way in cybersecurity, enterprise IT, and digital transformation. With 10+ brands, 38 digital media properties, an...Show more
    Last updated: 14 days ago
    Content Intelligence & AI Innovation Manager

    Content Intelligence & AI Innovation Manager

    ISMG - Information Security Media Group • Princeton, NJ, US
    Full-time
    IT, and digital transformation.With 10+ brands, 38 digital media properties, and over 400 premier events annually—ISMG connects a network of over 2M executives, decision-makers, and innovator...Show more
    Last updated: 13 days ago • Promoted
    Looking for the ultimate side hustle?

    Looking for the ultimate side hustle?

    Survey Authority • Red Bank, NJ, US
    Full-time
    Earn cash by matching with real companies that pay you for your opinions.Show more
    Last updated: 15 days ago • Promoted
    Treasury Specialist Associate

    Treasury Specialist Associate

    Veracity • Hammonton, NJ, US
    Full-time
    Folsom, NJ, United States, 08037 (Hybrid position) 02 Months Shift timings : Monday to Friday, 9am to 5pm Summary : The Treasury Specialist Associate will support the Treasury department by managing ...Show more
    Last updated: 30+ days ago • Promoted
    QA Engineer

    QA Engineer

    DerbySoft • Barnegat Light, NJ, US
    Full-time
    Founded in 2002, DerbySoft is a technology company whose mission is to make the travel business easier through industry leading technology that empowers travel industry services.The company support...Show more
    Last updated: 7 days ago • Promoted
    Medical Device Sales – Paid Internship

    Medical Device Sales – Paid Internship

    Medical Sales College • Forked River, New Jersey, US
    Internship
    Description Medical Device Sales - Paid Internship Looking for a rewarding and lucrative career in the medical sales industry? Our paid Internship may be the right path for you! Here are just some ...Show more
    Last updated: 30+ days ago • Promoted
    Travel SNF Physical Therapy Assistant - $1,128 per week

    Travel SNF Physical Therapy Assistant - $1,128 per week

    AHS Staffing • Hammonton, NJ, United States
    Full-time
    AHS Staffing is seeking a travel Physical Therapy Assistant for a travel job in Hammonton, New Jersey.Job Description & Requirements Specialty : Physical Therapy Assistant Discipline : Therapy Start ...Show more
    Last updated: 30+ days ago • Promoted