Data Scientist - LLM Specialist

A company is looking for a Senior Data Scientist with expertise in large language models and natural language processing.

Key Responsibilities

Evaluate LLM-generated summaries of clinical conversations for accuracy and completeness

Analyze unstructured text data to assess model quality and performance

Design evaluation frameworks and scalable workflows for LLM testing and analysis

Required Qualifications

Strong proficiency in Python and ML / NLP libraries (e.g., PyTorch, TensorFlow, Hugging Face)

Hands-on experience with large language models or text summarization models

Familiarity with LLM evaluation accuracy and hallucination detection

Experience working with unstructured text data and large-scale NLP pipelines

Ability to contextualize technical results into product or business-level insights