Talent.com
Machine Learning Engineer, LLM Fine-Tuning

Machine Learning Engineer, LLM Fine-Tuning

First Soft Solutions LLCSan Jose, CA, United States
5 days ago
Job type
  • Full-time
Job description

Machine Learning Engineer, LLM Fine‑Tuning

We are actively hiring for a Machine Learning Engineer focused on LLM fine‑tuning for Verilog / RTL applications.

Location : San Jose, CA (Onsite)

Skills : LLM fine‑tuning, Verilog / RTL, AWS, Bedrock, SageMaker

Responsibilities

  • Own the technical roadmap for Verilog / RTL‑focused LLM capabilities—from model selection and adaptation to evaluation, deployment, and continuous improvement.
  • Lead a hands‑on team of applied scientists / engineers : set direction, unblock technically, review designs / code, and raise the bar on experimentation velocity and reliability.

Fine‑tune and customize models using state‑of‑the‑art techniques (LoRA / QLoRA, PEFT, instruction tuning, preference optimization / RLAIF) with robust HDL‑specific evals :

  • Compile‑ / lint‑ / simulate‑based pass rates, pass@k for code generation, constrained decoding to enforce syntax, and “does‑it‑synthesize” checks.
  • Design privacy‑first ML pipelines on AWS :

  • Training / customization and hosting using Amazon Bedrock and SageMaker (or EKS + KServe / Triton / DJL) for bespoke training needs.
  • Artifacts in S3 with KMS CMKs; isolated VPC subnets & PrivateLink (including Bedrock VPC endpoints), IAM least‑privilege, CloudTrail auditing, and Secrets Manager for credentials.
  • Enforce encryption in transit / at rest, data minimization, no public egress for customer / RTL corpora.
  • Stand up dependable model serving : Bedrock model invocation where it fits, and / or low‑latency self‑hosted inference (vLLM / TensorRT‑LLM), autoscaling, and canary / blue‑green rollouts.
  • Build an evaluation culture : automatic regression suites that run HDL compilers / simulators, measure behavioral fidelity, and detect hallucinations / constraint violations; model cards and experiment tracking (MLflow / Weights & Biases).
  • Partner deeply with hardware design, CAD / EDA, Security, and Legal to source / prepare datasets (anonymization, redaction, licensing), define acceptance gates, and meet compliance requirements.
  • Drive productization : integrate LLMs with internal developer tools (IDEs / plug‑ins, code review bots, CI), retrieval (RAG) over internal HDL repos / specs, and safe tool‑use / function‑calling.
  • Mentor & uplevel : coach ICs on LLM best practices, reproducible training, critical paper reading, and building secure‑by‑default systems.
  • Qualifications

  • 10+ years total engineering experience with 5+ years in ML / AI or large‑scale distributed systems; 3+ years working directly with transformers / LLMs.
  • Proven track record shipping LLM‑powered features in production and leading ambiguous, cross‑functional initiatives at Staff level.
  • Deep hands‑on skill with PyTorch, Hugging Face Transformers / PEFT / TRL, distributed training (DeepSpeed / FSDP), quantization‑aware fine‑tuning (LoRA / QLoRA), and constrained / grammar‑guided decoding.
  • AWS expertise to design and defend secure enterprise deployments : Bedrock, SageMaker, S3, EC2 / EKS / ECR, VPC / Subnets / Security Groups, IAM, KMS, PrivateLink, CloudWatch / CloudTrail, Step Functions, Batch, Secrets Manager.
  • Strong software engineering fundamentals : testing, CI / CD, observability, performance tuning; Python a must (bonus for Go / Java / C++).
  • Demonstrated ability to set technical vision and influence across teams; excellent written and verbal communication for execs and engineers.
  • Seniority Level

    Mid‑Senior level

    Employment Type

    Full‑time

    Job Function

    Engineering and Information Technology

    Industries

    IT Services and IT Consulting

    #J-18808-Ljbffr

    Create a job alert for this search

    Machine Learning Engineer • San Jose, CA, United States

    Related jobs
    • Promoted
    AIML - Machine Learning Engineer, Foundation Model Services

    AIML - Machine Learning Engineer, Foundation Model Services

    Apple Inc.Santa Clara, CA, United States
    Full-time
    Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time. Work along side Foundation Model Research team to prototype and devel...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    AtlassianSan Francisco, CA, United States
    Full-time
    Atlassians can choose where they work – whether in an office, from home, or a combination of the two.That way, Atlassians have more control over supporting their family, personal goals, and other p...Show moreLast updated: 13 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    HarnhamSan Mateo, CA, US
    Full-time
    STAFF AI / ML ENGINEER – HEALTHTECH.HYBRID – SUNNYVALE, CA (MON–THU ONSITE, FRI WFH).Are you passionate about applying AI to improve real-world health outcomes and quality of life for seniors?.This e...Show moreLast updated: 3 days ago
    • Promoted
    Machine Learning Engineer, Level 5

    Machine Learning Engineer, Level 5

    MinimalPalo Alto, CA, United States
    Full-time
    Machine Learning Engineer, Level 5 page is loaded## Machine Learning Engineer, Level 5locations : Palo Alto, California : Santa Monica - 3250 Ocean Park Blvd : Seattle, Washington : Bellevue, W...Show moreLast updated: 27 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Mariana MineralsSan Francisco, CA, United States
    Full-time
    Mariana Minerals is looking for a highly motivated Machine Learning Engineer to work on building the critical minerals supply chain. As a Machine Learning Engineer at Mariana Minerals, you will lead...Show moreLast updated: 23 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Two DotsSan Francisco, CA, United States
    Full-time
    Join Two Dots to build a stronger financial system.Every time someone applies for a mortgage, car loan, or apartment lease, they submit financial documents that humans use to build a financial prof...Show moreLast updated: 23 hours ago
    • Promoted
    AIML - Staff Machine Learning Engineer - ML Efficiency, ML Platform & Technology

    AIML - Staff Machine Learning Engineer - ML Efficiency, ML Platform & Technology

    Apple Inc.Santa Clara, CA, United States
    Full-time
    AIML - Staff Machine Learning Engineer - ML Efficiency, ML Platform & Technology.Santa Clara, California, United States — Machine Learning and AI. We are seeking highly motivated and experienced eng...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Clutch CanadaPalo Alto, CA, United States
    Full-time
    Palo Alto, CA - Engineering - Hybrid - Full-time.Building hardware is like writing software with no debugger, no logs, and only three compile attempts — before mass production.This lack of visibili...Show moreLast updated: 30+ days ago
    • Promoted
    ML Engineer

    ML Engineer

    PhizenixMenlo Park, CA, US
    Full-time +1
    Client Opportunity | Through Phizenix.Phizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an innovative generative AI startup that's developing diffusion-based larg...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    HarnhamHayward, CA, US
    Full-time
    SENIOR MACHINE LEARNING ENGINEER - SEARCH & RECOMMENDATIONS.Hybrid – Bay Area (3 Days / Week Onsite).We're a fast-growing online marketplace backed by a major global tech player.Our platform help...Show moreLast updated: 30+ days ago
    • Promoted
    Defense Machine Learning Engineer - Remote

    Defense Machine Learning Engineer - Remote

    iO AssociatesFremont, CA, United States
    Remote
    Full-time
    Job Title : Uncleared Machine Learning Engineer - Remote.Our Client is at the forefront of Intelligent Exploration and Enterprise AI with their cutting-edge AI Platform. Operating in a dynamic indust...Show moreLast updated: 14 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    SAP SEPalo Alto, CA, United States
    Full-time +1
    At SAP, we enable you to bring out your best.Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer, Training Infrastructure

    Machine Learning Engineer, Training Infrastructure

    Ipro Networks Pte. Ltd.San Francisco, CA, United States
    Full-time
    Job Title : Machine Learning Engineer, Training Infrastructure | Position Type : Full time | Location : San Francisco, CA, USA | Salary Range : $150,000 - $250,000 (USD) | Job ID# : 158135.Design, imple...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Adobe Systems GmbHSan Jose, CA, United States
    Full-time
    Changing the world through digital experiences is what Adobe’s all about.We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital exper...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Bland.ai, Inc.San Francisco, CA, United States
    Full-time
    Based out of San Francisco, we're a quickly growing team striving to change the way customers interact with businesses.We've raised $65 million from Silicon Valley's finest; Including Emergence Cap...Show moreLast updated: 30+ days ago
    • Promoted
    AIML - Sr Machine Learning Engineer, Data and ML Innovation

    AIML - Sr Machine Learning Engineer, Data and ML Innovation

    Apple Inc.Cupertino, CA, United States
    Full-time
    AIML - Sr Machine Learning Engineer, Data and ML Innovation.Cupertino, California, United States Machine Learning and AI. Do you want to play a part in the next revolution in Foundation Models? Cont...Show moreLast updated: 25 days ago
    • Promoted
    Machine Learning Engineer - MLR

    Machine Learning Engineer - MLR

    Apple Inc.Cupertino, CA, United States
    Full-time
    Cupertino, California, United States Machine Learning and AI.Play a part in building the next revolution of machine learning technology. We’re looking for passionate mid-level and junior researchers...Show moreLast updated: 23 hours ago
    • Promoted
    AIML - Machine Learning Engineer - Special Projects

    AIML - Machine Learning Engineer - Special Projects

    Apple Inc.Cupertino, CA, United States
    Full-time
    Cupertino, California, United States Software and Services.In this role, you will : - Design and implement machine learning algorithms to aid in building user-facing interactive conversational featur...Show moreLast updated: 30+ days ago