Talent.com
AI Systems Engineer
AI Systems EngineerOpenkyber • CA, United States
AI Systems Engineer

AI Systems Engineer

Openkyber • CA, United States
5 days ago
Job type
  • Full-time
  • Quick Apply
Job description

Staff Machine Learning Engineer, LLM Fine Tuning (Verilog / RTL Applications) :

HIGHLIGHTS :

  • Location : San Jose, CA (Onsite / Hybrid)
  • Schedule : Full Time
  • Position Type : Contract
  • Hourly : BOE

Overview :

Our client is building privacy preserving LLM capabilities that help hardware design teams reason over Verilog / SystemVerilog and RTL artifacts-code generation, refactoring, lint explanation, constraint translation, and spec to RTL assistance. Our client is looking for a Staff level engineer to technically lead a small, high leverage team that fine tunes and productizes LLMs for these workflows in a strict enterprise data privacy environment.

You don't need to be a Verilog / RTL expert to start;curiosity, drive, and deep LLM craftsmanship matter most. Any HDL / EDA fluency is a strong plus.

What you'll do (Responsibilities) :

  • Own the technical roadmap for Verilog / RTL focused LLM capabilities-from model selection and adaptation to evaluation, deployment, and continuous improvement.
  • Lead a hands on team of applied scientists / engineers : set direction, unblock technically, review designs / code, and raise the bar on experimentation velocity and reliability.
  • Fine tune and customize models using state of the art techniques (LoRA / QLoRA, PEFT, instruction tuning, preference optimization / RLAIF) with robust HDL specific evals :
  • Compile / lint / simulate based pass rates, pass@k for code generation, constrained decoding to enforce syntax, and "does it synthesize"checks.
  • Design privacy first ML pipelines on AWS :
  • Training / customization and hosting using Amazon Bedrock (including Anthropic models) where appropriate;SageMaker (or EKS + KServe / Triton / DJL) for bespoke training needs.
  • Artifacts in S3 with KMS CMKs;isolated VPC subnets & PrivateLink (including Bedrock VPC endpoints), IAM least privilege, CloudTrail auditing, and Secrets Manager for credentials.
  • Enforce encryption in transit / at rest, data minimization, no public egress for customer / RTL corpora.
  • Stand up dependable model serving : Bedrock model invocation where it fits, and / or low latency self hosted inference (vLLM / TensorRT LLM), autoscaling, and canary / blue green rollouts.
  • Build an evaluation culture : automatic regression suites that run HDL compilers / simulators, measure behavioral fidelity, and detect hallucinations / constraint violations;model cards and experiment tracking (MLflow / Weights & Biases).
  • Partner deeply with hardware design, CAD / EDA, Security, and Legal to source / prepare datasets (anonymization, redaction, licensing), define acceptance gates, and meet compliance requirements.
  • Drive productization : integrate LLMs with internal developer tools (IDEs / plug ins, code review bots, CI), retrieval (RAG) over internal HDL repos / specs, and safe tool use / function calling.
  • Mentor & uplevel : coach ICs on LLM best practices, reproducible training, critical paper reading, and building secure by default systems.
  • What you'll bring (Minimum qualifications) :

  • 10+ years total engineering experience with 5+ years in ML / AI or large scale distributed systems;3+ years working directly with transformers / LLMs.
  • Proven track record shipping LLM powered features in production and leading ambiguous, cross functional initiatives at Staff level.
  • Deep hands on skill with PyTorch, Hugging Face Transformers / PEFT / TRL, distributed training (DeepSpeed / FSDP), quantization aware fine tuning (LoRA / QLoRA), and constrained / grammar guided decoding.
  • AWS expertise to design and defend secure enterprise deployments, including :
  • Amazon Bedrock (model selection, Anthropic model usage, model customization, Guardrails, Knowledge Bases, Bedrock runtime APIs, VPC endpoints)
  • SageMaker (Training, Inference, Pipelines), S3, EC2 / EKS / ECR, VPC / Subnets / Security Groups, IAM, KMS, PrivateLink, CloudWatch / CloudTrail, Step Functions, Batch, Secrets Manager.
  • Strong software engineering fundamentals : testing, CI / CD, observability, performance tuning;Python a must (bonus for Go / Java / C++).
  • Demonstrated ability to set technical vision and influence across teams;excellent written and verbal communication for execs and engineers.
  • Nice to have (Preferred qualifications) :

  • Familiarity with Verilog / SystemVerilog / RTL workflows : lint, synthesis, timing closure, simulation, formal, test benches, and EDA tools (Synopsys / Cadence / Mentor).
  • Experience integrating static analysis / AST aware tokenization for code models or grammar constrained decoding.
  • RAG at scale over code / specs (vector stores, chunking strategies), tool use / function calling for code transformation.
  • Inference optimization : TensorRT LLM, KV cache optimization, speculative decoding;throughput / latency trade offs at batch and token levels.
  • Model governance / safety in the enterprise : model cards, red teaming, secure eval data handling;exposure to SOC2 / ISO 27001 / NIST frameworks.
  • Data anonymization, DLP scanning, and code de identification to protect IP.
  • What success looks like :

  • 90 days
  • Baseline an HDL aware eval harness that compiles / simulates;establish secure AWS training & serving environments (VPC only, KMS backed, no public egress).

  • Ship an initial fine tuned / customized model with measurable gains vs. Base (e.G., +X% compile pass rate, Y% lint findings per K LOC generated).
  • 180 days
  • Expand customization / training coverage (Bedrock for managed FMs including Anthropic;SageMaker / EKS for bespoke / open models).

  • Add constrained decoding + retrieval over internal design specs;productionize inference with SLOs (p95 latency, availability) and audited rollout to pilot hardware teams.
  • 12 months
  • Demonstrably reduce review / iteration cycles for RTL tasks with clear metrics (defect reduction, time to lint clean, % auto fix suggestions accepted), and a stable MLOps path for continuous improvement.

  • (Security & privacy by design)
  • Customer and internal design data remain within private AWS VPCs;access via IAM roles and audited by CloudTrail;all artifacts encrypted with KMS.

  • No public internet calls for sensitive workloads;Bedrock access via VPC interface endpoints / PrivateLink with endpoint policies;SageMaker and / or EKS run in private subnets.
  • Data pipelines enforce minimization, tagging, retention windows, and reproducibility;DLP scanning and redaction are first class steps.
  • We produce model cards, data lineage, and evaluation artifacts for every release.
  • Tech you'll touch :
  • Modeling : PyTorch, HF Transformers / PEFT / TRL, DeepSpeed / FSDP, vLLM, TensorRT LLM

  • AWS & MLOps : Amazon Bedrock (Anthropic and other FMs, Guardrails, Knowledge Bases, Runtime APIs), SageMaker (Training / Inference / Pipelines), MLflow / W&B, ECR, EKS / KServe / Triton, Step Functions
  • Platform / Security : S3 + KMS, IAM, VPC / PrivateLink (incl. Bedrock), CloudWatch / CloudTrail, Secrets Manager
  • Tooling (nice to have) :

  • HDL toolchains for compile / simulate / lint, vector stores (pgvector / OpenSearch), GitHub / GitLab CI
  • "We are GTN The Go To Network"

    Create a job alert for this search

    System Engineer • CA, United States

    Related jobs
    Engineer

    Engineer

    Quality Talent Group • Tulare, California, United States
    Full-time
    Quick Apply
    Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They’ve built a global community of expert contributors and have already paid out more ...Show more
    Last updated: 3 days ago
    Moms 21–36 : Become a Surrogate with Ivy Surrogacy & Bless a Family

    Moms 21–36 : Become a Surrogate with Ivy Surrogacy & Bless a Family

    Ivy Surrogacy • Auberry, CA, US
    Full-time +1
    Becoming a surrogate mother is one of the greatest gifts of life!.Ivy Surrogacy is a third-party reproductive agency for parents all over the world seeking. At Ivy Surrogacy, we genuinely believe we...Show more
    Last updated: 10 days ago • Promoted
    AI Platform Engineer

    AI Platform Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    Position : Senior AI Program Manager Location : Denver, CO (5 Days Onsite) Duration : Long Term In Person Interview Must after Video call interviews About R Systems : R Systems is a leading digital pro...Show more
    Last updated: 5 days ago
    AI Infrastructure Solution Architect, Principal

    AI Infrastructure Solution Architect, Principal

    Jobgether • CA, US
    Remote
    Full-time
    Quick Apply
    This position is posted by Jobgether on behalf of a partner company.We are currently looking for an AI Infrastructure Solution Architect, Principal in California (USA). As an AI Infrastructure Solut...Show more
    Last updated: 26 days ago
    Remote Market Research Contributor (Hiring Immediately)

    Remote Market Research Contributor (Hiring Immediately)

    Earn Haus • Farmersville, California, US
    Remote
    Full-time +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
    Last updated: 30+ days ago • Promoted
    AI Automation Engineer

    AI Automation Engineer

    atqleads • Visalia, CA, us
    Full-time
    Quick Apply
    ATQLeads helps B2B small and mid-sized companies transform outdated go-to-market operations into scalable, intelligent, revenue-producing systems. We believe the future of growth belongs to organiza...Show more
    Last updated: 8 days ago
    Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

    Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

    OCPA • Shaver Lake, California, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Neurologist is needed in Central California! - Offering $50K Sign on bonus!

    Neurologist is needed in Central California! - Offering $50K Sign on bonus!

    KAWEAH HEALTH • Visalia, CA, US
    Full-time +1
    Kaweah Health is seeking a Neurologist to join our team in .Come practice in one of America's most progressive and collaborative health systems, located in Visalia, CA.We offer an expansiv...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer (Remote)

    Senior AI / ML Engineer (Remote)

    vidIQ • California, CA, US
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    SystemC / TLM2 Modeling Engineer

    SystemC / TLM2 Modeling Engineer

    Signature Consultants • USA, California, 100% Remote!
    Remote
    Full-time
    Quick Apply
    SystemC / TLM2 Modeling Engineer.Hands-on SystemC modeling projects.Performance modeling & architecture exploration experience. Solid C++ skills (SystemC foundation).Exposure to SystemC verifica...Show more
    Last updated: 12 days ago
    Power Generation Project Engineer (Mechanical)

    Power Generation Project Engineer (Mechanical)

    PG&E Corporation • AUBERRY, California, US
    Full-time
    Job Category : Power Generation; Engineering / Science .Job Level : Individual Contributor.Business Unit : Operations - Other. Power Generation operates and maintains PG&E's hydroelectric, fossil, sola...Show more
    Last updated: 13 hours ago • Promoted • New!
    Air Interdiction Agent

    Air Interdiction Agent

    U.S. Customs and Border Protection • Auberry, CA, US
    Full-time
    Pilot CBP Air Interdiction Agent.Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP), offers skilled Pilots interested in law enforcement an opportunity to work wi...Show more
    Last updated: 22 days ago • Promoted
    Physics Private Tutoring Jobs Visalia

    Physics Private Tutoring Jobs Visalia

    Superprof • Visalia, California, US
    Full-time +1
    Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
    Last updated: 4 hours ago • Promoted • New!
    ARRT - CT Technologist - Computed Tomography

    ARRT - CT Technologist - Computed Tomography

    MLee Healthcare Staffing and Recruiting, Inc • Shaver Lake, CA, United States
    Full-time
    ARRT - CT Technologist - Computed Tomography.Join us as a CT Technologist and enjoy strong leadership, competitive pay, and affordable housing. This role also provides opportunities to cross-train i...Show more
    Last updated: 30+ days ago • Promoted
    IaaS Automation Engineer

    IaaS Automation Engineer

    MetroSys • CA, US
    Full-time
    Quick Apply
    Overview MetroSys is seeking a highly skilled Infrastructure-as-a-Service (IaaS) Automation Engineer to support customer delivery of automated infrastructure solutions. This role focuses on building...Show more
    Last updated: 9 days ago
    Infectious Diseases Physician

    Infectious Diseases Physician

    Inspire Health Medical Group • Auberry, California, United States
    Permanent
    UCSF Fresno Regional Campus and the Central California Faculty Medical Group (CCFMG), dba Inspire Health, are recruiting qualified physicians to join our Infectious Disease (ID) medical education a...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Data Engineer

    Senior AI / ML Data Engineer

    Simarn Solutions • California, California, United States
    Full-time
    Job Title : Senior AI / ML Data Engineer .We are seeking a highly skilled Senior AI / ML Data Engineer with expertise in multimodal AI models, vector databases, and Azure-based data engineerin...Show more
    Last updated: 30+ days ago
    Remote Work From Home Call Center Representative Agent - Part Time Panelists Needed

    Remote Work From Home Call Center Representative Agent - Part Time Panelists Needed

    ApexFocusGroup • Fresno County, California, US
    Remote
    Full-time +1
    Seeking participants for Focus Group and market research studies.Work part-time from home and earn up to $750 per week.Register to see if you are eligible. Call Center Representative Agent experienc...Show more
    Last updated: 30+ days ago • Promoted