Talent.com
Machine Learning Infrastructure Engineer
Machine Learning Infrastructure EngineerWorkshop Labs • San Francisco, CA, United States
Machine Learning Infrastructure Engineer

Machine Learning Infrastructure Engineer

Workshop Labs • San Francisco, CA, United States
16 days ago
Job type
  • Full-time
Job description

Build the infrastructure to serve personal AI models privately and at scale.

We're building the first truly private, personal AI - one that learns your skills, judgment, and preferences without big tech ever seeing your data.

Our core ML systems challenge : how do we serve the world's best personal model, at low cost and high speed, with bulletproof privacy?

What you'll do

  • Build the infrastructure that lets us create & deploy thousands and eventually millions of personalized finetuned models for our customers
  • Monitor & optimize in-the-wild model serving performance to hit low latency & cost
  • Interface with the TEE-based privacy stack that lets us guarantee user data & models can only be seen & used by the user-not even us-and integrate the privacy architecture with the finetuning & inference code

You have

  • A deep understanding of the machine learning stack . You can dive into the details of how transformers work & performance optimization techniques for them. You have a mental model of GPUs sufficient to reason about performance from first principles. You can drill down from ML code to metal.
  • Ability to execute quickly. We ship fast and fail fast so we can win faster. The challenge of human relevance in a post-AGI world isn't going to solve itself.
  • A missionary mentality. We're a mission-driven company, looking for mission-first people. If you're passionate about ensuring AI works for people (and not the other way around), you've come to the right place.
  • Ready to roll up your sleeves. We're an early stage startup, so we're looking for someone who can wear many hats.
  • Experience you may have

  • Work at a fast-paced AI startup, or top AI lab .
  • Experience deploying ML systems at scale. You might have worked with frameworks like vLLM, S-LoRA, Punica, or LoRAX.
  • Experience with privacy-first infrastructure. You're familiar with confidential computing & ability to reason about both technical and real-world confidentiality and security. You may have worked with secure enclaves, TEEs, code measurement & remote attestation, Nvidia Confidential Computing, Intel TDX or AMD SEV-SNP, or related confidential computing technologies.
  • We encourage speculative applications; we expect many strong candidates will have different experience or unconventional backgrounds.

    What we offer

  • Generous compensation and early stage equity. We're competitive with the top startups, because we believe the best talent deserves it.
  • World-class expertise. We're based in top AI research hubs in San Francisco and London. We're backed by AI experts like Juniper Ventures, Seldon Lab, and angels at Anthropic and Apollo Research. You'll have access to some of the best AI expertise in the world.
  • Massive impact. Our mission is to keep people in the economy well after AGI. You'll help shift the trajectory of AI development for the better, helping break the intelligence curse and prevent gradual disempowerment to keep humans in control of the future.
  • About Workshop Labs

    We're building the AI economy for humans. While everyone else tries to automate the world top-down, we believe in augmenting people bottom-up.

    Our team previously created evals used by Open AI, completed frontier AI research at MIT / Cambridge / Oxford, worked in Stuart Russell's lab, and led product verticals at high growth startups.

    Our founders' essay series on AI's economic impacts and the technology we'll need to keep humans relevant, The Intelligence Curse, has been covered in TIME, The New York Times, and AI 2027.

    Our vision is for everyone to have a personal AI aligned to their goals and values, helping them stay durably relevant in a post-AGI economy. As a public benefit corporation, we have a fiduciary duty to ensure that as AI becomes more powerful, humans become more empowered, not disempowered or replaced.

    We're an early stage startup, backed by legendary investors like Brad Burnham and Matt McIlwain, visionary product leaders like Jake Knapp and John Zeratsky, philosopher-builders like Brendan McCord, and top AI safety funds like Juniper Ventures. Our investors were early at Anthropic, Slack, Prime Intellect, DuckDuckGo, and Goodfire. Our advisors have held senior roles at Anthropic, Google DeepMind, and UK AISI.

    Create a job alert for this search

    Machine Learning Engineer • San Francisco, CA, United States

    Related jobs
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Abridge • San Francisco, CA, United States
    Full-time
    Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare.Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation eff...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Greylock Partners • San Francisco, CA, United States
    Full-time
    Machine Learning Infrastructure Engineer — join early B2C investment to help build large-scale ML infrastructure for a cutting-edge AI-first mobile product. Founders have experience building iconic ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Machine Learning Infrastructure

    Software Engineer, Machine Learning Infrastructure

    David AI • San Francisco, California, United States
    Full-time
    David AI is the first audio data research company.We bring an R&D approach to data–developing datasets with the same rigor AI labs bring to models. Our mission is to bring AI into the real world, an...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning - Infrastructure

    Machine Learning - Infrastructure

    Causal Labs • San Francisco, CA, United States
    Full-time
    Our mission is to build causal intelligence, starting with physics models to predict and control the weather.We're building a small team driven by a deep passion and urgency to solve this civilizat...Show more
    Last updated: 5 days ago • Promoted
    Staff Machine Learning Infrastructure Engineer

    Staff Machine Learning Infrastructure Engineer

    DYNA Robotics Inc • Redwood City, CA, United States
    Full-time
    Dyna Robotics makes general-purpose robots powered by a proprietary embodied AI foundation model that generalizes and self-improves across varied environments with commercial-grade performance.Dyna...Show more
    Last updated: 17 days ago • Promoted
    AIML - Sr. Machine Learning Infrastructure Engineer, Evaluation

    AIML - Sr. Machine Learning Infrastructure Engineer, Evaluation

    Apple • San Francisco, CA, United States
    Full-time
    How do we ensure that Apple's most advanced AI features perform flawlessly for everyone, everywhere? At Apple, the AI / ML Evaluation team answers this question. We are the architects of quality and t...Show more
    Last updated: 14 days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Saxon Global • Menlo Park, CA, United States
    Full-time
    Strong foundation in machine learning, deep learning, and computer vision.Experience with distributed systems and scalable ML infrastructure. Proficient in Python and software development best pract...Show more
    Last updated: 14 days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Ambience Healthcare • San Francisco, CA, US
    Full-time
    Ambience Healthcare is the leading AI platform for documentation, coding, and clinical workflow, built to reduce administrative burden and protect revenue integrity at the point of care.Trusted by ...Show more
    Last updated: 8 days ago • Promoted
    ML Infrastructure Engineer

    ML Infrastructure Engineer

    Openai • San Francisco, California, United States
    Full-time
    The Runtime team builds the low level framework components to power our ML training systems.We work on building robust, scalable, high performance components to support our distributed training wor...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer, Training Infrastructure

    Machine Learning Engineer, Training Infrastructure

    HEDRA INC • San Francisco, CA, United States
    Full-time
    Hedra is a pioneering generative media company backed by top investors at Index, A16Z, and Abstract Ventures.We're building Hedra Studio, a multimodal creation platform capable of control, emotion,...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Machine Learning Infrastructure

    Software Engineer, Machine Learning Infrastructure

    Datologyai • Redwood City, California, United States
    Full-time
    Companies want to train their own large models on their own data.The current industry standard is to train on a random sample of your data, which is inefficient at best and actively harmful to mode...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer, Training Infrastructure

    Machine Learning Engineer, Training Infrastructure

    Hedra, Inc • San Francisco, CA, United States
    Full-time
    Hedra is a pioneering generative media company backed by top investors at Index, A16Z, and Abstract Ventures.We're building Hedra Studio, a multimodal creation platform capable of control, emotion,...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Workshop Labs • San Francisco, California, United States
    Full-time
    Build the infrastructure to serve personal AI models privately and at scale.We're building the first truly private, personal AI – one that learns your skills, judgment, and preferences without big ...Show more
    Last updated: 10 days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Character • Redwood City, CA, United States
    Full-time
    We're looking for seasoned ML Infrastructure engineers with experience designing, building and maintaining training and serving infrastructure for ML research. Provide infrastructure support to our ...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Infrastructure Engineer

    Machine Learning Infrastructure Engineer

    Character.AI • San Francisco, CA, United States
    Full-time
    Machine Learning Infrastructure Engineer.Machine Learning Infrastructure Engineer.Machine Learning Infrastructure Engineer. Machine Learning Infrastructure Engineer.Get AI-powered advice on this job...Show more
    Last updated: 30+ days ago • Promoted
    Principle Machine Learning Infrastructure Engineer, Ads

    Principle Machine Learning Infrastructure Engineer, Ads

    Roblox • San Mateo, CA, United States
    Full-time
    Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers...Show more
    Last updated: 17 days ago • Promoted
    Machine Learning Engineer, Training Infrastructure

    Machine Learning Engineer, Training Infrastructure

    Ipro Networks Pte. Ltd. • San Francisco, CA, United States
    Full-time
    Job Title : Machine Learning Engineer, Training Infrastructure | Position Type : Full time | Location : San Francisco, CA, USA | Salary Range : $150,000 - $250,000 (USD) | Job ID# : 158135.Design, imple...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Staff Machine Learning Infrastructure Engineer

    Senior / Staff Machine Learning Infrastructure Engineer

    Calico LLC • South San Francisco, CA, United States
    Full-time
    Senior / Staff Machine Learning Infrastructure Engineer.Senior / Staff Machine Learning Infrastructure Engineer.Senior / Staff Machine Learning Infrastructure Engineer. Senior / Staff Machine Learni...Show more
    Last updated: 17 days ago • Promoted