Talent.com
AI Infrastructure Engineer
AI Infrastructure EngineerPlayerZero • San Francisco, CA, United States
AI Infrastructure Engineer

AI Infrastructure Engineer

PlayerZero • San Francisco, CA, United States
8 days ago
Job type
  • Full-time
Job description

Get AI-powered advice on this job and more exclusive features.

What You’ll Do

  • Own critical services end-to-end—from architecture and design reviews through deployment, observability, and SLOs.
  • Scale LLM-driven workloads : build retrieval-augmented generation pipelines, vector indexes, and evaluation harnesses that handle billions of events per day.
  • Design data-intensive systems : streaming ETL, columnar storage, and time-series analytics that feed our self-healing algorithms.
  • Optimize for cost & latency across CPUs, GPUs, and serverless runtimes; profile hot paths and squeeze every millisecond.
  • Champion reliability : automate testing, chaos drills, and progressive delivery so new models roll out safely.
  • Collaborate cross-functionally with ML researchers, product engineers, and customers to ship features that matter.

Qualifications

  • 2–5+ years of experience building scalable backend or infrastructure systems in a production setting.
  • A builder mindset — you like owning projects end-to-end and are thoughtful about data models, performance, and long-term maintainability.
  • Experience transitioning prototypes to production with an understanding of tradeoffs in reliability and scale.
  • Comfort with data engineering workflows — parsing, transforming, indexing, and querying structured or unstructured data.
  • Exposure to search infrastructure or LLM-backed systems (e.g. document retrieval, semantic search, evaluation, or prompt engineering).
  • Bonus Points

  • Hands-on with vector databases (e.g., pgvector, Pinecone, Weaviate) or inverted-index search (Elasticsearch, Lucene).
  • Experience operating GPU clusters (Kubernetes, Ray, KServe) or tuning model-parallel inference.
  • Familiarity with Go / Rust (our primary stack) and TypeScript for the occasional full-stack tweak.
  • Deep knowledge of observability (OpenTelemetry, Grafana, Datadog) and performance profiling.
  • Contributions to open-source ML or infrastructure projects.
  • Tackling the challenges of such a vast and complex industry is an enormous undertaking. We've raised a Series A funding and are backed by leading investors who share our vision to help us on this journey.

    Seniority level

  • Mid-Senior level
  • Employment type

  • Full-time
  • Job function

  • Information Technology
  • Industries

  • Software Development
  • #J-18808-Ljbffr

    Create a job alert for this search

    Infrastructure Engineer • San Francisco, CA, United States

    Related jobs
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    StackAI • San Francisco, CA, United States
    Full-time
    As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end. Design and implement scalable backend architectures for AI workloads (infe...Show more
    Last updated: 30+ days ago • Promoted
    AI Infra Engineer : Kubernetes & Slurm (Hybrid, Equity)

    AI Infra Engineer : Kubernetes & Slurm (Hybrid, Equity)

    Pantera Capital • San Francisco, CA, United States
    Full-time
    A leading investment firm in San Francisco is seeking an AI Infrastructure Engineer to design and optimize AI training and inference clusters using Kubernetes and Slurm. The role requires strong pro...Show more
    Last updated: 2 days ago • Promoted
    AI Infrastructure Architect

    AI Infrastructure Architect

    Okta for Developers • San Francisco, CA, United States
    Full-time
    We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions. Your work will enable interna...Show more
    Last updated: 11 days ago • Promoted
    AI Infrastructure Architect

    AI Infrastructure Architect

    Okta • San Francisco, CA, United States
    Full-time
    AI Infrastructure Architect – We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer - AI WorldGen Infrastructure

    Platform Engineer - AI WorldGen Infrastructure

    Roam • San Francisco, CA, United States
    Full-time
    A leading AI lab in the San Francisco area seeks an engineer to build core infrastructure for AI-driven game generation tools. This role requires experience with AWS and a strong background in appli...Show more
    Last updated: 4 days ago • Promoted
    AI Infrastructure Engineer, Core Infrastructure

    AI Infrastructure Engineer, Core Infrastructure

    Scale AI • San Francisco, CA, United States
    Full-time
    AI Infrastructure Engineer, Core Infrastructure.As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrast...Show more
    Last updated: 11 days ago • Promoted
    AI Infrastructure Engineer - PlayerZero

    AI Infrastructure Engineer - PlayerZero

    HireOTS • San Francisco, CA, United States
    Full-time
    The platform is used by engineering and support teams to : .Autonomously debug problems in production software.Fix issues directly in the codebase. Prevent recurring issues through intelligent root-ca...Show more
    Last updated: 30+ days ago • Promoted
    AI Infrastructure Architect — Platform & Systems

    AI Infrastructure Architect — Platform & Systems

    Postman • San Francisco, CA, United States
    Full-time
    A leading API platform company in San Francisco is seeking a Member of Technical Staff on AI Infrastructure to build and maintain foundational systems for AI models. Collaborate with engineering tea...Show more
    Last updated: 5 days ago • Promoted
    Cloud Infrastructure Engineer — AWS, IaC, CI / CD, Autonomy

    Cloud Infrastructure Engineer — AWS, IaC, CI / CD, Autonomy

    Monograph • San Francisco, CA, United States
    Full-time
    A dynamic AI product company seeks an Infrastructure Engineer to design and maintain AWS infrastructure.You will own infrastructure-as-code tooling, improve reliability, and collaborate with cross-...Show more
    Last updated: 4 days ago • Promoted
    AI Infrastructure Engineer, Core Infrastructure

    AI Infrastructure Engineer, Core Infrastructure

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrastructure compute at Scale - from model training a...Show more
    Last updated: 24 days ago • Promoted
    AI Platform Engineer, Infrastructure

    AI Platform Engineer, Infrastructure

    Brainco • San Francisco, CA, United States
    Full-time
    Applied AI startup founded by Elad Gil and Jared Kushner, and backed by many of Silicon Valley's leading builders - including Patrick Collison (CEO of Stripe), Andrej Karpathy (Cofounder of OpenAI)...Show more
    Last updated: 11 days ago • Promoted
    Platform Engineer — AI Infra Specialist

    Platform Engineer — AI Infra Specialist

    Poly • San Francisco, CA, United States
    Full-time
    Platform Engineer — AI Infra Specialist.Platform Engineer — AI Infra Specialist.This range is provided by Poly.Your actual pay will be based on your skills and experience — talk with your recruiter...Show more
    Last updated: 30+ days ago • Promoted
    Principal Staff Engineer - AI Infrastructure - AI / ML Leader

    Principal Staff Engineer - AI Infrastructure - AI / ML Leader

    Andiamo • San Francisco, CA, US
    Permanent
    Overview Principal Staff Engineer - AI Infrastructure.We are seeking a Principal Staff Engineer to lead the architecture and development of our next-generation AI infrastructure.This role sits at ...Show more
    Last updated: 11 days ago • Promoted
    Senior AI Infrastructure Engineer

    Senior AI Infrastructure Engineer

    Menlo Ventures • San Francisco, CA, United States
    Full-time
    A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training.The ideal candida...Show more
    Last updated: 6 days ago • Promoted
    Infrastructure Engineer, AI & LLM Platform (Hybrid)

    Infrastructure Engineer, AI & LLM Platform (Hybrid)

    Ivo • San Francisco, CA, United States
    Full-time
    A forward-thinking tech company in San Francisco is seeking an Infrastructure Engineer to design and manage complex distributed systems. As part of the engineering team, you will own the future of t...Show more
    Last updated: 6 days ago • Promoted
    Agent Infrastructure Engineer : Build AI Driven Cloud Infra

    Agent Infrastructure Engineer : Build AI Driven Cloud Infra

    Netic • San Francisco, CA, United States
    Full-time
    A technology company in San Francisco is seeking an Agent Infrastructure Engineer responsible for building and scaling the cloud infrastructure that supports autonomous AI agents.The ideal candidat...Show more
    Last updated: 2 days ago • Promoted
    AI Research Infrastructure Engineer

    AI Research Infrastructure Engineer

    Block • San Francisco, CA, United States
    Full-time
    Each of our brands unlocks different aspects of the economy for more people.Together, we’re helping build a financial system that is open to everyone. Block is scaling Customer Insights into an AI-p...Show more
    Last updated: 15 hours ago • Promoted • New!
    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Capital One • San Francisco, CA, United States
    Full-time +1
    Distinguished AI Engineer (Agentic AI Platform Infrastructure).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an indu...Show more
    Last updated: 30+ days ago • Promoted