AI Infrastructure EngineerStack AI, Inc. • San Francisco, CA, United States
No longer accepting applications
AI Infrastructure Engineer
Stack AI, Inc. • San Francisco, CA, United States
1 day ago
Job type
- Full-time
Job description4+ years of backend engineering (Python is a must). Strong background in distributed systems, job orchestration, and task queues. Deep knowledge of concurrency, parallelism, and multithreading—including async / await, event loops, thread pools, synchronization primitives, deadlocks, and race conditions—is a must. You should know how to design systems that maximize throughput without sacrificing correctness or safety. Hands‑on experience with Temporal, Redis, Airflow, Celery, RabbitMQ (or similar). Experience with LLM serving and routing fundamentals (rate limiting, streaming, load balancing, budgets). Comfortable with containers & orchestration : Docker, Kubernetes. Familiarity with cloud platforms (AWS / GCP) and IaC (Terraform). Experience with multiple storage systems : S3, Postgres, MongoDB, Redis, and Elasticsearch. Track record scaling systems in startups or fast‑paced environments. Understanding of deploying, monitoring, and optimizing AI / ML systems in production with strong CI / CD practices. Play a foundational role at a fast‑growing Series A startup that is shaping the future of AI in enterprise workflows. Collaborate across Product, ML, and Platform teams, being the bridge between AI logic and scalable execution. Build infrastructure that enables real value for large enterprises : low‑code, secure, and scalable AI workflows. Join a company that’s scaling thoughtfully and values developer experience.
About the Role
We’re hiring an AI Infrastructure Engineer to shape and scale the backend systems that power our AI platform. As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end.
What You’ll Do
- Design and implement scalable backend architectures for AI workloads (inference, orchestration, monitoring).
- Own distributed job orchestration with Temporal and related systems.
- Improve data pipeline performance by designing smarter caching strategies (e.g., file deduplication, hot / cold storage, Redis caching layers) to reduce redundant compute and API calls.
- Build observability, monitoring, retries, and fault tolerance into all workflows.
- Manage infrastructure reliability, incident response, and performance.
- Develop tooling and platform infrastructure to support rapid growth.
- Partner with ML engineers to bring models to production at scale.
What We’re Looking For
Why You’ll Love Working Here
#J-18808-Ljbffr
Create a job alert for this search
Infrastructure Engineer • San Francisco, CA, United States
Related jobs
As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrastructure compute at Scale - from model training a...Show more
AI is a non-profit AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone.Our mission is to facilitate breakthrough AI safety research, advance global understan...Show more
We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions.
Your work will enable interna...Show more
AI Infrastructure Architect – We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions...Show more
Poly is building a better file storage platform for everyone.We've raised $8M from YC, Bloomberg Beta, Felicis, Figma Ventures, AI Grant, and more, and we're looking to grow our founding team of su...Show more
A leading AI lab in the San Francisco area seeks an engineer to build core infrastructure for AI-driven game generation tools.
This role requires experience with AWS and a strong background in appli...Show more
MindsDB is a fast-growing AI startup headquartered in San Francisco, California.MindsDB is an AI Analytics solution that connects to diverse data sources and applications then unifies structured an...Show more
AI Infrastructure Engineer, Core Infrastructure.As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrast...Show more
A leading API platform company in San Francisco is seeking a Member of Technical Staff on AI Infrastructure to build and maintain foundational systems for AI models.
Collaborate with engineering tea...Show more
A leading AI research firm in San Francisco is seeking a Software Engineer for the Agent Infrastructure team.This role involves building scalable systems for training AI models and launching agenti...Show more
As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrastructure compute at Scale - from model training a...Show more
Applied AI startup founded by Elad Gil and Jared Kushner, and backed by many of Silicon Valley's leading builders - including Patrick Collison (CEO of Stripe), Andrej Karpathy (Cofounder of OpenAI)...Show more
Platform Engineer — AI Infra Specialist.Platform Engineer — AI Infra Specialist.This range is provided by Poly.Your actual pay will be based on your skills and experience — talk with your recruiter...Show more
Today’s Data Scientists are in pain - spending their time manually wrangling data, building models through slow trial and error, taking on painstaking rewrites for deployment, and dealing with coun...Show more
Menlo Park, CA | On-Site | Full-Time / Direct Hire.Client Opportunity | Through Phizenix.Phizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an AI startup pioneering ...Show more
A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training.The ideal candida...Show more
A leading AI technology company in San Francisco seeks a Principal Software Engineer to design and build their AI-first data computing platform.
This role involves systems architecture, technical le...Show more
A technology company in San Francisco is seeking an Agent Infrastructure Engineer responsible for building and scaling the cloud infrastructure that supports autonomous AI agents.The ideal candidat...Show more
AI Infrastructure Engineer, Core Infrastructure
Scale Ai • San Francisco, California, United States
Full-time
Last updated: 24 days ago • Promoted
Infrastructure Engineer
FAR.AI • Berkeley, California, United States
Full-time
Last updated: 30+ days ago • Promoted
AI Infrastructure Architect
Okta for Developers • San Francisco, CA, United States
Full-time
Last updated: 13 days ago • Promoted
AI Infrastructure Architect
Okta • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Platform Engineer — AI Infra Specialist
Poly Corporation • San Francisco, CA, United States
Full-time
Last updated: 4 hours ago • Promoted • New!
Platform Engineer - AI WorldGen Infrastructure
Roam • San Francisco, CA, United States
Full-time
Last updated: 8 days ago • Promoted
Platform & Infrastructure Engineer
Mindsdb • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
AI Infrastructure Engineer, Core Infrastructure
Scale AI • San Francisco, CA, United States
Full-time
Last updated: 13 days ago • Promoted
AI Infrastructure Architect — Platform & Systems
Postman • San Francisco, CA, United States
Full-time
Last updated: 8 days ago • Promoted
AI Infrastructure Engineer : Agent Training & Production
OpenAI • San Francisco, CA, United States
Full-time
Last updated: 4 days ago • Promoted
AI Infrastructure Engineer, Core Infrastructure
Scale AI, Inc. • San Francisco, CA, United States
Full-time
Last updated: 27 days ago • Promoted
AI Platform Engineer, Infrastructure
Brainco • San Francisco, CA, United States
Full-time
Last updated: 13 days ago • Promoted
Platform Engineer — AI Infra Specialist
Poly • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
MTS, Infrastructure Engineer
Delphina • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
ML Infrastructure Engineer
Phizenix • Menlo Park, California, United States
Full-time +1
Last updated: 30+ days ago • Promoted
Senior AI Infrastructure Engineer
Menlo Ventures • San Francisco, CA, United States
Full-time
Last updated: 8 days ago • Promoted
AI Infrastructure Architect (Remote-First, Equity)
CEF AI • San Francisco, CA, United States
Remote
Full-time
Last updated: 1 day ago • Promoted
Agent Infrastructure Engineer : Build AI Driven Cloud Infra
Netic • San Francisco, CA, United States
Full-time
Last updated: 5 days ago • Promoted