Senior Infrastructure EngineerVast.ai • San Francisco, CA, United States
Senior Infrastructure Engineer
Vast.ai • San Francisco, CA, United States
10 days ago
Job type
- Full-time
Job descriptionDistributed Systems : Experience building high‑throughput backend systems or compute clouds Compute Orchestration : Familiarity with Docker, or custom scheduling frameworks GPU Infrastructure : Understanding of GPU provisioning, driver management, and workload scheduling Billing & Metering : Implemented or integrated usage‑based billing and account credit systems Marketplace Dynamics : Knowledge of dynamic pricing, spot instances, or supply‑demand balancing mechanisms Security & Multi‑Tenancy : Experience designing secure, multi‑tenant systems in cloud environments Programming : Strong programming skills in Python and C++; ability to write performant, maintainable, well‑architected code Database Expertise : Comfortable designing schemas and queries for large‑scale data systems (PostgreSQL preferred) Experience with GPU security, virtualization, or zero‑trust compute isolation Prior startup experience or end‑to‑end product ownership Improve the backend systems that power Vast.ai’s compute marketplace Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs Develop scalable infrastructure for workload scheduling and resource management Optimize pricing and marketplace logic for efficiency and transparency Collaborate with product and infrastructure teams to shape the future of decentralized compute 15 min – Initial screening with member of your future team (virtual) 40 min – Systems and architectures (virtual) 1 hour – LLM‑assisted coding assessment (virtual) 2 hours – Meet and greet with coding assessment (on‑site) Comprehensive health, dental, vision, and life insurance 401(k) with company match Meaningful early‑stage equity Onsite meals, snacks, and close collaboration with founders and tech leads Ambitious, fast‑paced startup culture where initiative is rewarded
About Us
Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.
Job Title
Staff Infrastructure Engineer
Location
On-site at our office in San Francisco or Westwood, Los Angeles.
About the Role
As a Senior Infrastructure Engineer, you will help design and scale the core systems that play the role of Vast.ai’s global GPU marketplace. You’ll work closely with our founders and core engineering team to extend the underlying compute infrastructure — from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics. We’re looking for someone who has previously built large‑scale infrastructure platforms — systems with similarities to Vast.ai, or distributed compute orchestration frameworks.
Tech Stack
- Python, C++, PostgreSQL, Linux, Docker, KVM, Redis, Terraform, AWS, REST / gRPC APIs
Ideal Experience
Bonus Points
Key Responsibilities
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
Interview Process (≈ 1 week)
Annual Salary Range
$180,000 – $300,000 + equity + benefits
Benefits
#J-18808-Ljbffr
Create a job alert for this search
Senior Infrastructure Engineer • San Francisco, CA, United States
Related jobs
AI is a non-profit AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone.Our mission is to facilitate breakthrough AI safety research, advance global understan...Show more
Our client is a leading institutional investment platform in the digital asset space, providing comprehensive infrastructure and technology for investors to manage their entire digital asset invest...Show more
This range is provided by Sinclair Talent Solutions.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
We are helping a rapidly scaling startup bui...Show more
This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Direct message the job poster from Crossing Hurdles.S...Show more
Cloud spend is a whopping $500 billion / yr, the biggest growing expense category for any tech company.Tackling these costs requires continuous effort and time from DevOps teams.Pump is building the ...Show more
Senior Infrastructure Engineer.Direct message the job poster from Commerce.Welcome to the Agentic Commerce Era.At Commerce, our mission is to empower businesses to innovate, grow, and thrive with o...Show more
Mercor is training models that predict how well someone will perform on a job better than a human can.We use our platform to source, vet, and onboard expert contractors who help train AI models in ...Show more
Senior Infrastructure Engineer.The ideal candidate is deeply technical, high‑agency, and thrives in fast‑moving environments.
AI researchers to ensure reliability and performance.If you have hands‑o...Show more
BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...Show more
We're democratizing software creation.Our platform lets anyone describe an idea and instantly turn it into a working application—no coding required.
We're solving one of computing's fundamental chal...Show more
Story aims to grow the creativity of the internet.The internet has introduced Story is building the IP infrastructure for the internet era, where creativity and intelligence move at the speed of cu...Show more
Nearly every company in the world runs on custom software for critical operations like tracking performance metrics, handling customer support workflows, building admin dashboards, and countless ot...Show more
SentiLink is building the future of identity verification in the United States.The existing ways to determine if somebody is who they claim to be are too clunky, ineffective, and expensive, but we ...Show more
At Delphi, we are redefining how knowledge is shared by creating a new medium for human communication : .The internet gave us static profiles and endless feeds.
Delphi is something different : a living...Show more
Macroscope aims to be the source of truth of what's happening for any company that builds software.Our mission is to give leaders clarity and engineers time.
We help leaders understand how their pro...Show more
BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...Show more
Build the future of adaptable intelligence.November 30, 2025 at 8 : 00 AM GMT.We believe the future is adaptable, and not one-size-fits-all.
We will lead in real-time efficient adaptation that combine...Show more
A leading B2B marketing platform is seeking a Software Engineer to develop cloud infrastructure and support product engineering teams.
This role emphasizes collaboration, mentorship, and the impleme...Show more
Infrastructure Engineer
FAR.AI • Berkeley, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer (External)
Medium • San Francisco, CA, United States
Full-time
Last updated: 20 hours ago • Promoted • New!
Senior Infrastructure Engineer
Sinclair Talent Solutions • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer
Crossing Hurdles • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer
Pump.co • San Francisco, CA, United States
Full-time
Last updated: 8 days ago • Promoted
Senior Infrastructure Engineer
Commerce • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Infrastructure Engineer
Mercor • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer
Aimhire • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer - InfraOps
Bitgo • San Francisco, California, United States
Full-time
Last updated: 7 days ago • Promoted
Infrastructure Engineer
Vibecode • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Lead Infrastructure Engineer
PIP Labs • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Infrastructure Engineer
Retool • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer
Djangojobs • San Francisco, CA, United States
Full-time
Last updated: 7 days ago • Promoted
Senior Infrastructure Engineer
Delphi • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer
Macroscope Inc. • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer - InfraOps
BitGo, Inc. • San Francisco, CA, United States
Full-time
Last updated: 7 days ago • Promoted
Senior Infrastructure Engineer
Adaption Labs • San Francisco, CA, United States
Full-time
Last updated: 5 days ago • Promoted
Senior Cloud Infrastructure Engineer
Qualified • San Francisco, CA, United States
Full-time
Last updated: 6 days ago • Promoted