Senior Infrastructure EngineerVast.ai • San Francisco, CA, United States
Senior Infrastructure Engineer
Vast.ai • San Francisco, CA, United States
10 days ago
Job type
- Full-time
Job descriptionDistributed Systems : Experience building high‑throughput backend systems or compute clouds Compute Orchestration : Familiarity with Docker, or custom scheduling frameworks GPU Infrastructure : Understanding of GPU provisioning, driver management, and workload scheduling Billing & Metering : Implemented or integrated usage‑based billing and account credit systems Marketplace Dynamics : Knowledge of dynamic pricing, spot instances, or supply‑demand balancing mechanisms Security & Multi‑Tenancy : Experience designing secure, multi‑tenant systems in cloud environments Programming : Strong programming skills in Python and C++; ability to write performant, maintainable, well‑architected code Database Expertise : Comfortable designing schemas and queries for large‑scale data systems (PostgreSQL preferred) Experience with GPU security, virtualization, or zero‑trust compute isolation Prior startup experience or end‑to‑end product ownership Improve the backend systems that power Vast.ai’s compute marketplace Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs Develop scalable infrastructure for workload scheduling and resource management Optimize pricing and marketplace logic for efficiency and transparency Collaborate with product and infrastructure teams to shape the future of decentralized compute 15 min – Initial screening with member of your future team (virtual) 40 min – Systems and architectures (virtual) 1 hour – LLM‑assisted coding assessment (virtual) 2 hours – Meet and greet with coding assessment (on‑site) Comprehensive health, dental, vision, and life insurance 401(k) with company match Meaningful early‑stage equity Onsite meals, snacks, and close collaboration with founders and tech leads Ambitious, fast‑paced startup culture where initiative is rewarded
About Us
Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.
Job Title
Staff Infrastructure Engineer
Location
On-site at our office in San Francisco or Westwood, Los Angeles.
About the Role
As a Senior Infrastructure Engineer, you will help design and scale the core systems that play the role of Vast.ai’s global GPU marketplace. You’ll work closely with our founders and core engineering team to extend the underlying compute infrastructure — from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics. We’re looking for someone who has previously built large‑scale infrastructure platforms — systems with similarities to Vast.ai, or distributed compute orchestration frameworks.
Tech Stack
- Python, C++, PostgreSQL, Linux, Docker, KVM, Redis, Terraform, AWS, REST / gRPC APIs
Ideal Experience
Bonus Points
Key Responsibilities
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
Interview Process (≈ 1 week)
Annual Salary Range
$180,000 – $300,000 + equity + benefits
Benefits
#J-18808-Ljbffr
Create a job alert for this search
Senior Infrastructure Engineer • San Francisco, CA, United States
Related jobs
AI is a non-profit AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone.Our mission is to facilitate breakthrough AI safety research, advance global understan...Show more
BitGo is the leading infrastructure provider of digital asset solutions delivering custody wallets staking trading financing and settlement services from regulated cold storage.Since our founding i...Show more
This range is provided by Sinclair Talent Solutions.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
We are helping a rapidly scaling startup bui...Show more
This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Direct message the job poster from Crossing Hurdles.S...Show more
Our client is a leading institutional investment platform in the digital asset space, providing comprehensive infrastructure and technology for investors to manage their entire digital asset invest...Show more
Cloud spend is a whopping $500 billion / yr, the biggest growing expense category for any tech company.Tackling these costs requires continuous effort and time from DevOps teams.Pump is building the ...Show more
Senior Infrastructure Engineer.Direct message the job poster from Commerce.Welcome to the Agentic Commerce Era.At Commerce, our mission is to empower businesses to innovate, grow, and thrive with o...Show more
Annual Bonus, Sign-on bonus, RSUs, and Stock options.Join a dynamic startup seeking an infrastructure specialist to design, scale, and maintain cutting-edge infrastructure that powers innovative di...Show more
Senior Infrastructure Engineer.The ideal candidate is deeply technical, high‑agency, and thrives in fast‑moving environments.
AI researchers to ensure reliability and performance.If you have hands‑o...Show more
Omni gives businesses one place to easily analyze all their data.Built by the teams behind Looker and Stitch, Omni combines data models, a point-and-click UI, spreadsheet formulas, and powerful vis...Show more
BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...Show more
We're democratizing software creation.Our platform lets anyone describe an idea and instantly turn it into a working application—no coding required.
We're solving one of computing's fundamental chal...Show more
Story aims to grow the creativity of the internet.The internet has introduced Story is building the IP infrastructure for the internet era, where creativity and intelligence move at the speed of cu...Show more
Our customer is a startup with an excellent strategy and technology to fundamentally change how SAP is utilized across all industry verticals.
You will work to disrupt a $100B Industry : Youll help F...Show more
Join a ground-breaking AI platform company, founded by top AI researchers and successful entrepreneurs, that is building the first Agentic AI Platform for SAP Custom Code.This critical infrastructu...Show more
BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...Show more
A leading B2B marketing platform is seeking a Software Engineer to develop cloud infrastructure and support product engineering teams.
This role emphasizes collaboration, mentorship, and the impleme...Show more
A tech-driven financial infrastructure firm in San Francisco is seeking a Senior Infrastructure Software Engineer.This role involves architecting low-latency systems for a Layer 1 blockchain focuse...Show more
Infrastructure Engineer
FAR.AI • Berkeley, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer InfraOps
BitGo • San Francisco, California, USA
Full-time
Last updated: 8 days ago • Promoted
Senior Infrastructure Engineer
Sinclair Talent Solutions • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer
Crossing Hurdles • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer (External)
Medium • San Francisco, CA, United States
Full-time
Last updated: 19 hours ago • Promoted • New!
Senior Infrastructure Engineer
Pump.co • San Francisco, CA, United States
Full-time
Last updated: 7 days ago • Promoted
Senior Infrastructure Engineer
Commerce • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Cloud Infrastructure Engineer
Harrison Clarke • San Francisco, CA, United States
Full-time
Last updated: 10 days ago • Promoted
Senior Infrastructure Engineer
Aimhire • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Cloud Infrastructure Engineer
Omni Analytics, Inc. • San Francisco, CA, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer - InfraOps
Bitgo • San Francisco, California, United States
Full-time
Last updated: 7 days ago • Promoted
Infrastructure Engineer
Vibecode • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Lead Infrastructure Engineer
PIP Labs • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Infrastructure Engineer Startup
Staff Smart Inc • San Francisco, California, USA
Full-time
Last updated: 19 days ago • Promoted
Senior Infrastructure Engineer
Hamilton Barnes? • San Francisco, CA, United States
Full-time
Last updated: 6 days ago • Promoted
Senior Infrastructure Engineer - InfraOps
BitGo, Inc. • San Francisco, CA, United States
Full-time
Last updated: 6 days ago • Promoted
Senior Cloud Infrastructure Engineer
Qualified • San Francisco, CA, United States
Full-time
Last updated: 5 days ago • Promoted
Senior Infrastructure Engineer for Low-Latency Blockchain & DEX
Nexus • San Francisco, CA, United States
Full-time
Last updated: 19 hours ago • Promoted • New!