Senior Infrastructure EngineerVast.ai • San Francisco, CA, United States

Senior Infrastructure Engineer

Vast.ai • San Francisco, CA, United States

4 days ago

Job type

Full-time

Job description

About Us

Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.

Job Title

Staff Infrastructure Engineer

Location

On-site at our office in San Francisco or Westwood, Los Angeles.

About the Role

As a Senior Infrastructure Engineer, you will help design and scale the core systems that play the role of Vast.ai’s global GPU marketplace. You’ll work closely with our founders and core engineering team to extend the underlying compute infrastructure — from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics. We’re looking for someone who has previously built large‑scale infrastructure platforms — systems with similarities to Vast.ai, or distributed compute orchestration frameworks.

Tech Stack

Python, C++, PostgreSQL, Linux, Docker, KVM, Redis, Terraform, AWS, REST / gRPC APIs

Ideal Experience

Distributed Systems : Experience building high‑throughput backend systems or compute clouds

Compute Orchestration : Familiarity with Docker, or custom scheduling frameworks

GPU Infrastructure : Understanding of GPU provisioning, driver management, and workload scheduling

Billing & Metering : Implemented or integrated usage‑based billing and account credit systems

Marketplace Dynamics : Knowledge of dynamic pricing, spot instances, or supply‑demand balancing mechanisms

Security & Multi‑Tenancy : Experience designing secure, multi‑tenant systems in cloud environments

Programming : Strong programming skills in Python and C++; ability to write performant, maintainable, well‑architected code

Database Expertise : Comfortable designing schemas and queries for large‑scale data systems (PostgreSQL preferred)

Bonus Points

Experience with GPU security, virtualization, or zero‑trust compute isolation

Prior startup experience or end‑to‑end product ownership

Key Responsibilities

Improve the backend systems that power Vast.ai’s compute marketplace

Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs

Develop scalable infrastructure for workload scheduling and resource management

Optimize pricing and marketplace logic for efficiency and transparency

Benchmark, profile, and harden systems for performance, reliability, and fault tolerance

Collaborate with product and infrastructure teams to shape the future of decentralized compute

Interview Process (≈ 1 week)

15 min – Initial screening with member of your future team (virtual)

40 min – Systems and architectures (virtual)

1 hour – LLM‑assisted coding assessment (virtual)

2 hours – Meet and greet with coding assessment (on‑site)

Annual Salary Range

$180,000 – $300,000 + equity + benefits

Benefits

Comprehensive health, dental, vision, and life insurance

401(k) with company match

Meaningful early‑stage equity

Onsite meals, snacks, and close collaboration with founders and tech leads

Ambitious, fast‑paced startup culture where initiative is rewarded

#J-18808-Ljbffr

Create a job alert for this search

Senior Infrastructure Engineer • San Francisco, CA, United States

Related jobs

Senior Cloud Infrastructure Engineer

Exploreomni • San Francisco, CA, United States

Full-time

Omni gives businesses one place to easily analyze all their data.Built by the teams behind Looker and Stitch, Omni combines data models, a point-and-click UI, spreadsheet formulas, and powerful vis...Show more

Last updated: 30+ days ago • Promoted

Senior Infrastructure Engineer

Crossing Hurdles • San Francisco, CA, United States

Full-time

This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Crossing Hurdles is a global recruitment consultancy ...Show more

Last updated: 4 days ago • Promoted

Senior Infrastructure Engineer

Sinclair Talent Solutions • San Francisco, CA, United States

Full-time

This range is provided by Sinclair Talent Solutions.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. We are helping a rapidly scaling startup bui...Show more

Last updated: 4 days ago • Promoted

Senior Infrastructure Engineer

Pump.co • San Francisco, CA, United States

Full-time

Cloud spend is a whopping $500 billion / yr, the biggest growing expense category for any tech company.Tackling these costs requires continuous effort and time from DevOps teams.Pump is building the ...Show more

Last updated: 1 day ago • Promoted

Principal Engineer, Catalog Infrastructure (Founding Team)

Attachments King • San Francisco, CA, United States

Full-time

Attachments King is an eCommerce startup in the Heavy Equipment Industry developing proprietary software that flexibly discovers compatibility between equipment and host machine components.We’re hi...Show more

Last updated: 15 days ago • Promoted

Senior Infrastructure Engineer - Bellevue or San Francisco

Aircall • San Francisco, CA, United States

Full-time

Aircall is the world’s leading integrated customer communications and intelligence platform for growing businesses.Trusted by over 20,000 companies worldwide, Aircall unifies voice and digital chan...Show more

Last updated: 30+ days ago • Promoted

Senior Infrastructure Engineer

Commerce • San Francisco, CA, United States

Full-time

Senior Infrastructure Engineer.Direct message the job poster from Commerce.Welcome to the Agentic Commerce Era.At Commerce, our mission is to empower businesses to innovate, grow, and thrive with o...Show more

Last updated: 30+ days ago • Promoted

Senior Cloud Infrastructure Engineer

Harrison Clarke • San Francisco, CA, United States

Full-time

Annual Bonus, Sign-on bonus, RSUs, and Stock options.Join a dynamic startup seeking an infrastructure specialist to design, scale, and maintain cutting-edge infrastructure that powers innovative di...Show more

Last updated: 4 days ago • Promoted

Software Infrastructure & Platform Engineer

PsiQuantum • Palo Alto, CA, United States

Full-time

Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more

Last updated: 30+ days ago • Promoted

Senior Cloud Infrastructure Engineer

The Recruiting Guy • San Francisco, CA, United States

Full-time

If this role is still posted then we are still recruiting and needing applications.Senior Cloud Infrastructure Engineer.Must live within commuting distance of San Francisco or be willing to relocat...Show more

Last updated: 4 days ago • Promoted

Staff ML Infrastructure Engineer

Cubiq Recruitment • San Jose, CA, US

Full-time

Staff / Lead ML Infrastructure Engineer.San Francisco, CA — Onsite.Salary - Over market average + equity.We are building one of the world’s leading generative video and multimodal AI pl...Show more

Last updated: 1 day ago • Promoted

Senior Infrastructure Engineer

Hamilton Barnes? • San Francisco, CA, United States

Full-time

Join a ground-breaking AI platform company, founded by top AI researchers and successful entrepreneurs, that is building the first Agentic AI Platform for SAP Custom Code.This critical infrastructu...Show more

Last updated: 14 hours ago • Promoted • New!

Senior Infrastructure Engineer

Djangojobs • San Francisco, CA, United States

Full-time

SentiLink is building the future of identity verification in the United States.The existing ways to determine if somebody is who they claim to be are too clunky, ineffective, and expensive, but we ...Show more

Last updated: 14 hours ago • Promoted • New!

Senior Infrastructure Engineer

Recruiting From Scratch • San Francisco, CA, United States

Full-time

Senior Infrastructure Engineer.Series A Venture-Backed Startup.Fully Remote (Option to work from NYC or Boston offices).Our client is a fast-growing, physician-founded healthtech startup on a missi...Show more

Last updated: 30+ days ago • Promoted

Senior Infrastructure Engineer San Francisco, CA

Pump • San Francisco, CA, United States

Full-time

Cloud spend is a whopping $500 billion / yr, the biggest growing expense category for any tech company - tackling these costs requires continuous effort and time from DevOps teams.Pump is building th...Show more

Last updated: 4 days ago • Promoted

Senior Infrastructure Engineer

Macroscope Inc. • San Francisco, CA, United States

Full-time

Macroscope aims to be the source of truth of what's happening for any company that builds software.Our mission is to give leaders clarity and engineers time. We help leaders understand how their pro...Show more

Last updated: 30+ days ago • Promoted

Senior Infrastructure Engineer - InfraOps

BitGo, Inc. • San Francisco, CA, United States

Full-time

BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...Show more

Last updated: 14 hours ago • Promoted • New!

Senior Infrastructure Engineer - InfraOps

BitGo • San Francisco, CA, United States

Full-time

Be among the first 25 applicants.BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regu...Show more

Last updated: 14 hours ago • Promoted • New!