Talent.com
Senior Software Engineer - Infrastructure
Senior Software Engineer - InfrastructureBaseten • Salida, CA, United States
Senior Software Engineer - Infrastructure

Senior Software Engineer - Infrastructure

Baseten • Salida, CA, United States
5 days ago
Job type
  • Full-time
Job description

About Baseten

Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including IVP, Spark Capital, Greylock, and Conviction, we're trusted by leading AI-driven innovators like Writer, Abridge, Bland, Patreon, Descript, Retool, and Zed to deliver industry-leading performance, security, and reliability for their mission-critical workloads. With our recent $75M Series C funding, we're growing fast to make AI accessible across all products.

The Role

As a Senior Infrastructure Software Engineer at Baseten, you'll architect and lead development of our ML inference platform that powers production AI applications. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.

Example Initiatives

You'll get to work on these types of projects as part of our Infrastructure team :

  • Multi-cloud capacity management
  • Inference on B200 GPUs
  • Multi-node inference
  • Fractional H100 GPUs for efficient model serving

Responsibilities

  • Design and architect scalable infrastructure systems for our ML inference platform
  • Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
  • Drive enhancements to our inference orchestration layer for complex model deployments
  • Define monitoring strategies for model performance, latency, and resource utilization
  • Develop advanced solutions for GPU capacity management and throughput optimization
  • Establish infrastructure automation standards to streamline ML deployment workflows
  • Partner with other engineers to translate complex inference requirements into technical solutions
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap
  • Requirements

  • Bachelor's degree or higher in Computer Science or related field
  • 5+ years experience building production infrastructure systems
  • Expert-level proficiency in Go, with Python experience a plus
  • Deep expertise with Kubernetes in production environments
  • Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus.
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Track record of leading technical initiatives and mentoring engineers
  • Experience with ML / AI workloads and MLOps platforms highly valued
  • Benefits

  • Competitive compensation package (Flexible PTO, 401k, covered healthcare premiums).
  • This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
  • An inclusive and supportive work culture that fosters learning and growth.
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
  • Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

    At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

    Create a job alert for this search

    Senior Software Engineer Infrastructure • Salida, CA, United States

    Similar jobs
    Software Engineer, macOS Core Product - Modesto, USA

    Software Engineer, macOS Core Product - Modesto, USA

    Speechify • Modesto, CA, US
    Full-time
    At Speechify, our mission is to ensure.Speechify's text-to-speech products—including apps on iOS, Android, macOS, Chrome, and web—to listen to PDFs, books, docs, and web content fas...Show more
    Last updated: 2 days ago • Promoted
    Custodial Services Manager - Facilities Planning, Maintenance & Transportation - Central Services

    Custodial Services Manager - Facilities Planning, Maintenance & Transportation - Central Services

    InsideHigherEd • Modesto, California, United States
    Full-time
    Custodial Services Manager - Facilities Planning, Maintenance & Transportation - Central Services.Yosemite Community College District / Central Services. Management Salary Schedule (2025-2026) Range 2...Show more
    Last updated: 3 days ago • Promoted
    Level II - Radiology Technologist

    Level II - Radiology Technologist

    Tenet North Cal • Turlock, CA, US
    Full-time
    Tenet North Cal is seeking a Radiology Technologist Level II for a job in Turlock, California.Job Description & Requirements. Up to $15,000 Sign-On bonus based on experience! .Welcome to Em...Show more
    Last updated: 30+ days ago • Promoted
    Emergency Medicine - Residency Program Director

    Emergency Medicine - Residency Program Director

    Kaiser Permanente - The Permanente Medical Group, Inc. -Northern California • Modesto, US
    Full-time
    Additional potential incentives up to.Reduced schedules (with pro-rated compensation) may be available.Some incentive opportunities are estimates based on potential premium pay.Kaiser Permanente / ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Fiat Rails

    Senior Software Engineer, Fiat Rails

    Paxos • Salida, CA, United States
    Full-time
    Join Our Team as a Senior Software Engineer!.Are you a passionate software engineer looking for an exciting opportunity? We are seeking a talented individual to join our team as a Senior Software E...Show more
    Last updated: 1 day ago • Promoted
    Business Account Executive

    Business Account Executive

    SPECTRUM • TURLOCK, California, United States
    Full-time
    This role requires the ability to work lawfully in the U.As a Spectrum B2B Outside Sales Account Executive, you will sell Spectrum’s internet, voice and video services to small businesses door-to-d...Show more
    Last updated: 2 days ago • Promoted
    Retail Sales Associate

    Retail Sales Associate

    Verizon • Turlock, CA, United States
    Full-time +1
    A place to share your ideas freely - even if they're daring or different.Where the true you can learn, grow, and thrive.At Verizon, we power and empower how people live, work and play by connecting...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Employed Hem Onc | Northern California | Up to 626K base | Fellowship Stipend

    Employed Hem Onc | Northern California | Up to 626K base | Fellowship Stipend

    Jackson Physician Search • Turlock, CA, US
    Full-time
    Join a newly renovated cancer center in California's Central Valley! This opportunity is an excellent choice for a board eligible / certified physician to join an experienced cancer team of two phy...Show more
    Last updated: 2 days ago • Promoted
    Operator Technician - Raw / FG - Entry

    Operator Technician - Raw / FG - Entry

    Blue Diamond Growers • Turlock, CA, United States
    Full-time +1
    Targeted Base Salary Range (if applicable) : .In 1910 a cooperative of 230 California almond growers formed with the following core values : . To build strong relationships among growers and with their ...Show more
    Last updated: 15 days ago • Promoted
    Sr. Continuous Improvement Engineer (West Coast Based)

    Sr. Continuous Improvement Engineer (West Coast Based)

    Divert • Turlock, CA, US
    Full-time
    Ideal candidates for this position will be located on the West Coast and will travel to and partner with our facilities across the US up to 30% annually. Applicants who are located on the West Coast...Show more
    Last updated: 2 days ago • Promoted
    Travel Surgical Tech - $1,825 per week in Oakdale, CA

    Travel Surgical Tech - $1,825 per week in Oakdale, CA

    AlliedTravelCareers • Oakdale, CA, US
    Full-time
    AlliedTravelCareers is working with Medical Solutions to find a qualified Surg Tech in Oakdale, California, 95361!.A facility in Oakdale, CA is seeking its next amazing Surgical Tech.Read on if thi...Show more
    Last updated: 8 hours ago • Promoted • New!
    Community Hospital Pathologist

    Community Hospital Pathologist

    Sante Consulting LLC • Modesto, CA, US
    Full-time
    Quick Apply
    Community Hospital Pathologist.Community Hospital Pathologist.This collegial, team-based practice is committed to excellence in patient care and diagnostic services. The position offers the chance t...Show more
    Last updated: 30+ days ago • Promoted
    Software Development Engineer

    Software Development Engineer

    Amazon • Modesto, CA, USA
    Full-time
    Join Amazon's engineering team and help us build innovative solutions to complex problems.As a Software Development Engineer, you will design, develop, and test software applications and services.W...Show more
    Last updated: 30+ days ago • Promoted
    Senior Estimator - Structural Steel

    Senior Estimator - Structural Steel

    Weldway Steel Fabrication • Oakdale, CA, United States
    Full-time
    In order to make an application, simply read through the following job description and make sure to attach relevant documents. The Senior Structural Steel Estimator is responsible for preparing accu...Show more
    Last updated: 5 hours ago • Promoted • New!
    Complete Online Surveys For Cash (Up to $25 / per)

    Complete Online Surveys For Cash (Up to $25 / per)

    Earn Haus • Newman, CA, US
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show more
    Last updated: 2 days ago • Promoted
    Structural Project Engineer—Engineering Excellence Starts Here

    Structural Project Engineer—Engineering Excellence Starts Here

    TETER, Inc • Modesto, CA, USA
    Full-time
    Quick Apply
    Fresno, Visalia, Bakersfield, or Modesto, California.TETER is seeking a highly skilled and motivated.Structural Project Engineer I–II. This role is ideal for a licensed Structural Engineer wit...Show more
    Last updated: 30+ days ago
    Radiology Tech II

    Radiology Tech II

    Emanuel Medical Ctr • Hughson, CA, US
    Full-time
    Up to $15,000 Sign-On bonus based on experience!.Welcome to Emanuel Medical Center!.Since 1917, Emanuel has been the heart of healthcare in Turlock, California, providing incredible high-quality ca...Show more
    Last updated: 21 days ago • Promoted
    Professional Land Surveyor ( County / City Surveyor)

    Professional Land Surveyor ( County / City Surveyor)

    Willdan Group, Inc. • Modesto, CA, United States
    Full-time
    The future is now, Willdan is "Envisioning the Future" of clean energy and infrastructure as well as sustainability through our work with cities, buildings, and transportation.Willdan is a national...Show more
    Last updated: 6 hours ago • Promoted • New!