Talent.com
Senior Infrastructure Software Engineer, Enterprise AI

Senior Infrastructure Software Engineer, Enterprise AI

Scale AI, Inc.San Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Scale GP is building the next generation of enterprise-grade Generative AI products. Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and deploy powerful Agentic workflows for Enterprise use cases. We're looking for a Senior Infrastructure Software Engineer to build and scale our core infrastructure in a fast-paced environment. This team is key to our mission, directly enabling the deployment of these agentic flows for our customers.This is a unique opportunity for an infrastructure leader who is passionate about defining the future of AI deployments. You will be at the forefront of the industry, solving complex, bleeding-edge problems in scalability, security, and developer efficiency. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.

What You'll Do :

  • Define the architectural patterns for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers.
  • Lead the infrastructure roadmap with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies.
  • Own the development and maintenance of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response.
  • Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization.
  • Solve the toughest engineering problems related to multi-tenancy, data isolation, and high-performance inference at a massive scale, taking end-to-end ownership across the full product lifecycle.

What We're Looking For :

  • Proven experience in a senior role, with 5+ years of full-time software engineering experience.
  • Deep understanding of modern infrastructure practices , including CI / CD, IaC (e.g., Terraform, Helm Charts), container orchestration (e.g., Kubernetes) and observability platforms (e.g., Datadog, Prometheus, Grafana).
  • Extensive experience with at least one major cloud provider (AWS, Azure, or GCP).
  • Strong knowledge of security and compliance in enterprise environments, with a focus on access management, data isolation, and customer-specific VPC setups.
  • Proficiency in Python or JavaScript / TypeScript, and SQL .
  • Bonus points : Hands-on experience and a passion for working with Agents, LLMs, vector databases, and other emerging AI technologies.
  • Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to : Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.

    Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is :

    $188,000 — $235,000 USD

    PLEASE NOTE : Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.

    About Us :

    At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Cisco, DLA Piper, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.

    We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

    We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and / or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.

    We comply with the United States Department of Labor's Pay Transparency provision .

    PLEASE NOTE : We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants' needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

    Create a job alert for this search

    Senior Software Engineer Ai • San Francisco, CA, United States

    Related jobs
    • Promoted
    Senior Infrastructure Engineer

    Senior Infrastructure Engineer

    Ariat InternationalSan Leandro, CA, US
    Full-time
    We are looking for a seasoned Senior Infrastructure Engineer to join our IT team and contribute to the design, deployment, and management of enterprise infrastructure systems.This role is critical ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Software Engineer, Security Infrastructure

    Senior Software Engineer, Security Infrastructure

    Parafin Inc.San Francisco, CA, United States
    Full-time
    At Parafin, we’re on a mission to grow small businesses.Small businesses are the backbone of our economy, but traditional banks often don’t have their backs. We build tech that makes it simple for s...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, Developer Infrastructure

    Senior Software Engineer, Developer Infrastructure

    SentrySan Francisco, CA, United States
    Full-time
    Bad software is everywhere, and we’re tired of it.Sentry is on a mission to help developers write better software faster so we can get back to enjoying technology. With more than $217 million in fun...Show moreLast updated: 27 days ago
    • Promoted
    Senior Software Engineer - Infrastructure

    Senior Software Engineer - Infrastructure

    QualifiedSan Francisco, CA, United States
    Full-time
    Qualified is the Agentic Marketing Platform for B2B companies.With Piper the AI SDR Agent, Qualified offers a whole new way to grow inbound pipeline. Piper operates across both the website and email...Show moreLast updated: 14 days ago
    • Promoted
    Software Engineer III, Infrastructure, Core

    Software Engineer III, Infrastructure, Core

    Google Inc.San Francisco, CA, United States
    Full-time
    Software Engineer III, Infrastructure, Core.Applicants in San Francisco : Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Franci...Show moreLast updated: 3 days ago
    • Promoted
    Senior Infrastructure Engineer - Bellevue or San Francisco

    Senior Infrastructure Engineer - Bellevue or San Francisco

    AircallSan Francisco, CA, United States
    Full-time
    Aircall is the world’s leading integrated customer communications and intelligence platform for growing businesses.Trusted by over 20,000 companies worldwide, Aircall unifies voice and digital chan...Show moreLast updated: 8 days ago
    • Promoted
    Software Engineer, Infrastructure

    Software Engineer, Infrastructure

    Menlo VenturesSan Francisco, CA, United States
    Full-time
    Biotechnology is rewriting life as we know it, from the medicines we take, to the crops we grow, the materials we wear, and the household goods that we rely on every day. But moving at the new speed...Show moreLast updated: 17 days ago
    • Promoted
    Software Engineer - AI Agent Infrastructure (Healthcare)

    Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthSan Jose, CA, US
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...Show moreLast updated: 2 days ago
    • Promoted
    Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

    Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthSunnyvale, CA, US
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...Show moreLast updated: 2 days ago
    • Promoted
    Senior Software Engineer, Core Infrastructure

    Senior Software Engineer, Core Infrastructure

    harvey.aiSan Francisco, CA, United States
    Full-time
    As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing and building new infrastructure systems while equally scaling and strengthening the existi...Show moreLast updated: 14 days ago
    • Promoted
    Software Engineer (Infrastructure)

    Software Engineer (Infrastructure)

    GreptileSan Francisco, CA, United States
    Full-time
    K – $210K • $75K – $125K Equity • Up to $25,000 in relocation assistance.Greptile is an AI code reviewer that catches bugs and anti-patterns in pull requests with complete context of the codebase.H...Show moreLast updated: 16 days ago
    • Promoted
    Senior Software Engineer, Application Infrastructure

    Senior Software Engineer, Application Infrastructure

    Brex Inc.San Francisco, CA, United States
    Full-time
    Senior Software Engineer, Application Infrastructure.Senior Software Engineer, Application Infrastructure.Brex is the AI-powered spend platform. We help companies spend with confidence with integrat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Infrastructure Engineer

    Senior Infrastructure Engineer

    GumloopSan Francisco, CA, United States
    Full-time
    Senior Infrastructure Engineer.As a senior infrastructure engineer, you'll be.Architecting, implementing and rolling out large-scale infrastructure projects independently.Helping define technical r...Show moreLast updated: 4 days ago
    • Promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Sift Stack, Inc.San Francisco, CA, United States
    Full-time
    At Sift, we’re redefining how modern machines are built, tested, and operated.Our platform gives engineers real-time observability over high-frequency telemetry—eliminating bottlenecks and enabling...Show moreLast updated: 30+ days ago
    • Promoted
    03 Senior Infra Engineer San Francisco

    03 Senior Infra Engineer San Francisco

    LlamaIndex Inc.San Francisco, CA, United States
    Full-time
    Unwavering Integrity with Purpose.We operate with honesty and stay true to our mission.We adapt quickly, solve creatively, and thrive in ambiguity. We think strategically and deliver results with ur...Show moreLast updated: 12 days ago
    • Promoted
    Senior Infrastructure Engineer

    Senior Infrastructure Engineer

    Macroscope Inc.San Francisco, CA, United States
    Full-time
    Macroscope aims to be the source of truth of what's happening for any company that builds software.Our mission is to give leaders clarity and engineers time. We help leaders understand how their pro...Show moreLast updated: 13 days ago
    • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    StackAISan Francisco, CA, United States
    Full-time
    As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end. Design and implement scalable backend architectures for AI workloads (infe...Show moreLast updated: 7 days ago
    • Promoted
    Principal Cloud and Infrastructure Architect - Digital

    Principal Cloud and Infrastructure Architect - Digital

    IntuitiveSunnyvale, CA, United States
    Full-time
    At Intuitive, we are united behind our mission : we believe that minimally invasive care is life-enhancing care.Through ingenuity and intelligent technology, we expand the potential of physicians to...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    LanceDBSan Francisco, CA, United States
    Full-time
    From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI appli...Show moreLast updated: 11 hours ago
    • Promoted
    Software Engineer II, Data Engineering & Infrastructure

    Software Engineer II, Data Engineering & Infrastructure

    Australian Competition and Consumer CommissionSan Francisco, CA, United States
    Full-time
    Aurora’s mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, m...Show moreLast updated: 16 days ago