Talent.com
Senior Software Engineer, Infrastructure (ML and Real-Time Speech)
Senior Software Engineer, Infrastructure (ML and Real-Time Speech)Otter.ai • Mountain View, CA, United States
Senior Software Engineer, Infrastructure (ML and Real-Time Speech)

Senior Software Engineer, Infrastructure (ML and Real-Time Speech)

Otter.ai • Mountain View, CA, United States
1 day ago
Job type
  • Permanent
Job description

The Opportunity

We're looking for an experienced Senior Software Engineer to join a team that empowers you to grow, be your authentic self, and do your best work every day. At Otter, we've built a platform that simplifies note taking, saves time, improves productivity and accessibility, and makes collaboration effortless. If this mission resonates with you, let's talk.

We need your help building the infrastructure that powers some of the most advanced multi-language, automatic speech recognition (ASR) and real-time speaker identification systems on the market. You'll design and scale the backend platforms that bring cutting-edge speech AI to life, working shoulder-to-shoulder with our machine learning researchers and product managers to deliver resilient, high-performance systems that enable real-time, multilingual AI experiences at scale.

If you're passionate about building rock-solid infrastructure for AI-driven products, enjoy solving complex distributed-systems problems, and want your work to have an immediate impact on millions of users, this is your opportunity.

Your Impact

  • Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features.
  • Architect scalable, fault-tolerant infrastructure across databases, queues, and pub / sub systems to support low-latency ML workflows.
  • Partner with ML teams to apply models into production (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference.
  • Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming.
  • Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations.
  • Collaborate with cross-functional teams to streamline developer experience, CI / CD pipelines, and automated testing for ML-backed services.

We're Looking for Someone Who

  • Has5+ years of experience designing and building scalable backend systems and distributed infrastructure.
  • Is fluent in Python (bonus for C++) and familiar with building high-performance services.
  • Understands data structures, algorithms, distributed systems, and operating systems at a deep level.
  • Has worked with databases (SQL & NoSQL), queuing systems, and pub / sub solutions, and knows what's happening "under the hood."
  • Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly.
  • Enjoys collaborating with ML engineers and product teams to translate research into production-ready systems.
  • Thrives in a fast-paced environment where innovation and reliability go hand in hand.
  • Nice to Haves

  • Experience with real-time streaming frameworks (Kafka, Pulsar, Flink).
  • Hands-on experience with container orchestration (Kubernetes, ECS).
  • Familiarity with SDK integrations or developer platform design.
  • Experience building or optimizing speech / voice AI pipelines.
  • About Otter.ai

    We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

    With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

    Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

    Accessibility & Accommodations

    Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

  • Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.
  • Salary range

    Salary Range : $185,000 to $230,000.00 USD per year.

    This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors. Our base salary is just one component of a comprehensive total rewards package.

    Create a job alert for this search

    Senior Software Engineer Infrastructure • Mountain View, CA, United States

    Related jobs
    Senior Software Engineer, Ads ML Infrastructure - USDS

    Senior Software Engineer, Ads ML Infrastructure - USDS

    Tik Tok • San Jose, CA, United States
    Full-time
    About the team The ads system at TikTok USDS operates on a massive scale and serves millions of advertisers, clients and influencers across the world. The quality of the ads system highly depends on...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Together Cloud Infrastructure

    Senior Software Engineer - Together Cloud Infrastructure

    Together AI • San Francisco, CA, United States
    Full-time
    Senior Software Engineer - Together Cloud Infrastructure.Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM in...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, ML Infra

    Senior Software Engineer, ML Infra

    Ambient • Redwood City, CA, United States
    Full-time
    AI-powered physical security platform helping the world's leading enterprises reduce risk, improve operational efficiency, and gain critical insights. Fortune 500 organizations, rely on Ambient.Our ...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer, ML Infrastructure, PrePlan

    Senior Software Engineer, ML Infrastructure, PrePlan

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 23 hours ago • Promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    TRM Labs • San Francisco, CA, United States
    Full-time
    Senior Software Engineer, Infrastructure.TRM Labs is a blockchain intelligence company committed to fighting crime and creating a safer world. By leveraging blockchain data, threat intelligence, and...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Space Infrastructure

    Senior Software Engineer - Space Infrastructure

    Loft Orbital Solutions • San Francisco, CA, United States
    Full-time
    As a Space Infrastructure Software Engineer, you are responsible for scaling our ability to operate a heterogeneous fleet of satellites—spanning dedicated, rideshare, and constellation missions.You...Show more
    Last updated: 25 days ago • Promoted
    Senior Software Engineer - Infrastructure

    Senior Software Engineer - Infrastructure

    Baseten • San Francisco, CA, United States
    Full-time
    Baseten powers inference for the world's most dynamic AI companies, like OpenEvidence, Clay, Mirage, Gamma, Sourcegraph, Writer, Abridge, Bland, and Zed. By uniting applied AI research, flexible inf...Show more
    Last updated: 27 days ago • Promoted
    Senior Software Engineer - ML Infrastructure

    Senior Software Engineer - ML Infrastructure

    Applied Intuition • Sunnyvale, CA, United States
    Full-time
    Applied Intuition is the vehicle intelligence company that accelerates the global adoption of safe, AI-driven machines.Founded in 2017 and now valued at $15 billion following its recent Series F fu...Show more
    Last updated: 23 hours ago • Promoted
    Senior Software Engineer, AI Infrastructure

    Senior Software Engineer, AI Infrastructure

    NVIDIA • Santa Clara, CA, United States
    Full-time
    NVIDIA DGX Cloud is a managed, multi-cloud AI supercomputing service that provides enterprises with instant access to NVIDIA's high-performance AI infrastructure and software, including dedicated D...Show more
    Last updated: 30+ days ago • Promoted
    Software Infrastructure & Platform Engineer

    Software Infrastructure & Platform Engineer

    PsiQuantum • Palo Alto, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Ads ML Infrastructure

    Senior Software Engineer, Ads ML Infrastructure

    Tik Tok • San Jose, CA, United States
    Full-time
    About the team The ads system at TikTok operates on a massive scale and serves millions of advertisers, clients and influencers across the world. The quality of the ads system highly depends on the ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Space Infrastructure

    Senior Software Engineer - Space Infrastructure

    Mvp VC • San Francisco, CA, United States
    Full-time
    As a Space Infrastructure Software Engineer, you are responsible for scaling our ability to operate a heterogeneous fleet of satellites—spanning dedicated, rideshare, and constellation missions.You...Show more
    Last updated: 23 days ago • Promoted
    Senior Software Engineer - Infrastructure, TikTok Search Engine

    Senior Software Engineer - Infrastructure, TikTok Search Engine

    Tik Tok • San Jose, CA, United States
    Full-time
    About the Team Our Search Team is responsible for building and owning TikTok's search engine, which provides our users the best search experience. On the TikTok Search Team, you'll have the opportun...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Decagon • San Francisco, CA, United States
    Full-time
    Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experience.Our AI agents provide intelligent, human‑like responses across chat, email, and voi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Sift Stack, Inc. • San Francisco, CA, United States
    Full-time
    At Sift, we’re redefining how modern machines are built, tested, and operated.Our platform gives engineers real-time observability over high-frequency telemetry—eliminating bottlenecks and enabling...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Performance, Offboard Infrastructure

    Senior Software Engineer, Performance, Offboard Infrastructure

    Nuro • Mountain View, CA, United States
    Full-time
    Nuro is a self-driving technology company on a mission to make autonomy accessible to all.Founded in 2016, Nuro is building the world's most scalable driver, combining cutting-edge AI with automoti...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer - Platform Infrastructure

    Senior Software Engineer - Platform Infrastructure

    King River Capital Group • San Francisco, CA, United States
    Full-time
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Software Engineer, Siri Speech

    Sr. Software Engineer, Siri Speech

    Apple • Cupertino, CA, United States
    Full-time
    The Siri Speech Platform team is building the platform and tools that enable us to deliver Siri’s state-of-the-art speech technology. We're seeking a Senior Software Engineer who is passionate about...Show more
    Last updated: 1 day ago • Promoted