Talent.com
LLM Applications Engineer (Enterprise)
LLM Applications Engineer (Enterprise)Rise Technical Recruitment Limited • San Francisco, CA, United States
LLM Applications Engineer (Enterprise)

LLM Applications Engineer (Enterprise)

Rise Technical Recruitment Limited • San Francisco, CA, United States
21 days ago
Job type
  • Full-time
Job description

LLM Applications Engineer (DevTool Start-Up)

$120,000 - $180,000 + Equity + Benefits + PTO

San Francisco, CA

Are you passionate about building production‑grade application systems on top of large language models? Do you thrive in environments where you directly own customer‑facing infrastructure that ships alongside the fastest‑moving AI models in the world?

This is an opportunity to join a fast‑growing, profitable startup at the forefront of AI infrastructure, building the systems layer that powers how real customers deploy and use language models in production.

Backed by top‑tier investors and trusted by major enterprises, the team has built a unified API framework that makes it seamless for developers to integrate across multiple LLM providers. Now, they’re looking for a Founding Application / Systems Engineer to own the translation, rollout, and reliability of new models and endpoints across the platform.

As a founding member of the engineering team, you’ll take ownership of the customer‑facing systems layer, shaping how new LLM models, providers, and APIs are translated, normalized, and deployed. You’ll work closely with paying customers, internal teams, and the developer community to ensure new models are available, reliable, and production-ready from day one.

If you’re looking for a role where you can combine hands‑on systems engineering with real customer impact and directly influence the infrastructure that underpins modern AI applications, this is an outstanding opportunity.

The Role :

  • Own and resolve LLM translation issues for paid customers in production
  • Roll out support for new LLM models, providers, and endpoints across the platform
  • Lead day0 launches for new model releases from OpenAI, Anthropic, and Google
  • Implement and maintain translation and normalization logic across differing LLM APIs
  • Maintain provider integrations and ensure consistent behavior, reliability, and performance
  • Improve observability, error handling, and system resilience for AI driven workloads
  • Collaborate with internal teams and customers to turn real world usage into platform improvements

The Person :

  • Proficiency in Python and async frameworks
  • Strong familiarity with LLM APIs and application level translation or integration layers
  • Solid understanding of backend systems, API design, and distributed services
  • Comfortable owning production systems and debugging customer facing issues
  • #J-18808-Ljbffr

    Create a job alert for this search

    Application Engineer • San Francisco, CA, United States

    Similar jobs
    ML Systems Engineer : Distributed LLM Training & Inference

    ML Systems Engineer : Distributed LLM Training & Inference

    Scale AI • San Francisco, CA, United States
    Full-time
    A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experien...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Ops Engineer | Distributed Systems Lead

    Senior ML Ops Engineer | Distributed Systems Lead

    Baton Trucking, Inc. • San Francisco, CA, United States
    Full-time
    A leading logistics technology company in San Francisco is seeking a Staff Software Engineer - ML Ops to enhance its machine learning infrastructure. The role involves building robust distributed sy...Show more
    Last updated: 30+ days ago • Promoted
    Staff Applications Engineer - Contract Lifecycle Management (CLM)

    Staff Applications Engineer - Contract Lifecycle Management (CLM)

    Uber • San Francisco, CA, United States
    Full-time
    Staff Applications Engineer - Contract Lifecycle Management (CLM).Staff Applications Engineer - Contract Lifecycle Management (CLM). We are seeking an experienced and highly skilled staff applicatio...Show more
    Last updated: 8 days ago • Promoted
    Solutions Engineer - Enterprise - AMER

    Solutions Engineer - Enterprise - AMER

    Notion Labs, Inc • San Francisco, CA, United States
    Full-time
    Notion helps you build beautiful tools for your life's work.In today's world of endless apps and tabs, Notion provides one place for teams to get everything done, seamlessly connecting docs, notes,...Show more
    Last updated: 4 days ago • Promoted
    Senior LLM Engineer

    Senior LLM Engineer

    Conviva • Foster City, CA, United States
    Full-time
    Conviva is the first and best place to go to understand and optimize digital customer experiences.Our Operational Data Platform harnesses full-census, comprehensive client-side telemetry—capturing ...Show more
    Last updated: 30+ days ago • Promoted
    RTL Design Engineer

    RTL Design Engineer

    Apple • San Francisco, CA, United States
    Full-time
    Come and join Apple’s growing wireless silicon development team.Our wireless SoC organization is responsible for all aspects of wireless silicon development, emphasizing highly energy-efficient des...Show more
    Last updated: 4 days ago • Promoted
    LLM Training Frameworks and Optimization Engineer

    LLM Training Frameworks and Optimization Engineer

    Together AI • San Francisco, CA, United States
    Full-time
    LLM Training Frameworks and Optimization Engineer.LLM Training Frameworks and Optimization Engineer.LLM Training Frameworks and Optimization Engineer. LLM Training Frameworks and Optimization Engine...Show more
    Last updated: 30+ days ago • Promoted
    LLM Inference Engineer

    LLM Inference Engineer

    Periodic Labs • Menlo Park, CA, United States
    Full-time
    We are an AI + physical sciences lab building state of the art models to make novel scientific discoveries.We are well funded and growing rapidly. Team members are owners who identity and solve prob...Show more
    Last updated: 4 days ago • Promoted
    RTL Engineer, PCIe

    RTL Engineer, PCIe

    Eridu Corporation • San Francisco, CA, United States
    Full-time
    Eridu AI is a Silicon Valley-based hardware startup pioneering infrastructure solutions that accelerate training and inference for large-scale AI models. Today’s AI performance is frequently limited...Show more
    Last updated: 8 days ago • Promoted
    RTL Engineer, PCIe

    RTL Engineer, PCIe

    Eridu • San Francisco, CA, United States
    Full-time
    Eridu AI is a Silicon Valley-based hardware startup pioneering infrastructure solutions that accelerate training and inference for large-scale AI models. Today’s AI performance is frequently limited...Show more
    Last updated: 25 days ago • Promoted
    Software Engineer LMTS

    Software Engineer LMTS

    Salesforce, Inc. • San Francisco, CA, United States
    Full-time
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job CategorySoftware EngineeringJob Details • • • •Abo...Show more
    Last updated: 13 days ago • Promoted
    ML Infrastructure Engineer

    ML Infrastructure Engineer

    Openai • San Francisco, California, United States
    Full-time
    The Runtime team builds the low level framework components to power our ML training systems.We work on building robust, scalable, high performance components to support our distributed training wor...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk, Inc. • San Francisco, CA, United States
    Remote
    Full-time
    A leader in customer experience solutions is looking for a Senior ML Engineer to enhance their retrieval-augmented generation (RAG) platform. In this role, you will leverage the latest in LLM techno...Show more
    Last updated: 23 days ago • Promoted
    Senior ML Engineer - RAG & LLM Platform (Remote)

    Senior ML Engineer - RAG & LLM Platform (Remote)

    Zendesk Group • San Francisco, CA, United States
    Remote
    Full-time
    A leading customer experience software provider in San Francisco is looking for a Senior ML Engineer to enhance their retrieval-augmented generation platform. In this role, you will deliver AI-power...Show more
    Last updated: 23 days ago • Promoted
    Senior ML Engineer, Global Recommendations & LLMs (Hybrid)

    Senior ML Engineer, Global Recommendations & LLMs (Hybrid)

    Grindr LLC • San Francisco, CA, United States
    Full-time
    A leading LGBTQ+ connection platform is seeking an experienced ML Engineer to enhance their machine learning capabilities. This role involves architecting scalable recommendation systems and leverag...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Infrastructure Engineer — Low-Latency Production

    Senior ML Infrastructure Engineer — Low-Latency Production

    Twelve Labs Inc. • San Francisco, CA, United States
    Full-time
    A leading AI startup in San Francisco is seeking a Software Engineer in ML Infrastructure to enhance their video solutions and manage ML workflows. The ideal candidate will have over 6 years of expe...Show more
    Last updated: 29 days ago • Promoted
    Integrations Solutions Engineer - Remote

    Integrations Solutions Engineer - Remote

    Canals • San Francisco, CA, United States
    Remote
    Full-time
    A remote technology startup is seeking a Solutions Engineer responsible for implementing, integrating, and scaling systems for distributors. This role involves working closely with customers, explai...Show more
    Last updated: 20 days ago • Promoted
    Senior AI Engineer - LLM Systems for Enterprise

    Senior AI Engineer - LLM Systems for Enterprise

    Distyl AI, Inc. • San Francisco, CA, United States
    Full-time
    A cutting-edge AI technology firm in San Francisco is on the lookout for AI Engineers at all experience levels to build and deploy AI-native systems. You will be responsible for designing robust LLM...Show more
    Last updated: 27 days ago • Promoted