Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • San Francisco, CA, United States
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • San Francisco, CA, United States
1 day ago
Job type
  • Full-time
Job description

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting‑edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed. Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte‑scale ingestion and inference system powering mission‑critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertise—someone who can teach, not be taught. You’ll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission‑critical deployments for commercial and federal entities with millions of public users
  • Architect and deliver horizontally scalable, fault‑tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
  • Oversee design and optimization of LLM‑driven data ingestion and retrieval workflows
  • Own optimization and tuning of high‑throughput, low‑latency production environments via async orchestration frameworks
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high‑performing team
  • Collaborate cross‑functionally with Product, Executive Leadership, and Customer Success

What You’ll Need to Be Successful

  • 10+ years in software engineering, 5+ years in management roles with large‑scale AI / ML systems and infrastructure
  • Expert‑level proficiency in Python and Golang, with 5+ years building production distributed systems
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask)
  • Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
  • In‑depth knowledge and hands‑on experience building scalable distributed architectures and high‑performance compute systems
  • Proven experience in multimodal ingestion pipelines within RAG platforms
  • Direct experience in designing, fine‑tuning, and optimizing LLMs for ingestion and retrieval workloads
  • Previous success managing engineering teams delivering production‑grade, HPC‑scale RAG systems
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on‑prem datacenter operations
  • Benefits for Full Time Employees

  • Remote first organization
  • 100% Company paid Health / Dental / Vision benefits for you and your dependents
  • Life Insurance, Short‑term and Long‑term Disability
  • 401k
  • Unlimited PTO
  • We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time. Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Manager Engineering • San Francisco, CA, United States

    Related jobs
    Senior Engineering Manager, Account Management Platform - ThousandEyes

    Senior Engineering Manager, Account Management Platform - ThousandEyes

    Cisco Systems, Inc. • San Francisco, CA, United States
    Full-time
    The application window is expected to close on : 12 / 18 / 25.NOTE : Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.Cisco ThousandEyes...Show more
    Last updated: 30+ days ago • Promoted
    Senior Engineering Manager, Foundations

    Senior Engineering Manager, Foundations

    Jobright.ai • San Francisco, CA, United States
    Full-time
    Senior Engineering Manager, Foundations.Be among the first 25 applicants.Senior Engineering Manager, Foundations.Jobright is an AI-powered career platform that helps job seekers discover the top op...Show more
    Last updated: 4 days ago • Promoted
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    PG Forsta • Emeryville, CA, United States
    Full-time
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Show more
    Last updated: 24 days ago • Promoted
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    Framework Computer Inc • San Francisco, CA, United States
    Full-time
    At Framework, we believe the time has come for products that are designed to last.Founded in San Francisco in 2020, our mission is to remake Consumer Electronics to respect people and the planet.We...Show more
    Last updated: 12 days ago • Promoted
    Senior Engineering Manager - Platform

    Senior Engineering Manager - Platform

    Rippling • San Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineering Manager, Compute Systems Software

    Senior Software Engineering Manager, Compute Systems Software

    General Motors • Mountain View, CA, United States
    Full-time
    Hybrid : This role is categorized as hybrid.This means the successful candidate is expected to report to Mountain View, CA, three times per week, at minimum. The Vehicle Experiences Engine (VEE) at G...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Engineering

    Senior Manager, Engineering

    Backbone • San Francisco, CA, United States
    Full-time
    At Backbone, we’re on a mission to redefine the way people play games.We create seamless, captivating experiences across mobile devices, tablets, TVs, and more. As we expand our product suite and in...Show more
    Last updated: 4 days ago • Promoted
    Senior Manager, Software Engineering Personalization and ML Enablement

    Senior Manager, Software Engineering Personalization and ML Enablement

    Upstart • San Mateo, California, USA
    Full-time
    Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstarts AI marketplace Upstart-powered banks and credit un...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Engineering Manager, Mapping

    Senior Engineering Manager, Mapping

    Lyft • San Francisco, CA, United States
    Full-time
    At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Mapping team at Lyft is ta...Show more
    Last updated: 1 day ago • Promoted
    Manager, Software Engineering, Computer Vision

    Manager, Software Engineering, Computer Vision

    Meta • Burlingame, CA, US
    Full-time
    Manager, Software Engineering, Computer Vision Join to apply for the Manager, Software Engineering, Computer Vision role at Meta Manager, Software Engineering, Computer Vision 2 weeks ago Be a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Hardware Engineering

    Senior Manager, Hardware Engineering

    Onto Innovation Inc. • Milpitas, CA, United States
    Full-time +1
    Senior Manager, Hardware Engineering page is loaded## Senior Manager, Hardware Engineeringlocations : Milpitas-CAtime type : Full timeposted on : Posted 3 Days Agojob requisition id : R-4644Ont...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineering Manager, Compute Systems Software

    Senior Software Engineering Manager, Compute Systems Software

    General Motors of Canada • Mountain View, CA, United States
    Full-time
    Hybrid : This role is categorized as hybrid.This means the successful candidate is expected to report to Mountain View, CA, three times per week, at minimum. Vehicle Experiences Engine (VEE).GM is tr...Show more
    Last updated: 1 day ago • Promoted
    Software Engineering Manager - Storage

    Software Engineering Manager - Storage

    Lambda • San Francisco, CA, United States
    Full-time
    We are seeking an experienced Software Engineering Manager with a history in the development of storage protocols and distributed storage systems to lead a team of Storage Software Engineers and Di...Show more
    Last updated: 30+ days ago • Promoted
    Applied AI Engineering Manager, Enterprise

    Applied AI Engineering Manager, Enterprise

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    AI is becoming vitally important in every function of our society.At Scale, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Software Engineering Payments and Experience

    Senior Manager, Software Engineering Payments and Experience

    Upstart • San Mateo, California, USA
    Full-time
    Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstarts AI marketplace Upstart-powered banks and credit un...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Engineering Manager, Deep Learning

    Senior Engineering Manager, Deep Learning

    Hayden AI • San Francisco, CA, United States
    Full-time
    Senior Engineering Manager, Deep Learning.At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real‑w...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    Early Warning Services LLC • San Francisco, CA, United States
    Full-time
    At Early Warning, we've powered and protected the U.As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hu...Show more
    Last updated: 10 hours ago • Promoted • New!
    Hardware Systems Engineering - Manager

    Hardware Systems Engineering - Manager

    Apple Inc. • Cupertino, CA, United States
    Full-time
    Cupertino, California, United States Hardware.In this role, the candidate will be working for the Hardware Validation Engineering (HVE) team on post-silicon hardware system validation of next gener...Show more
    Last updated: 11 hours ago • Promoted • New!