Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • San Francisco, CA, United States
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • San Francisco, CA, United States
7 days ago
Job type
  • Full-time
Job description

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting‑edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed. Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte‑scale ingestion and inference system powering mission‑critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertise—someone who can teach, not be taught. You’ll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission‑critical deployments for commercial and federal entities with millions of public users
  • Architect and deliver horizontally scalable, fault‑tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
  • Oversee design and optimization of LLM‑driven data ingestion and retrieval workflows
  • Own optimization and tuning of high‑throughput, low‑latency production environments via async orchestration frameworks
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high‑performing team
  • Collaborate cross‑functionally with Product, Executive Leadership, and Customer Success

What You’ll Need to Be Successful

  • 10+ years in software engineering, 5+ years in management roles with large‑scale AI / ML systems and infrastructure
  • Expert‑level proficiency in Python and Golang, with 5+ years building production distributed systems
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask)
  • Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
  • In‑depth knowledge and hands‑on experience building scalable distributed architectures and high‑performance compute systems
  • Proven experience in multimodal ingestion pipelines within RAG platforms
  • Direct experience in designing, fine‑tuning, and optimizing LLMs for ingestion and retrieval workloads
  • Previous success managing engineering teams delivering production‑grade, HPC‑scale RAG systems
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on‑prem datacenter operations
  • Benefits for Full Time Employees

  • Remote first organization
  • 100% Company paid Health / Dental / Vision benefits for you and your dependents
  • Life Insurance, Short‑term and Long‑term Disability
  • 401k
  • Unlimited PTO
  • We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time. Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Manager Engineering • San Francisco, CA, United States

    Related jobs
    Ground Software & Systems Manager - Mission Operations (0346U), Space Sciences Laboratory - 81263

    Ground Software & Systems Manager - Mission Operations (0346U), Space Sciences Laboratory - 81263

    InsideHigherEd • Berkeley, California, United States
    Full-time
    Ground Software & Systems Manager - Mission Operations (0346U), Space Sciences Laboratory - 81263.At the University of California, Berkeley, we are dedicated to fostering a community where everyone...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Alivio Search Partners • Redwood City, California, United States
    Full-time
    Redwood City, California (On-site 35 days per week).Offers must be made within one week of application.Architect, build, and optimize distributed systems for warehousing, robotics, e-commerce, or l...Show more
    Last updated: 30+ days ago • Promoted
    Senior Engineering Manager - Observability

    Senior Engineering Manager - Observability

    Snowflake • Menlo Park, CA, US
    Full-time
    Snowflake is about empowering enterprises to achieve their full potential and people too.With a culture thats all in on impact, innovation, and collaboration, Snowflake is the sweet spot for build...Show more
    Last updated: 30+ days ago • Promoted
    Manager, Software Engineering, Computer Vision

    Manager, Software Engineering, Computer Vision

    META • Menlo Park, CA, United States
    Full-time
    Meta is seeking a highly motivated and experienced Software Engineering Manager to join our team.As a leader in the tech industry, we are looking for someone who can drive innovation, collaboration...Show more
    Last updated: 10 days ago • Promoted
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    Framework Computer Inc • San Francisco, CA, United States
    Full-time
    At Framework, we believe the time has come for products that are designed to last.Founded in San Francisco in 2020, our mission is to remake Consumer Electronics to respect people and the planet.We...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineering Manager — Lead Teams & Drive Innovation

    Senior Software Engineering Manager — Lead Teams & Drive Innovation

    Meta • Menlo Park, CA, United States
    Full-time
    A leading technology company in California is seeking an experienced Software Engineering Manager to lead a team of engineers, drive technical innovation, and develop strategies to meet business ob...Show more
    Last updated: 3 days ago • Promoted
    Senior Engineering Manager – St. Louis Tiger Team

    Senior Engineering Manager – St. Louis Tiger Team

    Boeing • Berkeley, California, USA
    Full-time +2
    Senior Engineering Manager St.Boeing Defense Space & Security (BDS).Louis Site Engineering Staffing Tiger Team located in. This dedicated Tiger Team was formed to centralize and accelerate hiri...Show more
    Last updated: 21 days ago • Promoted
    Senior Software Engineering Manager, Enterprise

    Senior Software Engineering Manager, Enterprise

    Nuna Inc • San Francisco, CA, United States
    Full-time
    At Nuna, our mission is to make high-quality healthcare affordable for everyone.We are dedicated to tackling one of our nation's biggest problems with ingenuity, creativity, and a keen moral compas...Show more
    Last updated: 10 days ago • Promoted
    Senior Software Engineering Manager – Hybrid DevOps Lead

    Senior Software Engineering Manager – Hybrid DevOps Lead

    Early Warning Services LLC • San Francisco, CA, United States
    Full-time
    A leading financial technology company is seeking a Senior Manager of Software Engineering in San Francisco.The role involves overseeing multiple engineering teams, ensuring adherence to Agile prac...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Engineering Manager - Accelerated Compute Memory Systems

    Senior Engineering Manager - Accelerated Compute Memory Systems

    Ring Inc • San Francisco, CA, United States
    Full-time
    We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leadi...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Manager, Solutions Engineering

    Senior Manager, Solutions Engineering

    Intercom • San Francisco, California, USA
    Full-time
    Intercom is the AI Customer Service company on a mission to help businesses provide incredible customer experiences.Our AI agent Fin the most advanced customer service AI agent on the market lets b...Show more
    Last updated: 5 days ago • Promoted
    Engineering Manager : AI Core & Platform Systems

    Engineering Manager : AI Core & Platform Systems

    Qualified • San Francisco, CA, US
    Full-time
    A leading technology firm in San Francisco is seeking an experienced Engineering Manager to lead AI Core & Product teams. This role focuses on developing scalable backend systems, integrating AI...Show more
    Last updated: 5 days ago • Promoted
    Engineering Manager, Compute

    Engineering Manager, Compute

    San Francisco Staffing • San Francisco, CA, US
    Full-time
    Engineering Manager, Compute Team.The Compute team powers everything that runs inside our platform.We provide the infrastructure and automation that enables engineers to build, ship, and operate se...Show more
    Last updated: 21 days ago • Promoted
    Senior Software Engineering Manager, Enterprise

    Senior Software Engineering Manager, Enterprise

    Nuna Inc. • San Francisco, CA, United States
    Full-time
    Senior Manager Software, Enterprise.Senior Manager Software, Enterprise.At Nuna, our mission is to make high-quality healthcare affordable for everyone. We are dedicated to tackling one of our natio...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Cloud Engineering

    Senior Manager, Cloud Engineering

    PG Forsta • Emeryville, CA, United States
    Full-time
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Show more
    Last updated: 2 days ago • Promoted
    Senior Manager, Software Engineering Payments and Experience

    Senior Manager, Software Engineering Payments and Experience

    Upstart • San Mateo, California, USA
    Full-time
    Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstarts AI marketplace Upstart-powered banks and credit un...Show more
    Last updated: 6 days ago • Promoted
    Senior Software Engineering Manager, Enterprise Systems

    Senior Software Engineering Manager, Enterprise Systems

    Verily Life Sciences • San Bruno, CA, United States
    Full-time
    Verily is a subsidiary of Alphabet that is using a data-driven approach to change the way people manage their health and the way healthcare is delivered. Launched from Google X in 2015, our purpose ...Show more
    Last updated: 10 days ago • Promoted
    Senior Software Engineering Manager, Enterprise Systems

    Senior Software Engineering Manager, Enterprise Systems

    Verily • San Bruno, CA, United States
    Full-time
    Senior Software Engineering Manager, Enterprise Systems page is loaded## Senior Software Engineering Manager, Enterprise Systemsremote type : Hybridlocations : San Bruno, Californiatime type : F...Show more
    Last updated: 12 hours ago • Promoted • New!