Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • Chicago, Illinois, United States, 60601
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • Chicago, Illinois, United States, 60601
16 hours ago
Job type
  • Full-time
Job description

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : Were a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now were building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed.

Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte-scale ingestion and inference system powering mission-critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertisesomeone who can teach, not be taught. Youll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will :

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users.
  • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users.
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF).
  • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows.
  • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks.
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale.
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team.
  • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

What You'll Need to Be Successful :

  • 10+ years in software engineering, 5+ years in management roles with large-scale AI / ML systems and infrastructure.
  • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask) . Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar) .
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ) .
  • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
  • Proven experience in multimodal ingestion pipelines within RAG platforms.
  • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
  • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management.
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on-prem datacenter operations.
  • Benefits for Full Time Employees : - Remote first organization- 100% Company paid Health / Dental / Vision benefits for you and your dependents- Life Insurance, Short-term and Long-term Disability- 401k- Unlimited PTO

    We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.

    Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws.

    PI220486eddcd6-30511-39134746

    Create a job alert for this search

    Senior Manager Engineering • Chicago, Illinois, United States, 60601

    Related jobs
    Senior Manager, Data Engineering

    Senior Manager, Data Engineering

    Capital One • Chicago, IL, US
    Full-time +1
    Senior Manager, Data Engineering.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll b...Show more
    Last updated: 30+ days ago • Promoted
    Senior Full-Stack Engineering Leader — AWS & Cloud Transformation

    Senior Full-Stack Engineering Leader — AWS & Cloud Transformation

    Capital One • Chicago, IL, United States
    Full-time
    A major financial services company in Chicago is looking for a Senior Manager in Software Engineering.This role involves leading diverse technology projects, mentoring developers, and delivering cl...Show more
    Last updated: 3 days ago • Promoted
    Software Engineering Sr Manager - Payments Technology

    Software Engineering Sr Manager - Payments Technology

    Canadian Imperial Bank of Commerce • Chicago, IL, United States
    Full-time
    We’re building a relationship-oriented bank for the modern world.We need talented, passionate professionals who are dedicated to doing what’s right for our clients. At CIBC, we embrace your strength...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Software Engineering, Machine Learning - Capital One Software (Remote)

    Senior Manager, Software Engineering, Machine Learning - Capital One Software (Remote)

    Capital One • Chicago, IL, United States
    Remote
    Full-time +1
    Senior Manager, Software Engineering, Machine Learning - Capital One Software (Remote).Ever since our first credit card customer in 1994, Capital One has recognized that technology and data can ena...Show more
    Last updated: 8 days ago • Promoted
    Manager, Software Engineering, Full Stack (Global Payment Network)

    Manager, Software Engineering, Full Stack (Global Payment Network)

    Capital One • Deerfield, IL, US
    Full-time +1
    Manager, Software Engineering, Full Stack (Global Payment Network).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, colla...Show more
    Last updated: 28 days ago • Promoted
    Senior Manager, Software Engineering, Full Stack

    Senior Manager, Software Engineering, Full Stack

    Capital One • Chicago, IL, United States
    Full-time +1
    Senior Manager, Software Engineering, Full Stack.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusiv...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager - Accelerated Compute Memory Systems

    Senior Product Manager - Accelerated Compute Memory Systems

    Pryon • Chicago, Illinois, United States, 60601
    Full-time
    Senior Product Manager - Accelerated Compute Memory Systems.Were a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology...Show more
    Last updated: 16 hours ago • New!
    Software Engineering Manager - Desktop and Embedded Linux Optimisation

    Software Engineering Manager - Desktop and Embedded Linux Optimisation

    Canonical • Chicago, IL, United States
    Full-time
    Software Engineering Manager - Desktop and Embedded Linux Optimisation.Software Engineering Manager - Desktop and Embedded Linux Optimisation. Software Engineering Manager - Desktop and Embedded Lin...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineering Manager - Container and Virtualisation Infrastructure

    Software Engineering Manager - Container and Virtualisation Infrastructure

    Canonical • Chicago, IL, United States
    Full-time
    Software Engineering Manager - Container and Virtualisation Infrastructure.Software Engineering Manager - Container and Virtualisation Infrastructure. Software Engineering Manager - Container and Vi...Show more
    Last updated: 30+ days ago • Promoted
    Manager, Software Engineering Management

    Manager, Software Engineering Management

    ServiceNow, Inc. • Chicago, IL, United States
    Full-time
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...Show more
    Last updated: 1 day ago • Promoted
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    Capital One • Chicago, IL, US
    Full-time +1
    Senior Manager, Software Engineering.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and itera...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Software Engineering, Full Stack - Capital One Software (Remote)

    Senior Manager, Software Engineering, Full Stack - Capital One Software (Remote)

    Capital One • Chicago, IL, US
    Remote
    Full-time +1
    Senior Manager, Software Engineering, Full Stack - Capital One Software (Remote).Ever since our first credit card customer in 1994, Capital One has recognized that technology and data can enable ev...Show more
    Last updated: 30+ days ago • Promoted
    Linux Engineering Manager - Optimisation for Latest Hardware

    Linux Engineering Manager - Optimisation for Latest Hardware

    Canonical • Chicago, IL, United States
    Full-time
    Linux Engineering Manager - Optimisation for Latest Hardware.Linux Engineering Manager - Optimisation for Latest Hardware. Linux Engineering Manager - Optimisation for Latest Hardware.Be among the f...Show more
    Last updated: 30+ days ago • Promoted
    Sr Mgr Software Engineering

    Sr Mgr Software Engineering

    Medline Industries - Transportation & Operations • Northbrook, IL, US
    Full-time
    Medline Industries has an immediate opening for a highly experienced and motivated senior manager of Software Engineering to lead our team in modernizing our warehouse management system.As the Seni...Show more
    Last updated: 4 days ago • Promoted
    Senior Manager, Software Engineering, Back End

    Senior Manager, Software Engineering, Back End

    Capital One • Chicago, IL, US
    Full-time +1
    Senior Manager, Software Engineering, Back End.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive,...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineering Manager

    Software Engineering Manager

    Grubhub • Chicago, IL, United States
    Full-time
    Senior Talent Acquisition Partner at Grubhub & Wonder.Grubhub, part of Wonder Group Inc, is all about connecting hungry diners with our network of over 375,000 merchants nationwide.Innovative techn...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Software Engineering, Back End - Capital One Software (Remote)

    Senior Manager, Software Engineering, Back End - Capital One Software (Remote)

    Capital One • Chicago, IL, US
    Remote
    Full-time +1
    Senior Manager, Software Engineering, Back End - Capital One Software (Remote).Ever since our first credit card customer in 1994, Capital One has recognized that technology and data can enable even...Show more
    Last updated: 7 days ago • Promoted
    Manager, Software Engineering

    Manager, Software Engineering

    Circle • Chicago, IL, United States
    Full-time
    Be among the first 25 applicants.Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, near...Show more
    Last updated: 30+ days ago • Promoted