Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • Chicago, Illinois, United States, 60601
No longer accepting applications
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • Chicago, Illinois, United States, 60601
4 days ago
Job type
  • Full-time
Job description

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : Were a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now were building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed.

Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte-scale ingestion and inference system powering mission-critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertisesomeone who can teach, not be taught. Youll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will :

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users.
  • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users.
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF).
  • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows.
  • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks.
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale.
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team.
  • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

What You'll Need to Be Successful :

  • 10+ years in software engineering, 5+ years in management roles with large-scale AI / ML systems and infrastructure.
  • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask) . Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar) .
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ) .
  • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
  • Proven experience in multimodal ingestion pipelines within RAG platforms.
  • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
  • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management.
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on-prem datacenter operations.
  • Benefits for Full Time Employees : - Remote first organization- 100% Company paid Health / Dental / Vision benefits for you and your dependents- Life Insurance, Short-term and Long-term Disability- 401k- Unlimited PTO

    We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.

    Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws.

    PI220486eddcd6-30511-39134746

    Create a job alert for this search

    Senior Manager Engineering • Chicago, Illinois, United States, 60601

    Related jobs
    Senior Director – Global SaaS & Cloud Engineering

    Senior Director – Global SaaS & Cloud Engineering

    Coates Group • Chicago, IL, United States
    Full-time
    A leading technology firm is seeking a Senior Director of Engineering in Chicago.This role involves leading multiple engineering teams to implement scalable software and solutions while enhancing o...Show more
    Last updated: 8 hours ago • Promoted • New!
    Software Engineering Manager, Ads Creative Management

    Software Engineering Manager, Ads Creative Management

    Jobsanywhere • Chicago, IL, United States
    Full-time
    Reddit is a community of communities.It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote...Show more
    Last updated: 14 hours ago • Promoted • New!
    Director of Software Engineering (Multiple Positions Available)

    Director of Software Engineering (Multiple Positions Available)

    JPMorganChase • Chicago, IL, United States
    Full-time
    Director of Software Engineering (Multiple Positions Available).Director of Software Engineering (Multiple Positions Available). Drive all aspects of technology delivery by building and managing hig...Show more
    Last updated: 12 days ago • Promoted
    Restaurant Delivery - Sign Up in Minutes

    Restaurant Delivery - Sign Up in Minutes

    DoorDash • Tinley Park, IL, United States
    Full-time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show more
    Last updated: 26 days ago • Promoted
    Senior Manager, Systems Analysis

    Senior Manager, Systems Analysis

    Blue Cross Blue Shield Association • Chicago, IL, United States
    Full-time
    This role is responsible for the overall delivery of technical solutions initiatives.Serves as the primary point of contact for the delivery, operations, and support of complex technology solutions...Show more
    Last updated: 22 days ago • Promoted
    Director Software Engineering - US Based Remote

    Director Software Engineering - US Based Remote

    Anywhere Real Estate • Chicago, IL, United States
    Remote
    Full-time
    Director – Software Engineering – Experience Digital Channels.Are you a highly motivated and confident software engineer with a passion for cutting-edge technology and innovation? If yes, we have a...Show more
    Last updated: 2 hours ago • Promoted • New!
    Director, Software Engineering (Java 8, Kafka, AWS)

    Director, Software Engineering (Java 8, Kafka, AWS)

    Request Technology, LLC • Chicago, IL, United States
    Full-time +1
    Director, Software Engineering (Java 8, Kafka, AWS).Prestigious company seeking a Director, Software Engineering to lead a team focused on building event-driven solutions.Requires experience with J...Show more
    Last updated: 30+ days ago • Promoted
    Director, Software Engineering — Lead Cloud & Microservices

    Director, Software Engineering — Lead Cloud & Microservices

    Capital One National Association • Chicago, IL, United States
    Full-time
    A leading financial services company in Chicago is seeking a Director of Software Engineering to lead product-focused teams. The role requires proven experience in software development, people manag...Show more
    Last updated: 8 hours ago • Promoted • New!
    Linux Engineering Manager - Optimisation for Latest Hardware

    Linux Engineering Manager - Optimisation for Latest Hardware

    Canonical • Chicago, IL, United States
    Full-time
    Linux Engineering Manager - Optimisation for Latest Hardware.Linux Engineering Manager - Optimisation for Latest Hardware. Linux Engineering Manager - Optimisation for Latest Hardware.Be among the f...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineering Manager

    Software Engineering Manager

    Meredith • Chicago, IL, United States
    Full-time
    In-office Expectations : This position is hybrid in-office, with the ability to work remotely for up to 2 days per week.Allrecipes, BHG, MyRecipes, Food & Wine and more. People Inc reaches millions o...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineering Manager

    Software Engineering Manager

    Grubhub • Chicago, IL, United States
    Full-time
    Senior Talent Acquisition Partner at Grubhub & Wonder.Grubhub, part of Wonder Group Inc, is all about connecting hungry diners with our network of over 375,000 merchants nationwide.Innovative techn...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager, Enterprise ML & GenAI Platform

    Senior Manager, Enterprise ML & GenAI Platform

    United Airlines • Chicago, IL, United States
    Full-time
    A major airline in Chicago is seeking a Senior Manager - Machine Learning to lead the ML engineering and GenAI platform.You will drive architecture, development, and operations for scalable AI solu...Show more
    Last updated: 14 hours ago • Promoted • New!
    Manager, Software Engineering

    Manager, Software Engineering

    Zoro.com • Chicago, IL, United States
    Full-time
    Manager, Software Engineering at Zoro.This role leads a multi-year strategic initiative to modernize and decouple Zoros business systems from NetSuite, rebuilding key capabilities as standalone ser...Show more
    Last updated: 9 days ago • Promoted
    Director, Software Engineering : DevOps

    Director, Software Engineering : DevOps

    The Options Clearing Corporation • Chicago, IL, United States
    Full-time
    The Director of Application Release and Readiness Testing will provide strategic leadership for the organization's application deployment, validation, and production readiness programs.This role is...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager - Accelerated Compute Memory Systems

    Senior Product Manager - Accelerated Compute Memory Systems

    Medium • Chicago, IL, United States
    Full-time
    We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leadi...Show more
    Last updated: 2 days ago • Promoted
    Senior Full-Stack Engineering Leader : AWS & Microservices

    Senior Full-Stack Engineering Leader : AWS & Microservices

    Capital One • Chicago, IL, United States
    Full-time
    A leading financial technology company is seeking a Senior Manager Software Engineer in Chicago, IL.This role involves leading technology projects and a team of developers to create innovative solu...Show more
    Last updated: 6 days ago • Promoted
    Manager, Software Engineering

    Manager, Software Engineering

    Circle • Chicago, IL, United States
    Full-time
    Be among the first 25 applicants.Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, near...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineering Manager

    Software Engineering Manager

    Beyond Finance • Chicago, IL, United States
    Full-time
    At Beyond Finance, we've made it our mission to help everyday Americans escape the endless cycle of crippling debt and step into a brighter financial future. Through compassionate, individualized ca...Show more
    Last updated: 4 days ago • Promoted