Talent.com
Principal AI/ML System Software Engineer
Principal AI/ML System Software Engineerd-Matrix • Santa Clara, CA, United States
Principal AI / ML System Software Engineer

Principal AI / ML System Software Engineer

d-Matrix • Santa Clara, CA, United States
30+ days ago
Job type
  • Full-time
Job description

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive , and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together , we can help shape the endless possibilities of AI.

Location

Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week.

Principal AI / ML System Software Engineer

What you will do

The role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will be responsible for the development, enhancement, and maintenance of the next-generation AI deployment software. You have had past experience working across all aspects of the full-stack toolchain and understand the nuances of what it takes to optimize and trade-off various aspects of hardware-software co-design. You are able to build and scale software deliverables in a tight development window. You will work with a team of system software experts to build out the deployment infrastructure, working closely with other software (ML, compilers) and hardware experts in the company.

What you will bring

Minimum

  • BS in Computer Science, Engineering, Math, Physics, or related degree with 12+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics, or related degree preferred with 6+ years
  • Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
  • Proficient in C / C++ / Python development in Linux environment and using standard development tools
  • Experience with distributed, high-performance software design and implementation
  • Self-motivated team player with a strong sense of ownership and leadership.

Preferred

  • MS or PhD in Computer Science, Electrical Engineering, or related fields
  • Experience with inference servers / model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
  • Experience with deep learning frameworks (such as PyTorch and TensorFlow)
  • Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.).
  • Experience with distributed systems collectives such as NCCL and OpenMPI
  • Experience with software testing fundamentals
  • Experience deploying ML workloads (LLMs, VLMs, NLP, etc.) on distributed systems.
  • Experience with Kubernetes, Ray, or other MLOps tools and techniques used from definition to deployment
  • Prior startup, small team, or incubation experience
  • Work experience at a cloud provider or AI compute / subsystem company
  • #LI-DL1

    Equal Opportunity Employment Policy

    d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

    d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Software Engineer • Santa Clara, CA, United States

    Related jobs
    Principal Software Engineer – AI Systems

    Principal Software Engineer – AI Systems

    Walmart Canada • Sunnyvale, CA, United States
    Full-time
    Balance functional requirements with non-functional goals such as reliability, latency, and security.Generative AI / LLMs • • in production. Strong coding skills in • •Python (preferred) • • and at least o...Show more
    Last updated: 19 days ago • Promoted
    Engineer - AI & ML

    Engineer - AI & ML

    Dish • Foster City, CA, United States
    Full-time
    EchoStar is reimagining the future of connectivity.Our business reach spans satellite television service, live-streaming and on-demand programming, smart home installation services, mobile plans an...Show more
    Last updated: 14 hours ago • Promoted • New!
    Principal Software Engineer, Managed AI

    Principal Software Engineer, Managed AI

    Crusoe • Sunnyvale, CA, US
    Full-time
    Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrif...Show more
    Last updated: 25 days ago • Promoted
    Principal Software Engineer-AI

    Principal Software Engineer-AI

    GoodLeap • San Francisco, CA, US
    Full-time
    GoodLeap is a technology company delivering best-in-class financing and software products for sustainable solutions, from solar panels and batteries to energy-efficient HVAC, heat pumps, roofing, w...Show more
    Last updated: 15 days ago • Promoted
    AI / ML Architect

    AI / ML Architect

    Cooley LLP • San Francisco, CA, United States
    Full-time
    Cooley is seeking an AI / ML Architect to join the Practice Engineering team within the Innovation department.As a leading technology law firm, Cooley is determined to become a leader in the digital ...Show more
    Last updated: 17 days ago • Promoted
    Principal / Senior Principal Machine Learning Engineer, AI Enablement

    Principal / Senior Principal Machine Learning Engineer, AI Enablement

    Genentech • San Francisco, CA, United States
    Full-time
    We advance science so that we all have more time with the people we love.It’s what drives us to innovate.To continuously advance science and ensure everyone has access to the healthcare they need t...Show more
    Last updated: 30+ days ago • Promoted
    Principal Machine Learning Engineer - Central AI

    Principal Machine Learning Engineer - Central AI

    Atlassian • San Francisco, CA, United States
    Full-time
    Atlassian is seeking a Principal Machine Learning Scientist to join our Central AI team located in Bellevue WA.The Central AI organization constructs the fundamental infrastructure, data pipeline, ...Show more
    Last updated: 30+ days ago • Promoted
    Founding AI / ML Engineer ( Personalisation )

    Founding AI / ML Engineer ( Personalisation )

    codax • San Francisco Bay Area, United States
    Full-time +1
    Founding AI / ML Engineer (Personalisation).SF Bay Area (hybrid) or In-Person ( Preferred ) .We’re building the reasoning layer for customer experience, a privacy-first, explainable system that under...Show more
    Last updated: 5 days ago • Promoted
    Machine Learning Systems Engineer, RL Engineering

    Machine Learning Systems Engineer, RL Engineering

    Menlo Ventures • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 30+ days ago • Promoted
    Principal DevOps Engineer - ML / AI Algorithms

    Principal DevOps Engineer - ML / AI Algorithms

    F. Hoffmann-La Roche Gruppe • Santa Clara, CA, United States
    Full-time
    At Roche you can show up as yourself, embraced for the unique qualities you bring.Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted ...Show more
    Last updated: 21 days ago • Promoted
    Principal ML Engineer

    Principal ML Engineer

    1010 Analog Devices Inc. • Rio Robles, CA, United States
    Full-time +1
    NASDAQ : ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologie...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI / ML Engineer - VC Backed Startups

    Principal AI / ML Engineer - VC Backed Startups

    SignalFire • San Francisco, CA, United States
    Full-time
    Join SignalFire’s Talent Network for Principal AI / ML Engineer Roles at VC-Backed Startups.AI, cybersecurity, healthtech, fintech, developer tools, and enterprise SaaS. We’re looking to connect with ...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Engineer, Intelligent Sensors

    Principal AI Engineer, Intelligent Sensors

    1010 Analog Devices Inc. • Rio Robles, CA, United States
    Full-time +1
    NASDAQ : ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologie...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer Software (AI tools - Developer Platform)

    Principal Engineer Software (AI tools - Developer Platform)

    Palo Alto Networks • Santa Clara, CA, US
    Full-time
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer a...Show more
    Last updated: 23 days ago • Promoted
    Machine Learning System Engineer

    Machine Learning System Engineer

    Signify Technology • San Jose, CA, United States
    Full-time
    Machine Learning System Engineer.An AI startup is seeking a Senior Systems Engineer to optimize deep learning performance at scale. In this role, you’ll work at the intersection of systems, infrastr...Show more
    Last updated: 30+ days ago • Promoted
    Principal - ML Architect

    Principal - ML Architect

    PHIZENIX • Redwood City, CA, United States
    Full-time
    Be among the first 25 applicants.As a Principal Architect, you will lead the design and evolution of intelligent, scalable systems for Multi-Agent Path Finding (MAPF). You’ll define architectural di...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI / ML System Software Engineer

    Principal AI / ML System Software Engineer

    d-Matrix • Santa Clara, CA, United States
    Full-time
    AI to power the transformation of technology.We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. We value humility and believe in direct communic...Show more
    Last updated: 30+ days ago • Promoted
    Principal - ML Architect

    Principal - ML Architect

    Phizenix • Redwood City, CA, US
    Full-time
    As a Principal Architect, you will lead the design and evolution of intelligent, scalable systems for Multi-Agent Path Finding (MAPF). You'll define architectural direction, integrate machine le...Show more
    Last updated: 30+ days ago • Promoted