Talent.com
Software Engineer, Systems ML - PyTorch Compiler, PyTorch Framework, PyTorch Performance

Software Engineer, Systems ML - PyTorch Compiler, PyTorch Framework, PyTorch Performance

METAMenlo Park, CA, United States
5 days ago
Job type
  • Full-time
Job description

This role is about developing the core PyTorch 2.0 technologies, innovating and advancing the state-of-the-art of ML compilers, and accelerating PT2 adoption through direct engagements with OSS and industry users. The PyTorch Compiler team is dedicated to making PyTorch run faster and more resource-efficient without sacrificing its flexibility and ease of use. The team is the driving force behind PT2, a step function change in PyTorch's history that brought compiler technologies to the core of PyTorch. PT2 technologies have gained industry-wide recognition since their first release in March 2023. The team is committed to building the PT2 compiler that withstands the test of time while striving to become the #1 ML framework compiler in the industry. The team is highly innovative, passionate about the technologies we build, and love to do technical work. Our work is open source, cutting-edge, and industry leading.

Software Engineer, Systems ML - PyTorch Compiler, PyTorch Framework, PyTorch Performance Responsibilities

  • Develop the PT2 compiler (e.g., TorchDynamo, TorchInductor, Export, PyTorch Core)
  • Improve PyTorch performance via systematic solutions for the entire community
  • Explore the intersection of the PyTorch compiler and PyTorch distributed
  • Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference)
  • Collaborate with users of PyTorch to enable new use cases of PT2 technologies both inside and outside Meta

Minimum Qualifications

  • Advanced in Python or C++ programming
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 4+ years of research or industry experience in developing compilers, ML systems, ML accelerators, GPU performance, and similar
  • Preferred Qualifications

  • Experience in developing PyTorch / PT2, Triton, MLIR, JAX, XLA, TVM is a huge plus
  • Knowledge in GPU architecture, ML accelerator performance, and developing high-performance kernels.
  • Experience in building OSS communities and extensive social media presence in the ML Sys domain.
  • Experience with training models, end-to-end model optimizations, or applying ML to systems.
  • Knowledge of communication collectives, PyTorch distributed, and parallelism.
  • Experience in developing inside other ML frameworks like Caffe2, TensorFlow, ONNX, TensorRT
  • For those who live in or expect to work from California if hired for this position, please click here for additional information.

    About Meta

    Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

    85,10 USD / hour to 251 000 USD / year + bonus + equity + benefits

    Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

    Equal Employment Opportunity

    Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here .

    Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form .

    Create a job alert for this search

    Software Engineer Ml • Menlo Park, CA, United States

    Related jobs
    • Promoted
    On Device ML Engineer : PyTorch Interoperability

    On Device ML Engineer : PyTorch Interoperability

    AppleCupertino, CA, United States
    Full-time
    Imagine being at the forefront of an evolution where innovative AI meets the elegance of Apple silicon.The On-Device Machine Learning team transforms groundbreaking research into practical applicat...Show moreLast updated: 1 day ago
    • Promoted
    Software Engineer - Perception Algorithm

    Software Engineer - Perception Algorithm

    TranzealNewark, CA, United States
    Full-time
    Top 3 Hard Skills Required + Years of Experience.Minimum 3 years experience with strong coding skills in Python and C++, with experience in real-time and high performance computing.Minimum 3 years ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, ML Performance

    Software Engineer, ML Performance

    OpenReqCupertino, CA, United States
    Full-time
    Etched is building AI chips that are hard-coded for individual model architectures.Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower laten...Show moreLast updated: 30+ days ago
    • Promoted
    Elasticsearch - Principal Software Engineer - Search Algorithms

    Elasticsearch - Principal Software Engineer - Search Algorithms

    ElasticMountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Platform Engineer

    Platform Engineer

    e2bSan Francisco, CA, United States
    Full-time
    Series A startup with 7-figure revenue.Our customers are companies like.Perplexity, Hugging Face, Manus, or Groq.We're building the next hyperscaler for AI agents. You will be building the next clou...Show moreLast updated: 8 hours ago
    • Promoted
    Principal Engineer Software (DLP Life Cycle (SDLC)

    Principal Engineer Software (DLP Life Cycle (SDLC)

    Palo Alto NetworksSanta Clara, CA, United States
    Full-time
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 2 days ago
    • Promoted
    Software Engineer, SystemML - Scaling / Performance

    Software Engineer, SystemML - Scaling / Performance

    METAMenlo Park, CA, United States
    Full-time
    In this role, you will be a member of the Network.AI Software team and part of the bigger DC networking organization.The team develops and owns the software stack around NCCL (NVIDIA Collective Com...Show moreLast updated: 7 days ago
    • Promoted
    ML Lead Engineer

    ML Lead Engineer

    Diverse LynxCupertino, CA, United States
    Full-time
    Machine Learning Implementations.Experience in ML Algorithms - Decision Trees, Radom Forest, XGBOOST etc.Experience in Structured Data Modelling. Experience in Statistical Techniques and EDA.Python ...Show moreLast updated: 30+ days ago
    • Promoted
    Performance Engineer

    Performance Engineer

    Syntricate TechnologiesSan Jose, CA, United States
    Full-time
    Strong capability of identifying performance hotspots and bottlenecks Advanced usage of perf, Client vTune and desirably AMDuProf Experience with continuous profiling (Gprofiler or Prometheus + Gra...Show moreLast updated: 15 days ago
    • Promoted
    Sr ML Compiler Engineer, Annapurna Labs

    Sr ML Compiler Engineer, Annapurna Labs

    AmazonCupertino, CA, United States
    Full-time
    The Product : AWS Machine Learning accelerators are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Inferentia chip delivers best-in-class ...Show moreLast updated: 30+ days ago
    • Promoted
    Founding Engineer, ML Performance & Systems

    Founding Engineer, ML Performance & Systems

    Isotron AISan Francisco, CA, United States
    Full-time
    We’re an early-stage stealth startup building a new kind of platform for generative media.Our mission is to enable the future of real-time generative applications : we’re building the foundational t...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Software Engineer, ML Inference Compiler & Deployment, Pre-Silicon

    Software Engineer, ML Inference Compiler & Deployment, Pre-Silicon

    TeslaPalo Alto, CA, United States
    Full-time
    As a Software Engineer within our Autonomy teams, you will contribute to one of the most advanced and widely deployed AI Platforms in the world for Autopilot and our Humanoid Robot, Optimus.In this...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Software Engineer, ML Inference Compiler & Deployment, AI Frameworks

    Software Engineer, ML Inference Compiler & Deployment, AI Frameworks

    TeslaPalo Alto, CA, United States
    Full-time
    As a Software Engineer within our Autonomy teams, you will contribute to one of the most advanced and widely deployed AI Platforms in the world, powering Autopilot and our Humanoid Robot, Optimus.I...Show moreLast updated: 12 hours ago
    • Promoted
    ML Software Engineer (Python Backend) Senior I / II, Staff

    ML Software Engineer (Python Backend) Senior I / II, Staff

    Albert InventOakland, CA, United States
    Full-time
    ML Engineer (Python Backend) - Sr.Welcome to the AI / ML team at Albert Invent!.A fast-growing and innovative company revolutionizing the chemical industry through a cutting-edge data management and ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer (ML Platform)

    Software Engineer (ML Platform)

    AnyscaleSan Francisco, California, United States
    Full-time
    Ray in their tech stacks to accelerate the progress of AI applications out into the real world.With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can s...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, Infrastructure (Onboard System & Toolchain)

    Software Engineer, Infrastructure (Onboard System & Toolchain)

    Pony.aiFremont, CA, United States
    Full-time
    Founded in 2016 in Silicon Valley, Pony.Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony. CNBC Disruptor list of the 50 most innovative and disruptive tech comp...Show moreLast updated: 30+ days ago
    • Promoted
    Senior / Staff Engineer (Python, LLM)

    Senior / Staff Engineer (Python, LLM)

    HirewellPalo Alto, CA, United States
    Permanent
    Salary Range : $175,000 - $200,000.Benefits : 401K (no match) Healthcare Vision Dental PTO Equity.Job Opportunity : Senior / Staff Engineer (Python, LLM). Develop and maintain software solutions using ...Show moreLast updated: 30+ days ago
    • Promoted
    ML Engineer

    ML Engineer

    RIT Solutions, Inc.Fremont, CA, United States
    Full-time
    Onsite in Fremont, CA (MUST BE LOCAL).In-depth knowledge of Python for high-performance data-intensive applications.Familiarity with at least one modern deep learning framework (Pytorch, Jax, Tenso...Show moreLast updated: 30+ days ago