Talent.com
Senior Network Engineer - Supercomputing
Senior Network Engineer - SupercomputingInstitute of Foundation Models • Sunnyvale, CA, US
Senior Network Engineer - Supercomputing

Senior Network Engineer - Supercomputing

Institute of Foundation Models • Sunnyvale, CA, US
14 days ago
Job type
  • Full-time
Job description

Job Description

Job Description

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

As part of IFM’s Supercomputing team, you will design, optimize, and maintain low-latency, high-bandwidth networking solutions that power some of the world’s largest GPU supercomputing clusters. You’ll work on both network software and systems that enable AI training and inference workloads, using cutting-edge technologies such as NVIDIA’s RDMA-capable solutions, InfiniBand, RoCE, and GPUDirect RDMA. Our integrated product stack covers the full lifecycle of network management—from metric collection and configuration deployment to zero-touch provisioning, real-time monitoring, alerting, and auto-remediation. You will also be responsible for investigating, debugging, and quickly resolving any network-side errors in collaboration with cross-functional teams, ensuring the highest degree of reliability and performance.

Job Responsibilities

  • Design & Optimization : Develop and tune RDMA-based communication systems leveraging NVIDIA GPUs, Mellanox NICs (InfiniBand, RoCE), and low-level networking technologies to support ultra-fast data transfers between nodes.
  • Performance Engineering : Implement and optimize GPUDirect RDMA to enable direct memory access between GPUs and network interfaces, minimizing CPU overhead.
  • Automation & Monitoring : Build network-aware software and observability tools with extensive metrics coverage, automate configuration management, and ensure robust, secure deployment pipelines through Infrastructure-as-Code (IaC) best practices.
  • Integration & Collaboration : Integrate RDMA solutions within Kubernetes-based workloads and containerized environments. Collaborate closely with AI researchers, network engineers, and infrastructure teams to accelerate data pipelines and optimize collective communications using NCCL, MPI, and SHARP.
  • Troubleshooting : Quickly investigate, debug, and resolve network-side issues across the full stack—from physical InfiniBand fabrics to high-level orchestration services—ensuring continuous operational excellence.

Tech Stack

  • Languages & Tools : Python, Go, Rust, C / C++
  • Networking Protocols & Technologies : TCP / IP, BGP, RDMA, InfiniBand, RoCE, SHARP, GPUDirect RDMA
  • AI & HPC Communication Frameworks : NCCL, MPI
  • Container & Orchestration : Kubernetes
  • Cluster Management : Slurm
  • Monitoring & Automation : Prometheus, Grafana, Ansible, Terraform
  • Hardware : NVIDIA GPUs, Mellanox networking solutions
  • Professional Experience

  • High-Performance Networks : Hands-on experience with NVIDIA RDMA technologies (e.g., GPUDirect RDMA, RoCE, InfiniBand) in HPC or AI supercomputing environments.
  • Job Scheduling & Cluster Management : Familiarity with Slurm workload manager and experience troubleshooting and optimizing network performance within Slurm-managed environments.
  • Advanced Communication Frameworks : Proven expertise in optimizing distributed systems using NCCL, SHARP, MPI, or similar frameworks tailored for GPU-accelerated workloads.
  • Programming & System Optimization : Proficiency in Python, Go, and low-level programming languages such as Rust, C, or C++ to design and optimize networking software.
  • Networking Fundamentals : In-depth knowledge of network protocols (TCP / IP, BGP, RDMA) and network architectures, both physical and logical.
  • Kubernetes & Containerization : Familiarity with Kubernetes networking and experience integrating RDMA into containerized environments.
  • Troubleshooting & Debugging : Strong analytical and debugging skills with a track record of rapidly resolving network-side errors and performance bottlenecks.
  • Collaboration & Metrics-Driven Approach : Experience working closely with network engineers and systems architects, using extensive metrics to drive prioritization and improvements.
  • Salary depends on level.

    Visa Sponsorship

    This position is eligible for visa sponsorship.

    Benefits Include

  • Comprehensive medical, dental, and vision benefits
  • Bonus
  • 401K Plan
  • Generous paid time off, sick leave and holidays
  • Paid Parental Leave
  • Employee Assistance Program
  • Life insurance and disability
  • Create a job alert for this search

    Senior Network Engineer • Sunnyvale, CA, US

    Related jobs
    Network Provisioning Engineer

    Network Provisioning Engineer

    VirtualVocations • Fremont, California, United States
    Full-time
    A company is looking for a Network Provisioning Engineer.Key Responsibilities Design, develop, and modify network solutions to ensure exceptional client experience and service delivery integrity ...Show more
    Last updated: 12 hours ago • Promoted • New!
    Network Engineer

    Network Engineer

    Qualys • Foster City, CA, United States
    Permanent
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.The successful applicant will be performing work in FedRAMP environments, and th...Show more
    Last updated: 30+ days ago • Promoted
    Senior Network Engineer

    Senior Network Engineer

    DigitalOcean, LLC • San Francisco, CA, United States
    Full-time
    Dive in and do the best work of your career at DigitalOcean.Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud.If you have a g...Show more
    Last updated: 4 days ago • Promoted
    Senior Network Engineering Consultant

    Senior Network Engineering Consultant

    Tubman Technologies Inc • san jose, CA, US
    Full-time
    Senior network engineer (contract position) onsite Location : San Jose, CA Dur : 6+ months The candidate should have the following skill sets with 10+years of exp Strong in routing & switching.Either...Show more
    Last updated: 9 days ago • Promoted
    Senior Infrastructure Engineer

    Senior Infrastructure Engineer

    VirtualVocations • Oakland, California, United States
    Full-time
    A company is looking for a Senior Infrastructure Engineer.Key Responsibilities Design, deploy, and maintain cloud infrastructure on AWS Develop and maintain Kubernetes clusters for running workl...Show more
    Last updated: 30+ days ago • Promoted
    Network System Engineer (27526)

    Network System Engineer (27526)

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 14 hours ago • Promoted • New!
    Network Engineer, Wired

    Network Engineer, Wired

    University of California - San Francisco Campus and Health • San Francisco, CA, United States
    Full-time
    The Network Engineer, Wired will play a crucial role in the Network Services team within Infrastructure Services to support the design, implementation, optimization, administration, and technical d...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Network Engineer

    Cloud Network Engineer

    VirtualVocations • Oakland, California, United States
    Full-time
    A company is looking for a Cloud Network Engineer to specialize in migrating networks to cloud infrastructures.Key Responsibilities Design and implement cloud networking infrastructure, including...Show more
    Last updated: 30+ days ago • Promoted
    Network Engineer

    Network Engineer

    VirtualVocations • Oakland, California, United States
    Full-time
    A company is looking for a Network Engineer to design, manage, and support a secure, cloud-based global network infrastructure. Key Responsibilities Design, manage, and optimize secure, cloud-base...Show more
    Last updated: 30+ days ago • Promoted
    IT Network Engineer

    IT Network Engineer

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Network System Engineer (27529)

    Network System Engineer (27529)

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 14 hours ago • Promoted • New!
    Network System Engineer (27527)

    Network System Engineer (27527)

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Network Monitoring Architect

    Senior Network Monitoring Architect

    VirtualVocations • Santa Clara, California, United States
    Full-time
    A company is looking for a Senior Network Monitoring Solutions Architect to support the deployment and optimization of network monitoring platforms. Key Responsibilities Assist with the deployment...Show more
    Last updated: 2 days ago • Promoted
    Senior Network Engineer

    Senior Network Engineer

    Qualys • Foster City, CA, United States
    Full-time
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.As a Sr Network Engineer, you will play a key role in developing and enhancing t...Show more
    Last updated: 30+ days ago • Promoted
    Network System Engineer (27528)

    Network System Engineer (27528)

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Cloud Engineer (Network)

    Senior Cloud Engineer (Network)

    Planet Labs PBC • San Francisco, CA, United States
    Full-time
    We believe in using space to help life on Earth.Planet designs, builds, and operates the largest constellation of imaging satellites in history. This constellation delivers an unprecedented dataset ...Show more
    Last updated: 8 days ago • Promoted
    Senior Networking Design Engineer

    Senior Networking Design Engineer

    Innominds Software Private Limited • SAN JOSE, CA, US
    Full-time
    Role / Title : Senior Networking Design Engineer Location : Mountain View, California Duration : 12 Months Job Description : How You Will Contribute : Specify & Design network infrastructure including rou...Show more
    Last updated: 23 days ago • Promoted
    Network Engineer

    Network Engineer

    Cooley LLP • San Francisco, CA, United States
    Full-time
    Cooley is seeking a Network Engineer to join the Technology Engineering team within the.Technology Infrastructure & Development Operations. As part of the Technology Network Engineering team, The Ne...Show more
    Last updated: 30+ days ago • Promoted