Talent.com
Senior Software Architect - Deep Learning and HPC Communications
Senior Software Architect - Deep Learning and HPC CommunicationsNVIDIA • Santa Clara, CA, United States
Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect - Deep Learning and HPC Communications

NVIDIA • Santa Clara, CA, United States
30+ days ago
Job type
  • Full-time
Job description

NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU our invention serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars.

What we are seeking :

We are the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.

DL and HPC applications have huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?

What you will be doing :

  • Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.
  • Design and implement new communication technologies to accelerate AI and HPC workloads.
  • Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects.
  • Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
  • Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs).

What we need to see :

  • M.S. / Ph.D. degree in CS / CE or equivalent experience.
  • 5+ years of relevant experience.
  • Excellent C / C++ programming and debugging skills.
  • Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
  • Deep understanding of operating systems, computer and system architecture.
  • Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
  • Strong experience with Linux.
  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
  • Ways to stand out from the crowd :

  • Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc.
  • Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications.
  • Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment.
  • The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

    You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

    NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Software Architect • Santa Clara, CA, United States

    Related jobs
    Senior Solution Architect - Simulation Solutions for Edge Computing

    Senior Solution Architect - Simulation Solutions for Edge Computing

    Nvidia Corporation • Santa Clara, CA, United States
    Full-time
    NVIDIA is seeking an outstanding Senior Solution Architect to contribute to the development of forward‑thinking simulation and AI platforms. Collaborate with internal and external teams to invent pi...Show more
    Last updated: 16 days ago • Promoted
    Senior Principal GenAI Software Lead Architect - Oracle Health (US REMOTE)

    Senior Principal GenAI Software Lead Architect - Oracle Health (US REMOTE)

    Oracle • Redwood City, CA, United States
    Remote
    Full-time
    Senior Principal AI Software Lead Architect - Oracle Health (remote or SF Bay).We are seeking a hands-on Software Architect with proven AI Agent platform experience to play a pivotal role in design...Show more
    Last updated: 9 days ago • Promoted
    Senior Software Architect, AI and HPC

    Senior Software Architect, AI and HPC

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    Senior Software Architect, AI and HPC page is loaded.Senior Software Architect, AI and HPC.Apply locations US, CA, Santa Clara US, TX, Remote US, WA, Remote US, CA, Remote US, OR, Remote time type ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Deep Learning

    Senior Software Engineer - Deep Learning

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    Senior Software Engineer - Deep Learning page is loaded## Senior Software Engineer - Deep Learninglocations : US, CA, Santa Claratime type : Full timeposted on : Posted Todayjob requisition id : ...Show more
    Last updated: 22 days ago • Promoted
    Senior Solution Architect, HPC and AI - NVIS

    Senior Solution Architect, HPC and AI - NVIS

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    NVIDIA is the world leader in computer graphics, artificial intelligence, and accelerated computing.For over 25 years, we have been at the forefront of research and engineering around the greatest ...Show more
    Last updated: 2 days ago • Promoted
    Senior Deep Learning Software Engineer

    Senior Deep Learning Software Engineer

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    Senior Deep Learning Software Engineer page is loaded## Senior Deep Learning Software Engineerlocations : US, CA, Santa Claratime type : Full timeposted on : Posted Todayjob requisition id : JR...Show more
    Last updated: 2 days ago • Promoted
    SoC Memory Subsystem Architect

    SoC Memory Subsystem Architect

    Baidu • Sunnyvale, CA, United States
    Full-time
    We are looking for a world-class Memory Subsystem Architect to join our SoC team at Baidu’s Sunnyvale office.The successful candidate will be a motivated self-starter who will thrive in this highly...Show more
    Last updated: 4 days ago • Promoted
    Senior Solution Architect, HPC and AI - NVIS

    Senior Solution Architect, HPC and AI - NVIS

    NVIDIA • Santa Clara, CA, United States
    Full-time
    Senior Solution Architect, HPC and AI - NVIS.Join to apply for the Senior Solution Architect, HPC and AI - NVIS role at NVIDIA. Do you want to be part of the team that brings Artificial Intelligence...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Architect - Data Center Systems

    Senior Software Architect - Data Center Systems

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    We are building innovative server systems for GPU accelerated applications, such as Deep Learning.Data Center SW team architects and develops the end to end software and firmware stack for these sy...Show more
    Last updated: 30+ days ago • Promoted
    Software Architect – Audio and Multimedia (ISD)

    Software Architect – Audio and Multimedia (ISD)

    MediaTek • San Jose, CA, United States
    Full-time
    Software Architect – Audio and Multimedia (ISD).Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. MediaTek Incorporated is a global fabless semiconducto...Show more
    Last updated: 4 days ago • Promoted
    Solution Architect - Presales

    Solution Architect - Presales

    Informatica LLC • Redwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous minds eager to solve the world's most...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Computer Vision and Deep Learning

    Senior Software Engineer, Computer Vision and Deep Learning

    Mashgin • Palo Alto, CA, US
    Full-time
    About Mashgin At Mashgin, we have developed a successful and innovative point-of-sale experience that uses computer vision and AI to make checkout nearly instantaneous. Our mission is to eliminate c...Show more
    Last updated: 30+ days ago • Promoted
    Senior Solutions Architect

    Senior Solutions Architect

    NVIDIA • Santa Clara, CA, United States
    Full-time
    NVIDIA is looking for an experienced network infrastructure Solutions Architect.Do you want to be part of a team that brings Artificial Intelligence (AI) hardware and software technologies to produ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Autonomy - Perception, Deep Learning

    Senior Software Engineer, Autonomy - Perception, Deep Learning

    Cyngn Inc. • Mountain View, CA, United States
    Full-time
    Based in Mountain View, CA, Cyngn is a publicly-traded autonomous technology company.We deploy self-driving industrial vehicles like forklifts and tuggers to factories, warehouses, and other facili...Show more
    Last updated: 30+ days ago • Promoted
    Presales Solution Architect

    Presales Solution Architect

    Informatica LLC • Redwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous, work-from-anywhere minds eager to so...Show more
    Last updated: 30+ days ago • Promoted
    Software Architect – Audio and Multimedia

    Software Architect – Audio and Multimedia

    MediaTek • San Jose, CA, United States
    Full-time
    Software Architect – Audio and Multimedia.MediaTek Incorporated is a global fabless semiconductor company that enables nearly 2 billion connected devices a year. MediaTek is a market leader in devel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Solution Architect – Simulation Solutions for Edge Computing

    Senior Solution Architect – Simulation Solutions for Edge Computing

    NVIDIA • Santa Clara, CA, United States
    Full-time
    Senior Solution Architect – Simulation Solutions for Edge Computing.Join NVIDIA as a Senior Solution Architect to contribute to the development of forward-thinking simulation and AI platforms, coll...Show more
    Last updated: 8 days ago • Promoted
    System Architect, Simulations & Models

    System Architect, Simulations & Models

    PsiQuantum • Palo Alto, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more
    Last updated: 30+ days ago • Promoted