Talent.com
Member of Technical Staff, CUDA/GPU Kernel
Member of Technical Staff, CUDA/GPU KernelxAI • San Francisco, CA, US
No longer accepting applications
Member of Technical Staff, CUDA / GPU Kernel

Member of Technical Staff, CUDA / GPU Kernel

xAI • San Francisco, CA, US
17 hours ago
Job type
  • Full-time
Job description

Member of Technical Staff, CUDA / GPU Kernel

About xAI

xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

  • CUDA
  • CUTLASS
  • C / C++ and Python binding tools

Location

The role is based in the Bay Area [San Francisco and Palo Alto] or Seattle, WA. Candidates are expected to be located near the Bay Area or Seattle or open to relocation.

Focus

  • Developing and improving low-level CUDA kernel optimizations for state-of-the-art inference and training software stack.
  • Profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight.
  • Understanding GPU memory hierarchy and computation capabilities.
  • Implementing the latest methods from the deep learning literature in low-level CUDA kernels.
  • Innovating new ideas that bring us closer to the limits of a GPU.
  • Ideal Experiences

  • Building high-performance GeMM CUDA kernels using Tensor cores or CUDA cores from scratch or by utilizing CuTe / CUTLASS.
  • Implementing features for attention kernel by extending existing kernels or writing them from scratch.
  • Comfortable with writing both forward and backward kernels and ensuring its correctness while considering floating point errors.
  • Optimizing for both memory-bound and compute-bound operations.
  • Reasoning about register pressure, shared-memory usage and GPU utilization through tools such as Nsight and removing bottlenecks.
  • Being familiar with the latest and the most effective techniques in optimizing inference and training workloads.
  • Using pybind to integrate custom-written kernels into a framework, specially JAX / XLA.
  • Interview Process

    After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15-minute interview ("phone interview") during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of four technical interviews :

  • Coding assessment in a language of your choice.
  • Systems hands-on : Demonstrate practical skills in a live problem-solving session.
  • Project deep-dive : Present your past exceptional work to a small audience.
  • Meet and greet with the wider team.
  • Our goal is to finish the main process within one week. All interviews will be conducted via Google Meet.

    Annual Salary Range

    $180,000 - $440,000 USD

    Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

    Interested in building your career at xAI? Get future opportunities sent straight to your email.

    Apply for this job

    indicates a required field

    First Name

    Last Name

    Email

    Phone

    Resume / CV

    Enter manually

    Accepted file types : pdf, doc, docx, txt, rtf

    Current company

    If you are currently employed in the field, please tell us the name of your employer.

    If you are currently employed in the field, please tell us your role including your seniority level (e.g. Software Engineer II).

    LinkedIn Profile

    If you have a public LinkedIn profile, please provide its URL.

    X Profile

    If you have a public X profile, please provide its URL.

    If you have a Google Scholar page, please provide its URL.

    If you have a GitHub profile, please provide its URL.

    What exceptional work have you done?

    In 100 words or less, tell us about a piece of work you are most proud of.

    Will you now, or in the future, require sponsorship for employment visa status (e.g., H-1B visa) to legally work for X.AI LLC in the U.S.?

  • Select...
  • J-18808-Ljbffr

    Create a job alert for this search

    Member Staff • San Francisco, CA, US

    Related jobs
    Senior / Staff Backend Engineer

    Senior / Staff Backend Engineer

    Termina • Hayward, CA, US
    Full-time
    Termina's goal is to accumulate first-party data for all Venture-backed companies in the world.Private-Markets investment decisions happen in the dark, uninformed, and in many cases without obj...Show more
    Last updated: 15 days ago • Promoted
    Member of Technical Staff

    Member of Technical Staff

    MLabs • San Francisco, CA, US
    Full-time
    Quick Apply
    Member of Technical Staff (Platform Development, Construction Tech).Our client is a rapidly scaling construction work efficiency platform, leveraging. This is a high-impact, hands-on coding role whe...Show more
    Last updated: 15 days ago
    Member of Technical Staff, Image Generation

    Member of Technical Staff, Image Generation

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff

    Member of Technical Staff

    Care Dynamics, LLC • San Francisco, CA, US
    Full-time
    Member of Technical Staff – Product Engineer (Hybrid | San Francisco, CA).Join a high-impact AI team at a pivotal moment. In this hybrid San Francisco–based role, you’ll help build...Show more
    Last updated: 24 days ago • Promoted
    Member of Technical Staff, Enterprise

    Member of Technical Staff, Enterprise

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Senior Full-Stack Engineer

    Senior Full-Stack Engineer

    ClassDojo • San Francisco, CA, United States
    Full-time
    ClassDojo's goal is to give every child on Earth an education they love.We started by building a powerful network for communication. ClassDojo’s flagship app is the #1 communication app connecting K...Show more
    Last updated: 20 days ago • Promoted
    Sr. Technical Sourcer

    Sr. Technical Sourcer

    FocusKPI • Mountain View, CA, US
    Temporary
    Technical Recruiter to join one of our clients, a high-tech SaaS company.Technical Sourcer, who will be responsible for working closely with their engineering teams to build a strong candidate pipe...Show more
    Last updated: 30+ days ago • Promoted
    Hardware Technician

    Hardware Technician

    The Mice Groups, Inc. • Fremont, CA, US
    Full-time
    Hardware Support IT Rep / Contract position onsite in Fremont, CA / 1-2 months / 10-20 hours per week / W2 candidates only. Support and maintain in-house technology equipment and IT assets.This incl...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff, Recommendation Systems

    Member of Technical Staff, Recommendation Systems

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff, X Search

    Member of Technical Staff, X Search

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Staff Full-Stack Engineer

    Staff Full-Stack Engineer

    Ambience Healthcare, Inc. • San Francisco, CA, United States
    Full-time
    Ambience Healthcare is the leading AI platform for documentation, coding, and clinical workflow, built to reduce administrative burden and protect revenue integrity at the point of care.Trusted by ...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff - Frontend Engineer

    Member of Technical Staff - Frontend Engineer

    Liquid AI • San Francisco, CA, United States
    Full-time
    At Liquid, we’re not just building AI models—we’re redefining the architecture of intelligence itself.Spun out of MIT, our mission is to build efficient AI systems at every scale.Our Liquid Foundat...Show more
    Last updated: 4 hours ago • Promoted • New!
    Member of Technical Staff - Backend

    Member of Technical Staff - Backend

    MLabs • San Francisco, CA, US
    Full-time
    San Francisco, CA (Union Square).Our client, an AI company recently acquired by a major industry leader, builds a.GenAI-native platform that automates tax document processing.Their technology achie...Show more
    Last updated: 22 days ago • Promoted
    Member of Technical Staff (91839)

    Member of Technical Staff (91839)

    Rivos • Santa Clara, CA, US
    Full-time
    Responsible for writing high performance code and verifying the performance against hardware for deep learning and AI workloads. Run benchmarks or key customer workloads under simulation to identify...Show more
    Last updated: 14 days ago • Promoted
    Member of Technical Staff - Backend

    Member of Technical Staff - Backend

    Transparent Search Group • San Francisco, California, United States
    Full-time
    Quick Apply
    We're looking for an experienced Backend Software Engineer with 3+ years.You should have a proven track record of building high-performance, scalable backend systems and thrive in a fast-paced star...Show more
    Last updated: 23 days ago
    Member of Technical Staff, Grok Imagine

    Member of Technical Staff, Grok Imagine

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Senior Full-Stack Engineer, Member Benefits & Rewards

    Senior Full-Stack Engineer, Member Benefits & Rewards

    Social Finance, Inc. (SoFi) • San Francisco, CA, United States
    Full-time
    Senior Full-Stack Engineer for the Member Benefits and Rewards team.We are responsible for member-facing SoFi Plus benefits like credit card cash back and the 1% investment match.We are also respon...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff, Modeling

    Member of Technical Staff, Modeling

    Boson AI • Santa Clara, CA, US
    Full-time
    Boson AI is a startup building large language tools for audio understanding, generation, interaction and entertainment.Our founders, Alex Smola, Mu Li, and a team of Deep Learning, Optimization, NL...Show more
    Last updated: 14 days ago • Promoted