Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • San Francisco, California, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • San Francisco, California, United States
16 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    Create a job alert for this search

    Engineer • San Francisco, California, United States

    Related jobs
    Principal Software Engineer AI Platform

    Principal Software Engineer AI Platform

    Snorkel Ai • Redwood City, California, United States
    Full-time
    At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale.The AI land...Show more
    Last updated: 18 days ago • Promoted
    Engineer II - IAM Technologies

    Engineer II - IAM Technologies

    Exelixis • Alameda, CA, United States
    Full-time
    The Engineer II - Client Technology provides advanced engineering support across a broad range of technologies and platforms. This role plays a critical part in anticipating and resolving escalated ...Show more
    Last updated: 30+ days ago • Promoted
    HPC Linux Systems Administrator

    HPC Linux Systems Administrator

    Jobot • Berkeley, CA, US
    Full-time
    This Jobot Job is hosted by : Kurt Holzmuller.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. Salary : $120,000 - $180,000 per year.We are a leadi...Show more
    Last updated: 30+ days ago • Promoted
    Neurosurgery (Complex Spine) Opportunity- Redwood City

    Neurosurgery (Complex Spine) Opportunity- Redwood City

    HealthEcareers - Client • Redwood City, CA, USA
    Full-time
    The Permanente Medical Group, Inc.Northern and Central California and a 80-year tradition of providing quality medical care. The Permanente Medical Group is currently actively seeking a .A FEW REASO...Show more
    Last updated: 30+ days ago • Promoted
    AI Kernel Engineer

    AI Kernel Engineer

    Quadric, Inc • Burlingame, California, United States
    Full-time
    Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture.Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads...Show more
    Last updated: 15 days ago • Promoted
    ML Engineer

    ML Engineer

    Wispr Flow • San Francisco, California, United States
    Full-time
    Wispr Flow is making it as effortless to interact with your devices as talking to a close friend.Voice is the most natural, powerful way to communicate — and we’re building the interfaces to make t...Show more
    Last updated: 22 days ago • Promoted
    Backend Engineer

    Backend Engineer

    Layer • San Francisco, California, United States
    Full-time
    We want engineers who can build a team and a company, not just a best-in-class product.We believe that certainly takes broad technical competence across our tech stack, but it also takes harder to ...Show more
    Last updated: 30+ days ago • Promoted
    Chroma - Backend Engineer

    Chroma - Backend Engineer

    Ai Talent Flow • San Francisco, California, United States
    Full-time
    Scaling retrieval systems is a challenging engineering problem.Chroma's distributed data plane must support workloads appropriate to serving AI applications at scale, which involves scaling vector ...Show more
    Last updated: 30+ days ago • Promoted
    Embedded ML Engineer

    Embedded ML Engineer

    Sesame • San Francisco, California, United States
    Full-time
    Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer II, AI Box

    Software Engineer II, AI Box

    Box • Redwood City, California, United States
    Full-time
    Box (NYSE : BOX) is the leader in Intelligent Content Management.Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform ...Show more
    Last updated: 30+ days ago • Promoted
    Neurosurgery Opportunity (Complex Spine)

    Neurosurgery Opportunity (Complex Spine)

    Kaiser Permanente - The Permanente Medical Group, Inc. -Northern California • Redwood City, CA, United States
    Full-time
    The Permanente Medical Group, Inc.Northern and Central California and a 80-year tradition of providing quality medical care. The Permanente Medical Group is currently actively seeking a Neurosurgeon...Show more
    Last updated: 4 days ago • Promoted
    Performance ML Engineer : CUDA, GPU Systems

    Performance ML Engineer : CUDA, GPU Systems

    Relace • San Francisco, CA, US
    Full-time
    A tech company specializing in ML infrastructure is seeking a Machine Learning Engineer who excels at making models faster and more efficient through performance tuning and optimization.The ideal c...Show more
    Last updated: 18 days ago • Promoted
    Remote Backend Software Engineer : Go - AI Trainer ($80-$100 per hour)

    Remote Backend Software Engineer : Go - AI Trainer ($80-$100 per hour)

    Mercor • Redwood City, California, US
    Remote
    Part-time
    Mercor is hiring experienced Go Engineers • • to support a variety of high-impact research collaborations with leading AI labs. Freelancers will help improve AI systems through work extending coding b...Show more
    Last updated: 5 days ago • Promoted
    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831

    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831

    InsideHigherEd • Berkeley, California, United States
    Full-time
    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831.At the University of California, Berkeley, we are dedicated to fostering a community where everyon...Show more
    Last updated: 7 days ago • Promoted
    Machine Learing Engineer

    Machine Learing Engineer

    Influur • San Francisco Bay, California, United States
    Full-time
    Our mission is to make influencer marketing as measurable, predictable, and scalable as paid ads — and we're building the tech that powers it. Backed by top-tier investors and trusted by global bran...Show more
    Last updated: 9 days ago • Promoted
    Software Engineer, Machine Learning Infrastructure

    Software Engineer, Machine Learning Infrastructure

    Datologyai • Redwood City, California, United States
    Full-time
    Companies want to train their own large models on their own data.The current industry standard is to train on a random sample of your data, which is inefficient at best and actively harmful to mode...Show more
    Last updated: 30+ days ago • Promoted
    AI Kernel Engineer

    AI Kernel Engineer

    quadric, Inc • Burlingame, CA, US
    Full-time
    Quick Apply
    Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture.Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads...Show more
    Last updated: 16 days ago
    Backend Engineer, Models

    Backend Engineer, Models

    Meter • San Francisco, California, United States
    Full-time
    Networking is one of the most fundamental industries in all of technology.For the first time, Meter has unified the full networking stack. and now we are making it autonomous.Meter Zero is our neur...Show more
    Last updated: 30+ days ago • Promoted