Talent.com
Slurm Administration & Systems Architecture (Sonoma)

Slurm Administration & Systems Architecture (Sonoma)

MidjourneySonoma, CA, United States
21 days ago
Job type
  • Full-time
Job description

Overview

We are seeking a highly skilled HPC / AI / ML Cluster Engineer to support the design, deployment, and ongoing operations of large-scale HPC environments powered by Slurm. This role centers on cluster engineering, administration, and performance optimization, with emphasis on GPU-accelerated computing, advanced networking, and workload scheduling. In this role, you will work closely with our researchers, vendors, and partners to manage Slurm clusters that are used for AI / ML workloads.

Responsibilities

Cluster Engineering & Deployment

  • Participate in the design and bring-up of bare metal HPC / AI / ML environments
  • Architect compute node definitions (NUMA, GRES GPU topologies, CPU pinning) and Slurm partitioning strategies for diverse workloads.
  • Integrate heterogeneous hardware platforms into cohesive scheduling environments.
  • Develop provisioning and imaging workflows (Ansible, MAAS, cloud-init, CI / CD pipelines) for reproducible cluster build-out.
  • Coordinate communications between vendors, researchers, and other partners during cluster bring-up and operation.

Slurm Management

  • Configure and operate the Slurm Workload Manager.
  • Build custom Slurm plugins and scripts (epilog / prolog, pam_slurm_adopt) to extend functionality and integrate with authentication, and monitoring.
  • Manage federated Slurm setups across multi-site or hybrid cloud environments.
  • System Administration & Monitoring

  • Administer Linux HPC environments, including network configuration, storage integration, and kernel tuning for HPC workloads.
  • Deploy and maintain observability stacks for system health, GPU metrics, and job monitoring.
  • Automate failure detection, node health checks, and job cleanup to ensure high uptime and reliability.
  • Manage security and access control (LDAP / SSSD, VPN, PAM, SSH session auditing).
  • User & Stakeholder Support

  • Assist cluster users with developing workflows that make efficient use of compute resources.
  • Containerize HPC applications with Docker / Podman / Enroot-Pyxis and integrate GPU-aware runtimes into Slurm jobs.
  • Automate cost accounting and cluster usage reporting.
  • Qualifications

  • 7+ years experience in HPC cluster administration and engineering, with deep knowledge of Slurm.
  • Familiarity with common AI / ML software package dependencies and workflows
  • Expert in Slurm configuration, partition design, QoS / preemption policies, and GRES GPU scheduling.
  • Strong background in Linux system administration, networking, and performance tuning for HPC environments.
  • Hands-on experience with parallel file system, advanced networking (InfiniBand, RoCE, 100 / 200 GbE), and monitoring stacks.
  • Proficient with automation tools (Ansible, Terraform, CI / CD pipelines) and version control.
  • Demonstrated ability to operate GPU-accelerated clusters at scale.
  • Create a job alert for this search

    System Administration • Sonoma, CA, United States

    Related jobs
    • Promoted
    Travel Speech Language Pathologist (SLP) - $2,455 per week in Suisun City, CA

    Travel Speech Language Pathologist (SLP) - $2,455 per week in Suisun City, CA

    AlliedTravelCareersSuisun City, CA, US
    Full-time
    AlliedTravelCareers is working with Cross Country Allied to find a qualified Speech Language Pathologist (SLP) in Suisun City, California, 94585!. As a home health speech-language pathologist, you'l...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer - AI Agent Infrastructure (Healthcare)

    Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthSanta Rosa, CA, US
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...Show moreLast updated: 10 days ago
    • Promoted
    Supervising Engineer

    Supervising Engineer

    Coastland | DCCMSanta Rosa, CA, US
    Full-time
    Coastland | DCCM has an immediate opening for a Supervising Engineer involves delivering engineering review services to public agency clients. The Supervising Engineer oversees a team of professiona...Show moreLast updated: 8 days ago
    • Promoted
    Middleware Engineer

    Middleware Engineer

    Vsolutions TechnologiesSanta Rosa, CA, US
    Full-time
    Position : Sr Middleware Engineer.Location : Oakland, CA, Rancho Cordova, CA or Alpharetta, GA(Hybrid).Performs as an individual contributor of middleware team that builds and supports exceptional cu...Show moreLast updated: 8 days ago
    • Promoted
    Senior MLE

    Senior MLE

    HarnhamSanta Rosa, CA, US
    Full-time
    Senior Machine Learning Engineer.A leading commerce marketplace with 130M+ users and billions of daily events is hiring a. Senior Machine Learning Engineer.Their marketplace connects buyers and sell...Show moreLast updated: 8 days ago
    • Promoted
    Houseparents - Relocation to Hershey, PA Required

    Houseparents - Relocation to Hershey, PA Required

    Milton Hershey SchoolWindsor, CA, United States
    Full-time
    Milton Hershey School (MHS) is one of the world's best private schools, where students in pre-K through 12th grade from disadvantaged backgrounds receive an exceptional career-focused education wit...Show moreLast updated: 30+ days ago
    • Promoted
    Customs and Border Protection Officer

    Customs and Border Protection Officer

    U.S. Customs and Border ProtectionMiddletown, CA, United States
    Full-time
    Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to work with an elite team of highly trained professionals whose camaraderie, p...Show moreLast updated: 30+ days ago
    • Promoted
    Dean - College of Engineering

    Dean - College of Engineering

    InsideHigherEdBerkeley, California, United States
    Full-time
    The budgeted salary range that the University reasonably expects to pay for this position is $400,000-$675,000.Screening of complete applications will begin immediately. This position is open until ...Show moreLast updated: 22 days ago
    • Promoted
    Night Auditor

    Night Auditor

    SolageCalistoga, CA, US
    Full-time
    Set on 22 acres in Calistoga, Solage, Auberge Collection blends small-town charm with effortless sophistication.This vibrant, design-forward retreat offers a fresh take on wine country luxury with ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

    Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthSanta Rosa, CA, US
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...Show moreLast updated: 10 days ago
    • Promoted
    Senior R&D Engineer, Med Device

    Senior R&D Engineer, Med Device

    Eliassen GroupSanta Rosa, CA, US
    Full-time
    BUSINESS PROBLEM, CONTEXT & INITIATIVE DESCRIPTION.Our client is a privately held medical device company based in Northern California growing rapidly in the development of disease-modifying the...Show moreLast updated: 10 days ago
    • Promoted
    Youth Development Specialist - Relocation to Hershey, PA Required

    Youth Development Specialist - Relocation to Hershey, PA Required

    Milton Hershey SchoolWindsor, CA, United States
    Full-time
    Milton Hershey School (MHS) is one of the world's best private schools, where students in pre-K through 12th grade from disadvantaged backgrounds receive an exceptional career-focused education wit...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Registered Nurse - Administration / Management - $2,404 to $2,604 per week in St. Helena, CA

    Travel Registered Nurse - Administration / Management - $2,404 to $2,604 per week in St. Helena, CA

    TravelNurseSourceSt. Helena, CA, US
    Full-time
    TravelNurseSource is working with Titan Medical Group to find a qualified Admin / Mgmt RN in St.Travel Nurse RN - Case Management. Titan Medical is looking for travelers to fill a Travel Case Manageme...Show moreLast updated: 4 days ago
    • Promoted
    Embedded Systems Engineer III

    Embedded Systems Engineer III

    RIX INDUSTRIESBenicia, CA, United States
    Full-time
    RIX Industries is a technology-focused company specializing in the design, development and manufacturing of gas generation systems, precision compressor solutions, and cryogenic cooling technologie...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Director of Design & Advanced Development

    Senior Director of Design & Advanced Development

    SharkNinjaAlbany, CA, US
    Full-time
    SharkNinja is a global product design and technology company, with a diversified portfolio of 5-star rated lifestyle solutions that positively impact people’s lives in homes around the world.Powere...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Solutions Engineer

    Senior Solutions Engineer

    Storm3Sonoma, CA, US
    Full-time
    F4BC; Series A HealthTech | Clinical Data Intelligence Platform.F30D; San Francisco (Hybrid | US Only).F4B0; $160,000+ (base + benefits + equity). This Series A HealthTech company is raising the qua...Show moreLast updated: 10 days ago
    • Promoted
    Travel Nurse RN - Administration / Management - $2,404 to $2,604 per week in St. Helena, CA

    Travel Nurse RN - Administration / Management - $2,404 to $2,604 per week in St. Helena, CA

    TravelNurseSourceSt. Helena, CA, US
    Full-time
    TravelNurseSource is working with Titan Medical Group to find a qualified Admin / Mgmt RN in St.Travel Nurse RN - Case Management. Titan Medical is looking for travelers to fill a Travel Case Manageme...Show moreLast updated: 4 days ago
    • Promoted
    Air Interdiction Agent

    Air Interdiction Agent

    U.S. Customs and Border ProtectionEsparto, CA, United States
    Full-time
    Pilot CBP Air Interdiction Agent.Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP), offers skilled Pilots interested in law enforcement an opportunity to work wi...Show moreLast updated: 3 days ago