Talent.com
Nebius
Remote Senior Site Reliability Engineer AI Studio (Inference Platform)Nebius • Newark, New Jersey
Remote Senior Site Reliability Engineer AI Studio (Inference Platform)

Remote Senior Site Reliability Engineer AI Studio (Inference Platform)

Nebius • Newark, New Jersey
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Why work at Nebius
Nebius is leading a new era in cloud computing to serve the global AI economy. We create the tools and resources our customers need to solve real-world challenges and transform industries, without massive infrastructure costs or the need to build large in-house AI/ML teams. Our employees work at the cutting edge of AI cloud infrastructure alongside some of the most experienced and innovative leaders and engineers in the field.


Where we work
Headquartered in Amsterdam and listed on Nasdaq, Nebius has a global footprint with R&D hubs across Europe, North America, and Israel. The team of over 800 employees includes more than 400 highly skilled engineers with deep expertise across hardware and software engineering, as well as an in-house AI R&D team.

AI Studio is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to deploy at massive scale. To deliver on that promise, we need an engineer who can make the platform behave flawlessly under extreme load and recover gracefully when the unexpected happens.


In this role you will own the reliability, performance, and observability of the entire inference stack. Your day starts with designing and refining telemetry pipelines — metrics, logs, and traces that turn hundreds of terabytes of signal into clear, actionable insight. From there you might tune Kubernetes autoscalers to squeeze more efficiency out of GPUs, craft Terraform modules that bake resilience into every new cluster, or harden our request-routing and retry logic so even transient failures go unnoticed by users. When incidents do arise, you’ll rely on the automation and runbooks you helped create to detect, isolate, and remediate problems in minutes, then drive the post-mortem culture that prevents recurrence. All of this effort points toward a single goal: scaling the platform smoothly while hitting aggressive cost and reliability targets.


Success in the role calls for deep fluency with Kubernetes, Prometheus, Grafana, Terraform, and the craft of infrastructure-as-code. You script comfortably in Python or Bash, understand the nuances of alert design and SLOs for high-throughput APIs, and have spent enough time in production to know how distributed back-ends fail in the real world. Experience shepherding GPU-heavy workloads — whether with vLLM, Triton, Ray, or another accelerator stack — will serve you well, as will a background in MLOps or model-hosting platforms. Above all, you care about building self-healing systems, thrive on debugging performance from kernel to application layer, and enjoy collaborating with software engineers to turn reliability into a feature users never have to think about.


If the idea of safeguarding the infrastructure that powers tomorrow’s multimodal AI energizes you, we’d love to hear your story.

What we offer



  • Competitive salary and comprehensive benefits package.

  • Opportunities for professional growth within Nebius.

  • Hybrid working arrangements.

  • A dynamic and collaborative work environment that values initiative and innovation.


We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

Create a job alert for this search

Remote Senior Site Reliability Engineer AI Studio (Inference Platform) • Newark, New Jersey

Similar jobs

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiWest Freehold, NJ, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Portfolio Architecture Leader (Insurance & AI)

Guardian LifeHolmdel Township, NJ, United States
Full-time

Guardian Life in Holmdel Township, NJ, is seeking a Head of Business Unit Architecture to lead the enterprise architecture strategy within the Business Unit.This senior position emphasizes end-to-e... Show more

 • Promoted

CIO, Food Ingredients: Standalone Tech & AI Leader

IFFUnion Beach, NJ, United States
Full-time

IFF is seeking a Chief Information Officer to lead the technology separation, stabilization, and long-term transformation after a carve-out.Build a standalone IT organization and establish digital,... Show more

 • Promoted

Senior Data Engineer New York, NY or Remote

Goldbelly, Inc.Edison, NJ, United States
Remote
Full-time

At Goldbelly, we believe food brings people together.We connect people with their greatest culinary desires within and beyond local communities.We empower food makers of all sizes and deliver their... Show more

 • Promoted

Remote Co-Founder & CTO - AI/ML for Women's Health

Find coEast Brunswick Township, NJ, United States
Full-time

Find co is looking for a Co-Founder and Chief Technology Officer to lead technical development.This role will focus on setting technical strategies and advancing core technology towards regulatory ... Show more

 • Promoted

Systems Engineer Lead

BAE Systems PlcTotowa, NJ, United States
Full-time

Job Description Ready to make a difference? BAE Systems is looking Systems Engineering Leads to work as part of a cross-functional, multi-disciplinary team to design, integrate, debug, and test ne... Show more

 • Promoted

Remote Backend Engineer, TS / Node - AI Audio Platform Job at Futureshaper.com in

Futureshaper.comPaterson, NJ, United States
Remote
Full-time

A leading text-to-speech technology company is looking for a Backend Developer to design and maintain robust APIs and oversee backend architecture at Speechify.The ideal candidate should have prove... Show more

 • Promoted

Cloud & AI Systems Engineer (Hybrid or Remote)

Managed Health Care Associates, Inc.Parsippany, NJ, United States
Remote
Full-time

Who We Are :Managed Health Care Associates, Inc.MHA) provides care communities access, solutions, and insights to help them run their businesses more effectively.Our members include post-acute prov... Show more

 • Promoted

GenAI + Snowflake Cortex Architect (Remote)

Kasmo GlobalEdison, NJ, United States
Remote
Full-time

Job Title :GenAI Snowflake Cortex Architect (Remote)Location :Remote6Months ContractAbout the RoleWe are seeking a seasoned Architect to lead the design, development and deployment of generative-AI... Show more

 • Promoted

AI Principal Architect - Remote in the US

MonksSomerset, NJ, United States
Remote
Full-time

Please note that we will never request payment or bank account information at any stage of the recruitment process.As we continue to grow our teams, we urge you to be cautious of fraudulent job pos... Show more

 • Promoted

System Engineering Integration and Test (SEIT) Lead/Section Manager

BAE SystemsTotowa, NJ, United States
Full-time

System Engineering Integration and Test Lead.Ready to make a difference? Our employees design, integrate, and test the world's next generation Electronic Warfare (EW) systems for the United States ... Show more

 • Promoted

Senior Consultant, Evidence Synthesis, Indirect Treatment Comparison (ITC)

IQVIA HoldingsParsippany, NJ, United States
Part-time

Senior Consultant, Evidence Synthesis, Indirect Treatment Comparison (ITC).Senior Consultants are project delivery leaders who are responsible for implementing methodologically rigorous evidence sy... Show more

 • Promoted

Environmental Due Diligence - Project Engineer/Scientist

Roux AssociatesSomerset, NJ, United States
Full-time

Job TitleEnvironmental Due Diligence - Project Engineer/ScientistJob TypeRegular Full TimeEducationBachelor's DegreeCategoryScientificJob DescriptionPosition OverviewRoux's Somerset, New Jersey off... Show more

 • Promoted

Remote Azure DevOps Engineer

Micro1Robertsville, New Jersey, US
$160,000.00 yearly
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Co-Founder & CTO — Health AI for Women’s Care (Remote)

HeraHealth Inc.East Brunswick Township, NJ, United States
Full-time

Co-Founder and Chief Technology Officer to spearhead technical development and strategy.This founding equity role will involve leading the company's tech vision, spearheading AI-driven solutions fo... Show more

 • Promoted

Scrum Master with AI

Diverse LynxSomerset, NJ, United States
Full-time

Work Location & Reporting Address: Somerset, NJ 08873 (Onsite.Does this position require Visa independent candidates only? Yes.Must Have Skills: AI Scrum Project Management Good understanding in Az... Show more

 • Promoted

Senior Software Engineer (Remote - USA)

AssetIntelNorth Brunswick, NJ, United States
Remote
Full-time

THIS JOB IS ONLY AVAILABLE TO INDIVIDUALS LIVING IN USA.NO RECRUITERS OR AGENCIES, PLEASE.About AssetIntelAssetIntel is a software company that develops asset management software products for the t... Show more

 • Promoted

Senior Project Coordination - Remote

NTT DATA ServicesParsippany, NJ, United States
Remote
Full-time

Req ID : 347059NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us.If you want to be part of an inclusive, adaptable, and forward-thinking organizat... Show more

 • Promoted

Senior Product Designer (Remote)

Lennar USAFreehold, NJ, United States
Remote
Full-time

OverviewLennar is one of the nation's leading homebuilders, dedicated to making an impact and creating an extraordinary experience for Homeowners, Communities, and Associates by building quality ho... Show more

 • Promoted

Solutions Engineer - Google Chrome

SHISomerset, NJ, United States
Full-time

The Solutions Engineer collaborates with account teams to assess customer data center environments and design tailored infrastructure solutions that align with business objectives.This role involve... Show more