No longer accepting applications

Senior Software Engineer- AI Hardware (New York)

BloombergNew York, NY, United States

11 hours ago

Job type

Full-time

Job description

Senior Software Engineer- AI Hardware

Location : New York

Business Area : Engineering and CTO

Ref # : 10041374

Description & Requirements

The Role : We are seeking an engineer to join our hardware management team. This team is responsible for the provisioning, monitoring, and support for thousands of servers supporting dozens of teams within Bloomberg, including the entire AI stack!

The ideal candidate will have experience in designing, implementing, and maintaining system software that enables communication between GPUs, CPUs, and storage in scale-out AI and HPC systems. This role will also be responsible for overseeing the ongoing monitoring, support, and maintenance of our HPC / AI clusters, ensuring peak performance and reliability.

We'll trust you to :

Design, build, and maintain highly reliable, scalable, and efficient infrastructure platforms that support our engineering teams and business needs.
Participate in system design discussions and contribute to architectural decisions
Ensure code quality through standard methodologies, code reviews, and alignment to clean code principles
Be able to produce clear and consumable documentation for a wide audience
Communicate effectively across diverse teams
Be willing to participate in on-call rotations as arranged
Be a self starter, manage priorities, and work independently
Stay up-to-date with the latest infrastructure technologies, and industry standard processes, and evaluate their potential impact on existing and future solutions

Who you are?

Hold yourself to high standards

Exude our ambitious, collaborative, and empathetic values

A self-starter mentality with an eagerness to solve previously unsolved problems

Excellent collaboration skills and are open to giving and receiving critical feedback across teams

Scalability and reliability are hardwired into your DNA

You have publicly available writing samples, blog posts, demos, or recordings of presentations on technical topics

What's in it for you?

A unique opportunity to be part of a rapidly growing team in one of the most exciting engineering teams in Bloomberg.

An inclusive and supportive work culture that fosters learning and growth.

Continuous professional development, product training, and career pathing

Intra-departmental mentor and buddy program for in-house networking

An inclusive company culture, ability to join our Community Guilds

You'll need to have :

4+ years of proficiency in Kubernetes environments (deployments, storage, services, jobs, ingress, egress, etc)

BA, BS, MS, PHD, in Computer Science, Electrical Engineering or related field

Hands-on management of GPU-based systems, including kernel and driver management, and developing software tooling to automate provisioning and maintenance of these systems.

Design, implemented, and maintained system software that enables communication between GPUS, CPUs, and storage in scale-out AI and HPC systems

Oversee the ongoing monitoring, support, and maintenance of our HPC / AI clusters, ensuring peak performance and reliability

Drive system upgrades, customization, and seamless integration with software developers, network operations, and data center teams

Manage and maintain a diverse range of computer systems and application software, ensuring they meet the highest standards of functionality and efficiency

Develop and maintain expertise in low-latency / high-bandwidth, interconnected infrastructure (including InfiniBand, Ethernet, RDMA / RoCE, and others)

Monitor and evaluate the efficiency and effectiveness of infrastructure service delivery methods and procedures

Partner with internal teams to develop prioritization, metrics, and processes around capacity planning and infrastructure availability. Periodically present capacity planning and performance reports to senior leaders during presentations and meetings

Benchmark, analyze, and make recommendations for improvement of IT infrastructure

We'd love to see :

Expertise with Kubernetes design patterns (operators, helm charts, kustomize, etc)

Experience with data center planning, including rack elevations, cabling plan, and cables / transceivers

Experience with data center operations and management

Create a job alert for this search

Senior Software Engineer Ai • New York, NY, United States

Related jobs

Promoted

Senior Software Engineer, Enterprise GenAI

Scale AI, Inc.New York, NY, United States

Full-time

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...Show moreLast updated: 30+ days ago

Senior Software Engineer

WorkWaveHolmdel, New Jersey, United States, 07733

Full-time

WorkWave is looking for innovative software engineers who want to be part of a team of creative and talented individuals. Our teams are a mix of technologists, product managers, quality experts, and...Show moreLast updated: 30+ days ago

AI Lead Engineer (Stamford, CT) - Now Hiring!

United RentalsStamford, CT, United States

Full-time

If you’d like the chance to make your mark with the world’s largest equipment rental provider,.United Rentals is seeking an AI Lead Engineer to drive the design and delivery of intelligent, scalabl...Show moreLast updated: 11 days ago

Promoted

Senior Software Engineer, AI

ImprintNew York, NY, United States

Full-time

Imprint is reimagining co-branded credit cards & financial products to be smarter, more rewarding, and truly brand-first. We partner with companies like Rakuten, Booking.H-E-B, Fetch, and Brooks Bro...Show moreLast updated: 30+ days ago

Promoted

AI Engineer

VirtualVocationsYonkers, New York, United States

Full-time

A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

VirtualVocationsBronx, New York, United States

Full-time

A company is looking for a Senior Software Engineer - Ad Serving.Key Responsibilities Design and present technical solutions for a high-performance Ad Serving system Lead the delivery of complex...Show moreLast updated: 30+ days ago

Promoted
New!

Senior AI Engineer (AI Foundations)

Capital OneNew York, New York, US

Full-time +1

Senior AI Engineer (AI Foundations).Do you have the following skills, experience and drive to succeed in this role Find out below. At Capital One, we are creating responsible and reliable AI systems...Show moreLast updated: 1 hour ago

Speechify is hiring : Software Engineer, AI Studio in New York

MediabistroNew York, NY, United States

Full-time

Join to apply for the Software Engineer, AI Studio role at Speechify Join to apply for the Software Engineer, AI Studio role at Speechify The mission of Speechify is to make sure that reading...Show moreLast updated: 30+ days ago

Promoted

Sr. Software Engineer- Gen AI Team (Hybrid)

Selective InsuranceMillburn, NJ, United States

Temporary

At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show moreLast updated: 3 days ago

Senior Software Engineer, AI

BetterNew York, New York, United States, 10001

Full-time

Better is reimagining home finance and making it faster, cheaper, and easier for everyone to become a homeowner.We leverage creative technology and innovation to make the home buying journey more a...Show moreLast updated: 30+ days ago

Senior Software Engineer (NY)

Cooperidge Consulting FirmNew York, NY, US

Full-time

Quick Apply

Cooperidge Consulting Firm is seeking.Senior Software Engineer to lead the development of a.This role offers the opportunity to work on technically complex, high-impact products from concept throug...Show moreLast updated: 30+ days ago

Full Stack AI Engineer

MprogenEdison, NJ, New Jersey, USA

Full-time

Full Stack AI Engineer Edison, NJ LongTerm Contract Onsite Position Experience : 8+ Years<...Show moreLast updated: 30+ days ago

Promoted

Software Engineer, Enterprise AI

Scale AI, Inc.New York, NY, United States

Full-time

Promoted

Senior AI Engineer, Applications Integrations

White & Case LLPNew York, NY, United States

Full-time

Senior AI Engineer, Applications Integrations.White & Case is an elite global law firm serving leading companies, financial institutions and governments worldwide. Our long history as an internation...Show moreLast updated: 30+ days ago

Promoted

Staff AI Engineer

VirtualVocationsPaterson, New Jersey, United States

Full-time

A company is looking for a Staff AI Engineer to join their Software Engineering team.Key Responsibilities Collaborate with cross-functional teams to transition AI / ML models into scalable, product...Show moreLast updated: 30+ days ago

Promoted

Software Engineer, AI

Epoch BiodesignNew York, NY, United States

Full-time

Software Engineer, AI — Brooklyn, NY — Engineering — In office — Full-time.In the next 30 years, the world will transform every part of the built environment to be climate positive green infrastruc...Show moreLast updated: 1 day ago

Senior AI Engineer

Tiger AnalyticsJersey City, NJ, US

Full-time

Quick Apply

Tiger Analytics is seeking a highly skilled.In this role, you will design, develop, and implement cutting-edge AI solutions that drive business value for our clients. You will leverage advanced mach...Show moreLast updated: 21 days ago

Promoted

Senior Software Engineer, Full-Stack - Enterprise Gen AI

Scale AI, Inc.New York, NY, United States

Full-time

Senior Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, an...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer - Data Platform

RelativityNewark, NJ, United States

Full-time

Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show moreLast updated: 30+ days ago

Promoted

Sr. Software Engineer

Robert HalfNew York, NY, US

Full-time

We are looking for a skilled Senior Software Engineer to design and implement innovative software solutions.This role involves creating scalable systems, optimizing performance, and contributing to...Show moreLast updated: 30+ days ago