Senior Software Engineer, AI Systems

A company is looking for a Senior Software Engineer, AI Systems - vLLM and MLPerf.

Key Responsibilities

Design and implement efficient inference systems for generative AI models

Define benchmarking methodologies and develop tools for industry-wide adoption

Optimize low-level system components for MLPerf Inference benchmarks on GPUs

Required Qualifications

Bachelor's, Master's, or PhD in Computer Science / Engineering or related field

5+ years of software development experience, preferably with Python and C++

Deep understanding of deep learning algorithms and high-performance computing

Hands-on experience with ML frameworks and inference engines

Familiarity with GPU programming and performance profiling tools