AI Infrastructure Software Architect

Description

/Preferred Qualifications

Are you passionate about building the backbone of AI innovation? Join our team as a Sr. AI Infrastructure Software Engineer and help craft the next-generation software infrastructure that powers groundbreaking AI frameworks like CUDA, TensorFlow, PyTorch, and JAX!

This role is ideal for engineers who excel in system-level development and are eager to expand their impact in high-performance computing—driving innovation where complexity meets scale!

Key Responsibilities:

• Architect and implement robust software infrastructure to support AI/ML workloads across multiple frameworks and hardware platforms.
• Design and optimize system-level components usingC,C++, and Python, ensuring high performance, scalability, and maintainability.
• Collaborate with multi-functional and cross-divisional teams to integrate AI frameworks (e.g., TensorFlow, PyTorch, JAX, ONNX) into a unified development environment.
• Lead the development of build systems and toolchains usingMakefiles, CMake, Clang, and GCC.
• Stay ahead of modern software and AI trends, and guide the team in adopting standard processes and new technologies.
• Provide technical leadership and mentorship to junior engineers and chip in to long-term architectural decisions.

Required Qualifications:

• Education & Experience: Advanced degree in Computer Science, Electrical Engineering, or a related field, with a strong background in system-level software development.
• Programming & Tools: Proficient in C, modern C++, Python, and experienced with Linux development environments. Familiar with build tools (Makefile, CMake), compilers (Clang, GCC), and container technologies (e.g., Kubernetes).
• Technical Expertise:Deep understanding of software architecture, compiler toolchains, and runtime systems. Experience building infrastructure for AI/ML frameworks or high-performance computing environments.
• Specialized Skills: Hands-on experience with CUDA, GPU programming, and familiarity with TensorFlow and deep learning model interoperability is a strong plus.
• multi-functional Impact: Proven track record to develop scalable software infrastructure across multiple divisions or organizations.
• AI & HPC Knowledge: Strong grasp of modern AI trends, including model optimization, distributed training, and inference acceleration.
• Communication: Excellent written and verbal communication skills.

Preferred Qualifications

• Experience working with AI accelerators or heterogeneous computing environments.
• Contributions to open-source AI or systems software projects.
• Strong collaboration skills, with the ability to influence and align partners across teams and geographies.

Minimum Qualifications

Doctorate (Academic) Degree and related work experience of 5 years; Master's Level Degree and related work experience of 8 years; Bachelor's Level Degree and related work experience of 12 yearsBase Pay Range: $180,000.00 - $306,000.00 AnnuallyPrimary Location: USA-CA-Milpitas-KLAKLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.

Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.

KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees. KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA. Please ensure that you have searched for legitimate job postings. KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers. If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information.