Distinguished Engineer

A company is looking for a Distinguished Engineer to define the architectural foundation for processing and transforming unstructured data for large-language-model applications.

Key Responsibilities

Define and evolve the end-to-end architecture for the data transformation and retrieval platform

Build and scale distributed systems that process massive volumes of unstructured data

Serve as the authority on Kubernetes orchestration and lead Python architecture best practices

Required Qualifications

15+ years of software engineering experience with a focus on distributed systems or data architecture

Expertise in Python for building frameworks and performance-critical services

Deep knowledge of Kubernetes for design, deployment, and debugging at scale

Fluency in Postgres, including query planning and tuning for high-throughput environments

Experience in high-performance data or AI / ML systems, particularly involving retrieval pipelines