As a Senior Backend Engineer on the Platform engineering team , you’ll lead the development of key aspects of our core services, including data I / O, streaming and storage capabilities. In this role, you will drive the evolution of our data infrastructure , focusing on large-scale high-throughput import and export, enabling our customers to seamlessly stream data from our to their platform, supporting the development of next generation AI models.
Your Day to Day
- Design, Develop, Deploy : Lead the design, development, and deployment of critical backend systems for large-scale distributed data infrastructure, including high-throughput exports.
- Scalability & Performance : Architect highly scalable, secure, and performant systems to handle billions of records at blazing speeds.
- Customer Collaboration : Work directly with customers to understand their needs, troubleshoot issues, and continuously improve the platform based on their feedback.
- Project Leadership : Drive initiatives from concept to execution, collaborating across teams and acting as a project owner.
- Strategic Planning : Work closely with stakeholders to define the Platform team’s roadmap and work closely with senior leadership to shape the company’s future.
- Innovation in AI : Contribute to building new capabilities for an AI platform used by leading AI labs to develop powerful multi-modal large language models (LLMs).
About You
5-8+ years of experience as a backend software engineerExpertise in a modern programming language (Python, Java, Kotlin, or TypeScript)Proficient in multiple storage systems (Relational Databases, Key-Value Stores, Cloud Buckets, etc.)Strong understanding of architectural concepts for large-scale distributed systemsExpertise in building streaming ETL pipelinesExperience with asynchronous messaging systems (Kafka, Google Pub / Sub, AWS SQS, RabbitMQ)Extensive experience with one or more public cloud platforms :Google Cloud Platform (GCP) (preferred)
Amazon Web Services (AWS)Microsoft AzureNice to Have
Familiarity with ReactJS and front-end development techniquesAn understanding of microservices architectureKnowledge of Google Spanner and ElasticSearchWorking knowledge of orchestration systems (e.g., Kubernetes)Familiarity with DevOps tools, such as ArgoCD, CodeFresh, and DataDog#J-18808-Ljbffr