A company is looking for a Data Platform Engineer to build and scale their modern data platform.
Key Responsibilities
Design and build a scalable data platform for batch and streaming use cases, ensuring data security and lineage capabilities
Develop a real-time data platform to support low-latency services for dynamic decision-making across various applications
Champion best practices for model deployment, monitoring, and CI / CD, ensuring high availability of the data platform
Required Qualifications
3+ years of experience in Platform Engineering with a focus on scalable data platforms in high-traffic environments
Proficiency in streaming architectures and building low-latency services for data ingestion and processing
Experience with containerization technologies such as Docker and Kubernetes
Expertise in coding with Python and Go, along with experience in cloud services like GCP or AWS
Extensive knowledge of big data technologies and experience in managing the full data lifecycle