The Opportunity : The Manager of Data Engineering will lead our data platform team in building and scaling enterprise-grade streaming data architectures. You will be a technical leader with deep expertise in the Confluent platform, Apache Kafka, and modern data engineering practices. This role will be responsible for managing a team of data engineers while driving the strategic direction of our real-time data infrastructure.
What You Will Do :
Team Leadership & Management
Lead, mentor, and develop a team of 2-3 data engineers specializing in streaming technologies
Provide technical guidance on complex streaming architectures and best practices
Conduct performance reviews, career development planning, and technical skill assessments
Foster a culture of innovation, collaboration, and continuous learning
Technical Strategy & Architecture
Define and execute the data engineering roadmap with a focus on real-time streaming platforms
Design and oversee the implementation of event-driven architectures using Confluent Platform
Establish best practices for stream processing, data governance, and platform reliability
Drive platform modernization initiatives and technology adoption decisions across streaming and batch systems
Architect integrations between streaming platforms (Kafka) and analytics platforms (Databricks, Snowflake)
Collaborate with stakeholders to translate business requirements into scalable technical solutions
Platform Operations & Optimization
Oversee the management and optimization of Kafka clusters and Confluent Platform deployments
Ensure high availability, performance, and scalability of streaming data pipelines
Manage platform capacity planning and cost optimization initiatives
Demonstrate experience with monitoring tools (JMX metrics, Grafana, Prometheus) for Kafka environments
Demonstrate understanding of data lakehouse architectures and multi-platform integration patterns
Successfully manage teams through platform migrations or modernization projects
The Experience You Will Bring :
Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical field
2+ years of people management experience leading technical teams
5+ years of hands-on data engineering experience with distributed systems
Deep expertise in Confluent Platform including Kafka Connect, Schema Registry, ksqlDB, and Control Center
Proficiency in Kafka cluster sizing, scaling, and performance optimization
Advanced proficiency in Apache Kafka : stream processing, topic design, partitioning strategies, consumer groups, and performance tuning
Extensive experience with Apache Airflow for workflow orchestration, DAG development, and pipeline monitoring
Expert-level skills in PySpark for large-scale data processing, performance optimization, and cluster management
Strong communication skills for working with technical and business stakeholders
Proven experience designing event-driven architectures and real-time data pipelines
Your Well Being :
Hybrid work model (Onsite / Offsite)
Comprehensive benefits : medical, dental, vision, company paid Basic Life / AD&D
401k Retirement Plan
Flexible PTO
Career Development
Employee Purchase Program
What We Stand For :
We act with intensity, urgency and a passion for supporting our customers and growing our business. We strive for excellence.
We hold ourselves accountable and expect it of each other. We attack problems with a positive “can do” attitude. We do what we say we’ll do.
We deliver as one team, working together with integrity, respect, trust, transparency, and fun. We are better because we work here.
We believe our unique diversity and authenticity make us a better company, allows us to be our best selves and is a competitive advantage.
We exhibit innate curiosity and creativity to innovate and reimagine how things can be done. We ask, is there a better way?
Manager Data Engineering • Atlanta, Georgia, United States