Lead Software Engineer (Big Data / Cloudera Platform)

Job Title : Lead Software Engineer (Big Data / Cloudera Platform)

Location : Reston, VA / Washington, DC (Hybrid - 1 Day per Month Onsite)

Job Type : Contract-to-Hire

Overview :

We are seeking a Lead Software Engineer with deep hands-on expertise in Big Data platforms, Cloudera (CDP / CDH), and AWS environments. This role focuses on production support, performance optimization, and on-call rotation for mission-critical big data systems. The ideal candidate will be an experienced technical leader who thrives in dynamic environments, ensuring the reliability and scalability of data platforms supporting business analytics and front-end tools like MicroStrategy .

Interview Process : Onsite Interview

Key Responsibilities :

• Lead the design, development, and support of large-scale big data solutions across Cloudera and AWS environments.
• Manage production support operations , including incident resolution, performance tuning, and system optimization.
• Monitor and maintain Cloudera clusters to ensure uptime, scalability, and compliance with organizational SLAs.
• Troubleshoot and support components within the Hadoop ecosystem (Hive, HBase, Solr, Impala, Spark, Flume).
• Administer and integrate Kafka and NiFi data flows for real-time data streaming and ingestion.
• Automate workflows and system tasks using Python and Shell scripting .
• Support and manage data migration projects (e.g., CDH to CDP) and enforce DevSecOps and CI / CD best practices.
• Collaborate with data engineers, cloud architects, and analytics teams to optimize pipeline performance and system security (Ranger, Kerberos).
• Mentor junior engineers and uphold high standards for code quality, deployment, and documentation.

Required Skills & Experience :

Preferred Qualifications :

Additional Information :

Lumen Solutions Group Inc. is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority / Gender / Disability / Religion / LGBTQI / Age / Veterans.