Lead Data Engineer

Job Description

Job Description

Connsci is seeking a Lead Data Engineer to support the building of an anomaly detection platform for a large government customer. This role will be responsible for leading the overall design, build, and management of data pipelines that integrate financial and procurement systems. The Lead Data Engineer will ensure that data ingestion, transformation, and storage processes are reliable, secure, and compliant with state and federal standards. In addition, this individual will be responsible for tracking project milestones, updating client stakeholders on status, and ensuring delivery.

Key Responsibilities :

• Design and maintain secure data ingestion pipelines using Azure Data Factory, API Management, and SFTP
• Develop ETL / ELT workflows in Azure Databricks to cleanse, transform, and normalize data across multiple systems
• Implement data quality checks (e.g., Great Expectations) to validate completeness, accuracy, and timeliness.
• Manage data storage in Azure Data Lake Storage Gen2 (bronze / silver / gold architecture) with evidentiary controls (immutability, hashing, lineage).
• Collaborate with Sr. Data Scientists to operationalize anomaly detection rules and risk scoring models.
• Optimize pipelines for performance, scalability, and cost efficiency across DEV, TEST, POC, PROD environments.
• Apply security best practices in alignment with NIST SP 800-53 / 171
• Troubleshoot pipeline failures, monitor jobs, and ensure compliance reporting readiness.
• Communicate with client stakeholders to understand program requirements and to provide routine progress updates
• Coordinate across team members to ensure effective delivery of program goals and adherence to project timeline

Basic Qualifications :

Preferred Qualifications :

Location : This role will be able to work remotely but preference will be given to candidates who are located in the same region as a Connsci office (DC Metro or Florida).

About Connsci

At Connsci, our mission is to be a trusted strategic partner for our clients, helping them achieve impactful results by addressing mission-critical issues that affect their bottom line. We recognize the importance of customizing our services to best fit our clients' needs and understanding what it takes to propel their organizations forward. By implementing industry-leading best practices and leveraging our multifaceted experience and expertise, we deliver services that are essential for any organization aiming to reach its goals.

What You Can Expect :

By joining Connsci, you'll become part of a dedicated team that is committed to delivering strategic, impactful solutions tailored to our clients' unique needs, enabling them to achieve their goals with confidence and efficiency. If you're passionate about cybersecurity and IT services, and eager to contribute to a dynamic team, we encourage you to explore opportunities with us.

At this time, Connsci will not sponsor a new applicant for employment authorization for this position.

Connsci is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.

This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. Connsci makes hiring decisions based solely on qualifications, merit, and business needs at the time.