Job type
- Full-time
- Remote
Job description
Job Description:
- Assess customer data and analytics requirements with product owners, business analysts, and data stewards
- Translate customer needs into scoped ingestion and transformation tasks
- Develop, configure, test, and maintain batch or event-driven data pipelines for new and migrated data sources
- Build customer-focused transformations, semantic views, and consumption-ready datasets for reporting, analytics, and data science
- Perform source-to-target reconciliation, freshness checks, data quality validation, and defect remediation
- Document evidence for customer acceptance
- Implement approved access, metadata, lineage, and security requirements with governance and security teams
- Monitor pipeline health and performance
- Troubleshoot failed loads and data discrepancies
- Support production incidents and corrective actions
- Document pipeline configurations, dependencies, runbooks, and handoffs
- Contribute improvements to reusable templates and automation
- Coordinate customer onboarding and technical handover with Summit platform and customer enablement teams
- Work with VA customers, data owners, analysts, and platform teams to onboard data sources and deliver reliable, analytics-ready data products
Requirements:
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline
- 8+ years of relevant experience, including demonstrated expertise designing and implementing complex data engineering solutions
- Hands-on experience developing and troubleshooting production data ingestion, ETL/ELT, transformation, and validation pipelines using SQL and Python
- Experience with cloud-based data platforms and services in Microsoft Azure, AWS, or Google Cloud
- Understanding of storage, orchestration, and secure data access
- Experience with data modeling, source-to-target reconciliation, data quality testing, and pipeline monitoring or incident troubleshooting
- Ability to document technical designs, data flows, dependencies, and operational procedures
- Ability to collaborate with engineers, analysts, and data owners
- Demonstrated ability to independently implement data pipelines using established design and deployment patterns
- Ability to obtain and maintain the required VA Public Trust suitability determination (Tier 2/Moderate Risk)
- Direct, hands-on experience supporting the VA Summit Data Platform is highly preferred
- Experience with other VA enterprise data and analytics environments is valuable
- Hands-on Microsoft Azure data engineering experience, including Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Spark, or comparable services
- Familiarity with Delta Lake/lakehouse architectures, data catalogs and lineage, and governance tools such as Collibra, Immuta, or Starburst
- Experience supporting federal IT systems and complying with security, privacy, and data-access requirements
- Experience with Agile delivery and relevant cloud/data engineering certifications is preferred
- Must support Eastern Time collaboration and applicable production coverage
- Remote work within CONUS is subject to VA security and system-access requirements
Benefits:
- Remote work within CONUS
- Occasional after-hours or weekend support may be required for critical outages or planned maintenance