Position Overview
McCarthy is seeking a full-time Data Engineer located in St. Louis, MO who, as part of the Enterprise Solutions and Analytics team, will play a crucial part in shaping our data infrastructure, supporting our existing systems, and driving innovation through ML and AI solutions. As we expand our capabilities, your expertise will be pivotal in delivering end-to-end data pipelines and repositories.
Key Responsibilities
- Profile source system data and design data warehouse and lake schemas
- Transform raw data into usable format based on analytics, reporting and integration requirements
- Design, implement, and support ETL, ELT and integration pipelines
- Optimize data pipelines for performance, scalability and efficiency
- Implement data quality checks and validations within data pipelines to ensure accuracy, consistency and completeness of data
- Collaborate with cross-functional teams to promote AI solutions in the enterprise
- Apply best practices in solution development, quality control and security in implementing pipelines
- Participate in code and design reviews to ensure alignment to standards and best practices
- Research, analyze, recommend, and select technical approaches for solving challenging and complex development and integration problems
Qualifications
5+ years of work experience in data management disciplines, including data modeling, integration and development of ETL / ELT pipelines5+ years of data solution delivery experience, preferably in the Microsoft Azure platforms and tools (Azure Data Factory, Azure SQL, Azure Data Lake Gen2, Azure DevOps). Experience in Microsoft Fabric would be a plusExperience with T-SQL (queries, stored procedures, and DDL)Experience querying API endpointsExperience with Power QuerySolid understanding of data warehouse and data lake concepts and design (including star schemas)Experience with Agile / Scrum methodology preferredExcellent analytical, conceptual, and problem-solving abilities with aptitude for acquiring new technical skillsEntrepreneurial attitude with a passion to deliver value for the organizationHighly motivated team player with strong interpersonal skillsConstant learner with a passion for continuous growth and improvementPython proficiency for data management, ML and AI developmentAdditional Experience and Skills
Experience developing integration solutions using a low-code platform such as Boomi, SnapLogic or MulesoftExperience developing solutions on PalantirExperience developing solutions in a Lakehouse platformExperience developing and promoting work through devops / dataops pipelines and utilizing source controlExperience with NoSQL database systems and building data pipelines to ingest unstructured and streaming dataExperience preparing data for Data Science and Machine Learning use casesExperience with master data managementExperience designing reports using Power BI, Power Query, and DAXMcCarthy is proud to be an equal opportunity employer, including disability and protected veteran status.
Seniority level
Mid-Senior levelEmployment type
Full-timeJob function
Information TechnologyIndustries
ConstructionJ-18808-Ljbffr