Job Description
Job Description
We are looking for a skilled Data Engineer to join our team in Wayne, Pennsylvania. This is a Contract-to-permanent position that offers a dynamic opportunity to work with large-scale data sets and contribute to data modeling and automation processes. If you're passionate about leveraging advanced tools and technologies to optimize data workflows, we encourage you to apply.
Responsibilities :
- Develop and implement data models for large-scale datasets, focusing on retailer data such as Walmart.
- Utilize tools such as Python, Snowflake, and SQL to design and optimize data pipelines.
- Automate data workflows through scripting, including Selenium-based web automation tasks.
- Collaborate with cross-functional teams to support data integration and analysis for multiple retailers.
- Ensure data accuracy and consistency across all platforms and workflows.
- Troubleshoot and resolve issues related to data pipelines and automation processes.
- Provide technical expertise to enhance data engineering practices and improve system performance.
- Document processes and workflows to maintain clarity and facilitate future updates.
- Minimum of 3 years of experience in data engineering with a focus on detail-oriented work.
- Proficiency in Python, Snowflake, and Microsoft SQL.
- Strong knowledge of data modeling and pipeline optimization.
- Experience with automation tools, including Selenium scripting.
- Ability to work with large datasets and ensure data integrity.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration abilities.
- Familiarity with retail data systems is a plus.