Position : Lead Data Engineer (Databricks / AWS)
Duration : 6 Month Contract w / extensions or conversion
Location : Remote ; East Coast!!!
Must Haves :
- 2-3 years exp. as a data engineer
- 3 years of RECENT experience with Data Bricks
- Must be their most relevant experience!!
- Experience with Cloud ( Azure, GCP, or AWS)
- Experience with SQL they will be writing queries
- Lead experience Okay with not just being heads down
- Python / pyspark experience
Plusses :
- AWS Certifications
- Data Governance experience
- Bach Degree
Day to Day :
Insight Global is seeking a Lead Data Engineer to sit remote (EAST COAST) for a large retail client headquartered in the greater Pittsburgh area! Our client recently kicked off a major project to build their own home-grown eCommerce platform and applications that will be used internally and then deployed out into their 600+ retail locations.
In this role, the Data Engineer will be a member of the RISC team and will be a design, develop, and maintain scalable and efficient data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse leveraging AWS, Databricks, Python and SQL technologies.
Additional responsibilities will include :
- Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
- Optimize and troubleshoot existing data pipelines for performance and reliability.
- Implement data quality and validation processes to ensure accuracy and consistency of data.
- Stay updated on industry trends and best practices in data engineering to continuously improve our data infrastructure.
- Work closely with data scientists, analysts, and other stakeholders to understand data use cases and provide the necessary infrastructure and support.
- Assemble large, complex sets of data that meet non-functional and functional business requirements.
- Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automating manual processes.
Compensation : $70.00-80.00 / HR
Remote Delivery Lead - Banking and Data Experience Preferred
Delivery Lead - Data & Tools Delivery Project. Due to a recent merger, this organization is quickly growing along with its need for talented, experienced Delivery Lead to enhance the Bank's technological capabilities. Strategic Delivery Oversight - Collaborates with technology leaders, enterprise PM...
Senior Data Engineer - Remote, US
The Senior Data Engineer position will report to the Manager of Data Platforms & Analytics Engineering. Snowflake), and backend services3+ years of experience with Python3+ years with OLTP databases such as Postgresql, MySQL3+ years with OLAP databases such as Snowflake, BigQuery, Redshift3+ years w...
Sr Data Quality Engineer - Remote
Design, develop, and implement comprehensive data quality tests to identify anomalies, inconsistencies, and data integrity issues for new product development initiatives, product changes, policy changes, and database changes. We are looking for a Senior Quality Engineer to join our (ata engineering ...
Lead Data Engineer
Implement data quality checks, data profiling, and data cleansing processes to ensure data accuracy, completeness, and consistency across data sources. Collaborate with data architects, business analysts, and stakeholders to understand data requirements, define data models, and design data integrati...
Lead Data Engineer
The Lead Data Engineer holds a pivotal role in data governance, ensuring data accuracy and delivering valuable insights to the organization. Their responsibilities include leading and mentoring a team of data developers, establishing governance frameworks, enforcing quality standards, and fostering ...
Lead Data Engineer
The employee should demonstrate mastering of skills across following data engineering areas: development of data integration pipelines between data systems, data security, ETL and ELT, quality engineering activities and data operation engineering using SSIS & Azure Data Factory. Demonstrates ability...
Lead Data Scientist - Search (NLP, Information Retrieval, Query, Applied ML)(Remote Or Hybrid) 7000 Target Pkwy N Brooklyn Park, Minnesota
JOIN TARGET AS A LEAD DATA SCIENTIST – SEARCH AND BROWSE. Join our global in-house Tech team of more than 5,000 software engineers, applied data scientists, architects and product managers striving to make Target the most convenient, safe and joyful place to shop. The Search and Browse Applied Data ...
Software Engineer II (Tech Lead - Java Spring React Node.js AWS)
Leadership - Intermediate leadership skills with the ability to help create a safe environment for others to learn and grow as engineers and a proven track record of self-motivation in identifying opportunities and tracking team efforts. Travelers is seeking a Software Engineer II to join our organi...
Data Engineer, Internal Audit - Remote
Collect data from multiple data sources and perform data integration, data matching/linkages, standardization, and storage. This Data Analyst 2 position with data engineering emphasis supports the ongoing digital transformation and modernization of internal audit’s risk assessment, audit execution, ...
Lead Data Engineer
The Lead Data Engineer holds a pivotal role in data governance, ensuring data accuracy and delivering valuable insights to the organization. Their responsibilities include leading and mentoring a team of data developers, establishing governance frameworks, enforcing quality standards, and fostering ...