Position : Lead Data Engineer (Databricks / AWS)
Duration : 6 Month Contract w / extensions or conversion
Location : Remote ; East Coast!!!
Must Haves :
- 2-3 years exp. as a data engineer
- 3 years of RECENT experience with Data Bricks
- Must be their most relevant experience!!
- Experience with Cloud ( Azure, GCP, or AWS)
- Experience with SQL they will be writing queries
- Lead experience Okay with not just being heads down
- Python / pyspark experience
Plusses :
- AWS Certifications
- Data Governance experience
- Bach Degree
Day to Day :
Insight Global is seeking a Lead Data Engineer to sit remote (EAST COAST) for a large retail client headquartered in the greater Pittsburgh area! Our client recently kicked off a major project to build their own home-grown eCommerce platform and applications that will be used internally and then deployed out into their 600+ retail locations.
In this role, the Data Engineer will be a member of the RISC team and will be a design, develop, and maintain scalable and efficient data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse leveraging AWS, Databricks, Python and SQL technologies.
Additional responsibilities will include :
- Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
- Optimize and troubleshoot existing data pipelines for performance and reliability.
- Implement data quality and validation processes to ensure accuracy and consistency of data.
- Stay updated on industry trends and best practices in data engineering to continuously improve our data infrastructure.
- Work closely with data scientists, analysts, and other stakeholders to understand data use cases and provide the necessary infrastructure and support.
- Assemble large, complex sets of data that meet non-functional and functional business requirements.
- Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automating manual processes.
Compensation : $70.00-80.00 / HR
Lead Data/Business Analyst (Healthcare) - Remote
Lead Data/Business Analyst (Healthcare). Leads the data analysis and profile efforts for new client implementations and system enhancements. Knowledge or certifications in software development methodologies like Scrum, the capability to lead cross-functional teams to meet project deadlines, and fami...
Remote Delivery Lead - Banking and Data Experience Preferred
Delivery Lead - Data & Tools Delivery Project. Due to a recent merger, this organization is quickly growing along with its need for talented, experienced Delivery Lead to enhance the Bank's technological capabilities. Strategic Delivery Oversight - Collaborates with technology leaders, enterprise PM...
Data Engineer - Python, SQL, & AWS
This platform, built on AWS, will utilize advanced data technologies to integrate data from various sources for real-time analytics in their application. The Data Engineer will also optimize the SaaS application and establish connections with technology partners in the automotive data field. Develop...
Lead Data QA Engineer
The Lead Data QA Engineer for the UT Data Hub improves university outcomes and advances the UT mission to transform lives for the benefit of society by increasing the usability and value of institutional data. The Lead Data QA Engineer works closely with, and supervises other team members to design,...
.NET Technical Lead (Remote)
NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. Years of experience in leading a technical team. Candidate should be able to work in global development environment and take up leadership in providing the IT solution. Lead development tea...
Lead Data QA Engineer
The Lead Data QA Engineer for the UT Data Hub improves university outcomes and advances the UT mission to transform lives for the benefit of society by increasing the usability and value of institutional data. The Lead Data QA Engineer works closely with, and supervises other team members to design,...
.NET Technical Lead (Remote)
NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. Years of experience in leading a technical team. Candidate should be able to work in global development environment and take up leadership in providing the IT solution. Lead development tea...
Lead Telecommunications Engineer (Remote)
Lead Telecommunications Engineer (Remote). As an almost 20+ year old FinTech company that has gone from start-up to industry leader, we know how to innovate, simplify, and value all people. As an almost 20+ year old FinTech company that has gone from start-up to industry leader, we know how to innov...
Lead Software Engineer, Full Stack (javascript, React, Aws)
Lead Software Engineer, Full Stack (JavaScript, React, AWS). As a Capital One Lead Software Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Lead Software Engineer on the team, you will be responsible for guiding teams in using a...
Site Reliability Engineer-FedRAMP, AWS (FULLY REMOTE) - 29122
Lead teams of tight-knit engineers who are building a state-of-the-art,cloud-based environment for massive-scale data processing. Splunk's Cloud Services group is looking for a Site ReliabilityEngineer to help lead, design and build the next generation of our large scale cloudoffering. Site Reliabil...