Talent.com
Lead Databricks Data Engineer

Lead Databricks Data Engineer

MindteckPhiladelphia, PA, United States
30+ days ago
Job type
  • Full-time
Job description

What you'll do

What you bring

Description :

Lead Databricks Data Engineer

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities :

Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.

Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.

Collaborate with Data Platform Architects and Client Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.

Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.

Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.

Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.

Implement secure and scalable data capture and ingestion workflows.

Support data preparation, exploration, and visualization to facilitate data-driven decision-making.

Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

Qualifications :

Bachelor's degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred

5+ years of experience in designing and delivering secure cloud solutions.

3+ years of experience with Databricks

2+ years of experience with Agile Methodology

Strong problem-solving, analytical, and communication skills.

While others say it, we do it : we care . We have great people and we do great work. Just as importantly, we have great relationships with an impressive clientele. Over 1,000 talented, diverse, and career-minded professionals are carving out their role and experiencing a good mix of challenges and opportunities - and we're rooting for them along the way, every day. For more, click :

Mindteck is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as a qualified individual with a disability, or any other trait protected by law.

Create a job alert for this search

Lead Data Engineer • Philadelphia, PA, United States

Related jobs
  • Promoted
Data Engineer II

Data Engineer II

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago
  • Promoted
Staff Data Engineer

Staff Data Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago
  • Promoted
Data Cloud Solution Engineer

Data Cloud Solution Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Solution Engineer, Data Cloud.Key Responsibilities Conduct in-person and web-based meetings to drive technical discovery and close opportunities Collaborate with Accou...Show moreLast updated: 2 days ago
  • Promoted
Senior Data Engineer II

Senior Data Engineer II

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 1 day ago
  • Promoted
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

ZipRecruiterPhiladelphia, PA, United States
Full-time
Job DescriptionJob DescriptionCompany Description.CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology.At CapTech, w...Show moreLast updated: 4 days ago
  • Promoted
Data Engineer - Pipelines & Analytics

Data Engineer - Pipelines & Analytics

Soni ResourcesConshohocken, PA, United States
Full-time
Soni's client is seeking a highly skilled Data Engineer to design, build, and maintain scalable, reliable data pipelines that power their analytics ecosystem. You will be responsible for ensuring th...Show moreLast updated: 4 days ago
  • Promoted
Lead Data Engineer with PySpark

Lead Data Engineer with PySpark

Infinity OutsourcingMt Laurel, NJ, United States
Full-time
About the job Lead Data Engineer with PySpark.Lead Data Engineer with PySpark ( 1 Day Onsite).Primary Tech skills = Pyspark, Databricks (Hands-on experience mandatory). Secondary Tech skills = Azure...Show moreLast updated: 30+ days ago
  • Promoted
Data Warehouse Engineer

Data Warehouse Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data Warehouse Engineer III.Key Responsibilities Design, develop, and maintain scalable ELT workflows using Azure Data Factory, Fivetran, and dbt Partner with data ana...Show moreLast updated: 30+ days ago
  • Promoted
Principal Data Engineer

Principal Data Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
  • Promoted
Data Governance Engineer

Data Governance Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data Governance Customer Engineer to assist enterprise customers in implementing Microsoft Purview across complex data environments. Key Responsibilities Guide customers...Show moreLast updated: 1 day ago
  • Promoted
Automation Engineer

Automation Engineer

Unisys CorporationBlue Bell, PA, United States
Full-time
What success looks like in this role : .Proficiency in programming languages.Python, Java, C++, C#, JavaScript, or Go.Strong understanding of software architecture and design patterns.CI / CD pipelines...Show moreLast updated: 30+ days ago
  • Promoted
Snowflake Deployment Engineer

Snowflake Deployment Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Snowflake Deployment Engineer to design, implement, and optimize Snowflake environments for data platforms. Key Responsibilities Lead the deployment, configuration, and ...Show moreLast updated: 2 days ago
  • Promoted
Data & AI Engineer

Data & AI Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data / AI Engineer (Gen AI, LLM, ML).Key Responsibilities Design, build, and maintain robust data pipelines and workflows for healthcare data Develop, train, and deploy ...Show moreLast updated: 1 day ago
  • Promoted
Databricks Data Engineer - Manager - Consulting - Location Open

Databricks Data Engineer - Manager - Consulting - Location Open

EYTrenton, NJ, United States
Full-time
At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show moreLast updated: 4 days ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
  • Promoted
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

CapTech ConsultingPhiladelphia, PA, US
Full-time
CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 2 days ago
  • Promoted
Analytics Engineer

Analytics Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for an Analytics Engineer II (REMOTE).Key Responsibilities Design and build data models and BI dashboards to solve business problems Collaborate with Agile teams to understa...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data Engineer, Trust & Safety.Key Responsibilities Build and maintain ETL / streaming pipelines for logs, events, and metadata Ensure data quality through alerting, reco...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer for AI

Data Engineer for AI

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 1 day ago
  • Promoted
Lead Analyst, Operational Analytics

Lead Analyst, Operational Analytics

VirtualVocationsPhiladelphia, Pennsylvania, United States
Full-time
A company is looking for a Lead Analyst, Operational Analytics.Key Responsibilities : Lead the data governance team in developing and enforcing data governance policies, standards, and best practi...Show moreLast updated: 1 day ago