Talent.com
Lead Data Engineer

Lead Data Engineer

The Friedkin GroupHouston, TX, United States
4 days ago
Job type
  • Full-time
Job description

Living Our Values

All associates are guided by Our Values. Our Values are the unifying foundation of our companies. We strive to ensure that every decision we make and every action we take demonstrates Our Values. We believe that putting Our Values into practice creates lasting benefits for all of our associates, shareholders, and the communities in which we live.

Why Join Us

  • Career Growth : Advance your career with opportunities for leadership and personal development.
  • Culture of Excellence : Be part of a supportive team that values your input and encourages innovation.
  • Competitive Benefits : Enjoy a comprehensive benefits package that looks after both your professional and personal needs.

Total Rewards

Our Total Rewards package underscores our commitment to recognizing your contributions. We offer a competitive and fair compensation structure that includes base pay and performance-based rewards. Compensation is based on skill set, experience, qualifications, and job-related requirements. Our comprehensive benefits package includes medical, dental, and vision insurance, wellness programs, retirement plans, and generous paid leave. Discover more about what we offer by visiting our Benefits page.

A Day In The Life

As a Lead Data Engineer within the Trailblazer initiative, you will play a crucial role in architecting, implementing, and managing robust, scalable data infrastructure. This position demands a blend of systems engineering, data integration, and data analytics skills to enhance TFG's data capabilities, supporting advanced analytics, machine learning projects, and real-time data processing needs. The ideal candidate brings deep expertise in Lakehouse design principles, including layered Medallion Architecture patterns (Bronze, Silver, Gold), to drive scalable and governed data solutions. This is also a highly visible leadership role that will represent the data engineering function and lead the Data Management Community of Practice across TFG.

As a Lead Data Engineer you will :

  • Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.
  • Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.
  • Architect and operationalize data pipelines following Medallion Architecture best practices within a Lakehouse framework-ensuring data quality, lineage, and usability across Bronze, Silver, and Gold layers.
  • Develop and optimize data models and storage solutions (Databricks, Data Lakehouses) to support operational and analytical applications, ensuring data quality and accessibility.
  • Utilize ETL tools and frameworks (e.g., Apache Airflow, Fivetran) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.
  • Lead the Data Management Community of Practice, serving as the primary facilitator, coordinator, and spokesperson. Drive knowledge sharing, establish best practices, and represent the data engineering discipline across TFG to both technical and business audiences.
  • Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.
  • Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.
  • Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.
  • Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.
  • What We Need From You

  • Bachelor's Degree computer science, MIS, or other business discipline and 10+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req or
  • Master's Degree computer science, MIS, or other business discipline and 5+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req
  • Demonstrated experience designing and implementing Medallion Architecture in a Databricks Lakehouse environment, including layer transitions, data quality enforcement, and optimization strategies. Required
  • Expertise in developing ETL / ELT workflows Required
  • Comprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native data offerings Required
  • Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage Required
  • Strong experience in AWS cloud services, with hands-on experience in integrating cloud storage and compute services with Databricks Required
  • Proficient in SQL and programming languages relevant to data engineering (Python, Java, Scala) Required
  • Hands on RDBMS experience (data modeling, analysis, programming, stored procedures) Required
  • Familiarity with machine learning model deployment and management practices is a plus Required
  • Strong executive presence and communication skills, with a proven ability to lead communities of practice, deliver presentations to senior leadership, and build alignment across technical and business stakeholders. Required
  • AWS Certified Solution Architect Preferred
  • Databricks Certified Associate Developer for Apache Spark Preferred
  • DAMA CDMP Preferred
  • or other relevant certifications. Preferred
  • Physical and Environmental Requirements The physical requirements described here are representative of those that must be met by an associate to successfully perform the essential functions of the job. While performing the duties of the job, the associate is required on a daily basis to analyze and interpret data, communicate, and remain in a stationary position for a significant amount of the work day and frequently access, input, and retrieve information from the computer and other office productivity devices. The associate is regularly required to move about the office and around the corporate campus. The associate must frequently move up to 10 pounds and occasionally move up to 25 pounds.

    Travel Requirements

    20% The associate is occasionally required to travel to other sites, including out-of-state, where applicable, for business.

    Join Us

    The Friedkin Group and its affiliates are committed to ensuring equal employment opportunities, including providing reasonable accommodations to individuals with disabilities. If you have a disability and would like to request an accommodation, please contact us at TalentAcquisition@friedkin.com. We celebrate diversity and are committed to creating an inclusive environment for all associates.

    We are seeking candidates legally authorized to work in the United States, without Sponsorship.

    #LI-BM1

    Create a job alert for this search

    Lead Data Engineer • Houston, TX, United States

    Related jobs
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for an EA-Data Pipeline.Key Responsibilities Process datasets from various data vendors and clients Identify and implement automation improvements for data processing Maint...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsHouston, Texas, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Aroha TechnologiesHouston, TX, US
    Full-time
    Job Title : Senior Data Engineer.Location : Houston, Texas (Should be local to Houston Texas).Roles and Responsibilities : The Senior Data Engineer is the one who designs and builds data foundations a...Show moreLast updated: 18 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsPasadena, Texas, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for an Analytics Engineer (Product).Key Responsibilities Define, build, and own end-to-end analytical solutions to guide business decisions Develop scalable, version-control...Show moreLast updated: 30+ days ago
    • Promoted
    Data Cloud Solution Engineer

    Data Cloud Solution Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Solution Engineer, Data Cloud.Key Responsibilities Conduct in-person and web-based meetings to drive technical discovery and close opportunities Collaborate with Accou...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Management Engineer

    Senior Data Management Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Senior Engineer, Data Management (Remote).Key Responsibilities Build and automate data ingestion, transformation, and aggregation pipelines Conduct complex data analys...Show moreLast updated: 3 days ago
    • Promoted
    Lead AI Data Engineer

    Lead AI Data Engineer

    VirtualVocationsPasadena, Texas, United States
    Full-time
    A company is looking for a Lead AI and Data Solution Engineer (LLMs, MCP).Key Responsibilities Lead the design, development, and deployment of enterprise-scale data and AI solutions Architect an...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer for AI

    Data Engineer for AI

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsHouston, Texas, United States
    Full-time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsPasadena, Texas, United States
    Full-time
    A company is looking for a Segment Data Engineer.Key Responsibilities Work with existing product event data in Twilio Segment, focusing on data capture, storage, and structure Design and impleme...Show moreLast updated: 30+ days ago
    • Promoted
    Segment Data Engineer

    Segment Data Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Segment Data Engineer to support their Marketing team's data initiatives.Key Responsibilities Work with Twilio Segment to capture, store, and structure product event da...Show moreLast updated: 5 days ago
    • Promoted
    Data Governance Engineer

    Data Governance Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Data Governance Customer Engineer to assist enterprise customers in implementing Microsoft Purview across complex data environments. Key Responsibilities Guide customers...Show moreLast updated: 2 days ago
    • Promoted
    Data & AI Engineer

    Data & AI Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Data / AI Engineer (Gen AI, LLM, ML).Key Responsibilities Design, build, and maintain robust data pipelines and workflows for healthcare data Develop, train, and deploy ...Show moreLast updated: 2 days ago
    • Promoted
    Lead Analyst, Operational Analytics

    Lead Analyst, Operational Analytics

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Lead Analyst, Operational Analytics.Key Responsibilities : Lead the data governance team in developing and enforcing data governance policies, standards, and best practi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsHouston, Texas, United States
    Full-time
    A company is looking for a Senior Data Engineer.Key Responsibilities Design, build, and maintain reliable ETL pipelines Work with large datasets using Python or Java and raw SQL Collaborate wit...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    RelativityHouston, TX, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsPasadena, Texas, United States
    Full-time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsHouston, Texas, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsSugar Land, Texas, United States
    Full-time
    A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago