Talent.com
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

Captech ConsultingChicago, Illinois, United States
30+ days ago
Job type
  • Full-time
Job description

Company Description

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

  • Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
  • 5+ years of experience delivering data engineering solutions on cloud platform
  • 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
  • Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
  • 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
  • Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
  • Fundamental understanding of big data, open source, and data streaming concepts
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
  • Experience providing technical leadership and mentoring other engineers in data engineering space
  • Cloud certification on any platform a plus
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.  You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.  Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness — each foundational to our core values.  We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click  HERE .  As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email [email protected] .

    CapTech supports Equal Pay for all. In addition, in the State of Illinois we are committed to Equal Pay for ALL in accordance with the Illinois Equal Pay Act. The base pay range for this role is : $150,000 - $200,000k.

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    #LI-LM1

    Create a job alert for this search

    Azure Data Engineer • Chicago, Illinois, United States

    Related jobs
    • Promoted
    Senior Solutions Architect & Tech Lead—Cloud Data

    Senior Solutions Architect & Tech Lead—Cloud Data

    Prairie Consulting ServicesChicago, IL, United States
    Full-time
    A consulting firm is seeking a Solutions Architect / Technical Lead to guide large-scale cloud data engineering projects. The role demands over 15 years of experience, focusing on architecture, desi...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Allstate InsuranceChicago, IL, United States
    Full-time
    At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ...Show moreLast updated: 1 day ago
    Sales Engineer

    Sales Engineer

    GpacLake Forest, Illinois, United States
    Full-time
    Quick Apply
    We’re helping several manufacturing teams add.If you can translate engineering into plain English, we already love you.Depending on the role, your day may include : . Helping customers understan...Show moreLast updated: 3 days ago
    • Promoted
    Azure Fabric Solution Architect — Data & AI Leader

    Azure Fabric Solution Architect — Data & AI Leader

    Wavicle Data SolutionsChicago, IL, United States
    Full-time
    A consulting firm specializing in cloud and data solutions is seeking a Solution Architect skilled in Azure data services. This role involves designing cloud-native architectures, leading engagement...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    TAG - The Aspen GroupChicago, IL, United States
    Full-time
    The Aspen Group (TAG) is one of the largest and most trusted retail healthcare business support organizations in the U.Dental Care, Urgent Care, Pet Care, and Medical Aesthetics.Working in partners...Show moreLast updated: 30+ days ago
    Senior Azure Engineer

    Senior Azure Engineer

    Coalfire SystemsChicago, Illinois, United States, 60611
    Full-time
    We celebrate diversity and are committed to respecting one another, embracing individual differences, and creating an inclusive environment for all employees. Coalfire is on a mission to make the ...Show moreLast updated: 30+ days ago
    Data Engineer (Mid–Junior Level)

    Data Engineer (Mid–Junior Level)

    Preferred Risk InsuranceBedford Park, IL, USA
    Full-time
    Quick Apply
    We are seeking the ideal candidate for our Data Engineer o.As a Data Engineer you will support our development and business teams with data workflows, reporting processes, and ongoing modernization...Show moreLast updated: 1 day ago
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Tiger AnalyticsChicago, IL, US
    Full-time
    Quick Apply
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS MLOps Tech Lead – Data Science & Python Expert

    AWS MLOps Tech Lead – Data Science & Python Expert

    TechDigital GroupChicago, IL, United States
    Full-time
    An innovative firm is seeking a skilled MLOps Engineer with expertise in AWS, Data Science, and Machine Learning.This role involves delivering impactful data-science projects, operationalizing mode...Show moreLast updated: 1 day ago
    Azure Data Architect

    Azure Data Architect

    Rapsys Technologies Pte Ltd.Chicago, Illinois, US
    Full-time
    We're Hiring : Azure Data Architect! 🌟.We are seeking an experienced and innovative Azure Data Architect to lead our data strategy and design robust solutions to support our business objectives.The...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Spectraforce TechnologiesWood Dale, IL, United States
    Temporary
    Position is remote (can be in any 20 states in Great Midwest area).Wooddale, IL area is the preferred location.M - F, 9am - 5pm CST, need to be available if emergent issues arise.In this role, you ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    KenexaiChicago, IL, United States
    Full-time
    Kenexai delivers smart, data-driven solutions that empower businesses across industries.Our mission is to combine deep, domain-specific expertise with cutting-edge technology to drive meaningful im...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Applied Data & AI Engineer

    Lead Applied Data & AI Engineer

    Hollister IncorporatedLibertyville, IL, United States
    Full-time
    We Make Life More Rewarding and Dignified.Join our Global IT Organization as we shape the future through.We are seeking a strategic yet hands-on. Lead Applied Data and AI Engineer.This role combines...Show moreLast updated: 11 days ago
    • Promoted
    Lead Solutions Architect

    Lead Solutions Architect

    CoSourcing Partners - Enterprise-AI and IT Services CompanyChicago, IL, United States
    Full-time
    Lead Forward Deployed Architect (Palantir & Intelligent Automation Focus).Citizen or Green Card Required).CoSourcing Partners’ AI Staffing and Digital Talent Enablement practice is expanding, and w...Show moreLast updated: 2 days ago
    Data Engineer

    Data Engineer

    DRC SystemsChicago, IL, United States
    Full-time
    Quick Apply
    Data Engineer Chicago IL - 5 days onsite Should have a very good knowledge of Python and should have worked in Data related Projects. Extensive use of various py...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Old National BankChicago, IL, United States
    Full-time
    US-MN-Lake Elmo | US-IN-Evansville | US-IL-Chicago.Old National Bank has been serving clients and communities since 1834. With over $70 billion in total assets, we are a regional powerhouse deeply r...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TAG - The Aspen GroupChicago, IL, United States
    Full-time
    The Aspen Group (TAG) is one of the largest and most trusted retail healthcare business support organizations in the U.Dental Care, Urgent Care, Pet Care, and Medical Aesthetics.Working in partners...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Architect

    Databricks Architect

    IndegeneChicago, IL, United States
    Full-time
    The Databricks Architect - Lead is a critical role within our Data and Analytics practice, tasked with designing, implementing, and optimizing advanced data architectures using Databricks.This role...Show moreLast updated: 2 days ago