Talent.com
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

ZipRecruiterCharlotte, NC, United States
4 days ago
Job type
  • Full-time
Job description

Job DescriptionJob DescriptionCompany Description

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

  • Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
  • 5+ years of experience delivering data engineering solutions on cloud platform
  • 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
  • Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
  • 5+ years of experience with at least one programming (Python, Java, R, C / C# / C++, Shell)
  • Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
  • Fundamental understanding of big data, open source, and data streaming concepts
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
  • Experience providing technical leadership and mentoring other engineers in data engineering space
  • Cloud certification on any platform a plus
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.  You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.  Alongside our suite of traditional benefits encompassing generous PTO, health coverage, insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, , and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate and into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, and fairness — each foundational to our core values.  We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our , and Belonging efforts, click HERE.  As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email lmassa@captechconsulting.com.

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    #LI-LM1

    Create a job alert for this search

    Azure Data Engineer • Charlotte, NC, United States

    Related jobs
    • Promoted
    • New!
    Senior Lead AWS Data Engineer

    Senior Lead AWS Data Engineer

    Accord Technologies IncMooresville, NC, United States
    Full-time
    Lead the design, implementation, and optimization of ETL workflows using Python and Spark.Build and maintain state-of-the-art data platforms on AWS, contributing to a robust Lakehouse architecture....Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Senior Data Engineer Python, PySpark & AWS(hybrid)

    Senior Data Engineer Python, PySpark & AWS(hybrid)

    eTeamCharlotte, NC, United States
    Full-time
    We are seeking a candidate who has hands on experience using Python, Pyspark and AWS technologies.The ideal candidate should have extensive hands on experience designing, building and integrating s...Show moreLast updated: 14 hours ago
    • Promoted
    Lead AI Cloud Engineer

    Lead AI Cloud Engineer

    ExperisCharlotte, NC, United States
    Full-time
    Our client, a leader in financial services, is seeking a Lead AI Cloud Engineer to join their team.As a Lead AI Cloud Engineer, you will be part of the engineering department supporting innovative ...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    QodeFort Mill, SC, US
    Full-time
    AWS Data Engineer (Spark, AWS, Glue).FEFF;Location : Fort Mill SC (Hybrid).Work with development teams and other project. Design and develop data applications using big data technologies (AWS, Spark...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Glue Data Engineer

    AWS Glue Data Engineer

    QodeFort Mill, SC, US
    Full-time
    Job Title : AWS Glue Data Engineer.Fort Mill, SC or New York City, NY (Hybrid).We are seeking a highly skilled.The ideal candidate will have strong expertise in AWS cloud-native data services, data ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - AI / BI Analytics

    Senior Data Engineer - AI / BI Analytics

    Bank of AmericaCharlotte, NC, United States
    Full-time
    Senior Data Engineer - AI / BI Analytics.Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware.To proceed with your application, you must be at least 18 years of age.To procee...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Aroha TechnologiesCharlotte, NC, US
    Full-time
    Lead Data Engineer Locaiton : - Charllote, NC or Jersey City, NJ Long Term Required RDBMS (e.PostgreSQL, SQL Server) and different data formats (e. JSON, Parquet) , robust data platforms on the AWS ec...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    American Red CrossCharlotte, NC, United States
    Full-time
    Please use Google Chrome or Mozilla Firefox when accessing Candidate Home.By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spi...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer - WM

    Data Engineer - WM

    QodeFort Mill, SC, United States
    Full-time
    Data Engineer - Wealth Management.We are seeking a highly skilled.The ideal candidate will have strong expertise in.Python, PySpark, AWS Glue, Lambda, and Redshift. Implement serverless data workflo...Show moreLast updated: 4 days ago
    • Promoted
    Lead API Python + AWS Developer - REMOTE

    Lead API Python + AWS Developer - REMOTE

    PerficientCharlotte, NC, US
    Remote
    Full-time
    We currently have a career opportunity for a Lead API Python Developer to join our remote team located in Fort Mill, SC.This is a hybrid role which require onsite presence up to 3 days per week.As ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingCharlotte, NC, United States
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the resul...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior AWS Data Engineer [Equity & Fixed Income asset / Indices experience]

    Senior AWS Data Engineer [Equity & Fixed Income asset / Indices experience]

    SynechronFort Mill, SC, United States
    Full-time
    Senior AWS Data Engineer [Equity & Fixed Income asset / Indices experience].Senior AWS Data Engineer [Equity & Fixed Income asset / Indices experience]. This range is provided by Synechron.Your actual...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Senior Data Engineer Leader

    Senior Data Engineer Leader

    LPL FinancialFort Mill, SC, United States
    Full-time
    We are looking for a talented and experienced Sr.Software Data Engineer Leader to be part of the Data Technology Engineering team responsible for building a systems-of-record (SOR) modernization in...Show moreLast updated: 16 hours ago
    • Promoted
    Principal Cloud Engineer - AWS

    Principal Cloud Engineer - AWS

    The HartfordCharlotte, NC, United States
    Full-time
    Principal Cloud Engineer - IE06ME.We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportu...Show moreLast updated: 4 days ago
    • Promoted
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    Capgemini USAAvance ConsultingCharlotte, NC, United States
    Full-time
    Design, develop, and deploy cloud-based solutions using GCP services such as DataFlow, DataFusion, Dataproc, Composer, GCS, BigQuery, and more. Build and maintain robust, scalable, and efficient Pyt...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Snowrelic IncCharlotte, NC, United States
    Full-time
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Design and implement scalable data pipelines and architectures on Azure Databricks.Optimize ETL / ELT wo...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer AWS Azure GCP

    Data Engineer AWS Azure GCP

    CapTech ConsultingCharlotte, NC, United States
    Full-time
    CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers.We build pipelines...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingCharlotte, NC, US
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Keylent IncCharlotte, NC, United States
    Full-time
    AWS Services (AWS platform and services knowledge including AWS Lambda, API Gateway) + Data Skills -Glue, Informatica / Kafka / AWS Data flow. Data Engineer with Informatica knowledge).Minimum ten (10) ...Show moreLast updated: 4 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Lincoln Financial ServicesCharlotte, NC, United States
    Full-time
    Radnor, PA (Pennsylvania); Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Greensboro, NC (North Carolina).Hybrid : Employee will work 3 days a week in a Lincoln office.We are seeking an ...Show moreLast updated: 30+ days ago