Talent.com
Lead Data Engineer (AWS, Azure, GCP)

Lead Data Engineer (AWS, Azure, GCP)

Captech ConsultingPhiladelphia, Pennsylvania, United States
30+ days ago
Job type
  • Full-time
Job description

Company Description

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

  • Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
  • 5+ years of experience delivering data engineering solutions on cloud platform
  • 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
  • Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
  • 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
  • Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
  • Fundamental understanding of big data, open source, and data streaming concepts
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
  • Experience providing technical leadership and mentoring other engineers in data engineering space
  • Cloud certification on any platform a plus
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.  You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.  Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness — each foundational to our core values.  We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click  HERE .  As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email [email protected] .

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    #LI-LM1

    Create a job alert for this search

    Azure Data Engineer • Philadelphia, Pennsylvania, United States

    Related jobs
    Lead Databricks Data Engineer

    Lead Databricks Data Engineer

    eTeam IncPhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will lever...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Cloud Engineer (US)

    Lead Cloud Engineer (US)

    TD BankMt Laurel, NJ, United States
    Full-time
    Mount Laurel, New Jersey, United States of America.TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defini...Show moreLast updated: 19 hours ago
    • Promoted
    AI Cloud Architect

    AI Cloud Architect

    OracleTrenton, NJ, United States
    Full-time
    Proven Experience in Designing and Leading Complex Solutions : .Demonstrated capability in creating large-scale, integrated systems that blend infrastructure, Generative AI, GPUs, and applications ...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Cloud Architect - NoSQL Database Engineer

    Sr. Cloud Architect - NoSQL Database Engineer

    HumanaTrenton, NJ, United States
    Full-time
    Become a part of our caring community and help us put health first.The NoSQL Database Engineer will design, implement, and support MongoDB, Neo4j, and vector database solutions within Humana's ente...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Cloud Engineering Technical Manager

    AWS Cloud Engineering Technical Manager

    Unisys CorporationBlue Bell, PA, United States
    Full-time
    What success looks like in this role : .Develop and implement the cloud strategy aligned with business goals.Lead and mentor a team of cloud engineers and architects. Foster a culture of innovation an...Show moreLast updated: 30+ days ago
    AWS Developer

    AWS Developer

    Sunrise SystemsTrenton, New Jersey, United States
    Full-time
    Quick Apply
    Duration : 05 Months On Contract with possible extensions.Interview Type : In Person Only.Our seeking a skilled AWS Developer to support the design, development, and deployment of cloud-based solutio...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Inherent TechnologiesPrinceton, NJ, United States
    Full-time
    Quick Apply
    Position : Data Engineer Location : Princeton, NJ • • •Day 1 Onsite • • • Duration : 1 Years Show moreLast updated: 3 days ago
    Cloud Engineer

    Cloud Engineer

    Meta Force Technology Staffing LLCPhiladelphia, PA, United States
    Full-time
    Quick Apply
    Philadelphia, PA Position : Sr.Cloud Engineer Job Description : The Sr Cloud Engineer is respo...Show moreLast updated: 3 days ago
    • Promoted
    Sr AWS Cloud DevOps Engineer

    Sr AWS Cloud DevOps Engineer

    Unisys CorporationBlue Bell, PA, United States
    Full-time
    What success looks like in this role : .DevSecOps Pipeline Design & Automation : .Design and implement secure, automated CI / CD pipelines in AWS using tools like AWS CodePipeline, Jenkins, GitLab CI, an...Show moreLast updated: 30+ days ago
    AWS Cloud Engineer

    AWS Cloud Engineer

    eTeam IncPhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    Position based in either Philadelphia, PA, or Washington, DC.AWS Cloud Engineer to build and deploy highly scalable, reliable, and secure cloud environments for customers using innovative automatio...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Analyst

    AWS Data Analyst

    System One Holdings, LLCPrinceton, NJ, United States
    Full-time
    Location : Princeton, New Jersey.Contractor Work Model : Hybrid - Must be local and willing to go into the office 2 - 3 days a week. Security Clearance : No clearance required.Must be US Citizen or Gre...Show moreLast updated: 5 days ago
    • Promoted
    Cloud Application Engineer (GCP & Azure)

    Cloud Application Engineer (GCP & Azure)

    ArtechCollegeville, PA, United States
    Full-time
    Role : Cloud Application Engineer (GCP & Azure).Location : Collegeville, PA (Onsite).Cloud Development, with C or with either Java OR Golang. Must Have 4 to 7 years of experience in Google Cloud.Must...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Lead Cloud Engineer (US)

    Lead Cloud Engineer (US)

    TD Bank GroupMt Laurel, NJ, United States
    Full-time
    Mount Laurel, New Jersey, United States of America.TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defini...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    JPC PartnersPhiladelphia, PA, United States
    Full-time
    The Sr Cloud Engineer is responsible for ensuring successful implementations, accompanying operational processes, support and documentation of cloud and hybrid cloud projects, primarily, but not li...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer / Analyst

    Data Engineer / Analyst

    Stoltz Management of DelawareBala-Cynwyd, PA, United States
    Full-time
    United States employment visas at this time.Co-CEO & Chief Operating Officer.We are seeking a seasoned professional with expertise in data engineering, data management, analytics, and reporting to ...Show moreLast updated: 16 days ago
    Technical Product Owner – Data & Analytics

    Technical Product Owner – Data & Analytics

    MindlancePhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    Are you a dynamic Technical Product Owner with a passion for transforming data into powerful insights? We're seeking a lead member to join our agile delivery team and drive the development of impac...Show moreLast updated: 30+ days ago
    Senior AWS Cloud Architect

    Senior AWS Cloud Architect

    eTeam IncPhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    Position based in either Philadelphia, PA, or Washington, DC.As a Senior AWS Cloud Architect you will be responsible for designing, building, and deploying highly scalable, reliable, and secure clo...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Analyst

    AWS Data Analyst

    System OnePrinceton, NJ, United States
    Full-time
    Location : Princeton, New Jersey.Contractor Work Model : Hybrid - M ust be local and willing to go into the office 2 – 3 days a week. Security Clearance : No clearance required.Must be US Citizen or Gr...Show moreLast updated: 5 days ago