Talent.com
Data Engineer AWS Azure GCP

Data Engineer AWS Azure GCP

CapTech ConsultingPhiladelphia, PA, United States
3 days ago
Job type
  • Full-time
Job description

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

Specific responsibilities for the Data Engineer – Cloud position include :

  • Developing data pipelines and other data products using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • Advising clients on specific technologies and methodologies for utilizing cloud resources to efficiently ingest and process data quickly
  • Utilizing your skills in engineering best practices to solve complex data problems
  • Collaborating with end users, development staff, and business analysts to ensure that prospective data architecture plans maximize the value of client data across the organization.
  • Articulating architectural differences between solution methods and the advantages / disadvantages of each

Qualifications : Qualifications

Typical experience for successful candidates includes :

  • Experience delivering solutions on a major cloud platform
  • Ability to think strategically and relate architectural decisions / recommendations to business needs and client culture
  • Experience in the design and implementation of data architecture solutions
  • A wide range of production database experience, usually including substantial SQL expertise, database administration, and scripting data pipelines
  • Ability to assess and utilize traditional and modern architectural components required based on business needs.
  • A demonstrable ability to deliver production data pipelines and other data products. This could be hands on experience, degree, certification, bootcamp, or other learning.
  • Skills :

    Successful candidates usually have demonstrable experience with technologies in some of these categories :

  • Languages : SQL, Python, Java, R, C# / C++ / C
  • Database : SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle
  • DevOps : git, docker, subversion, Kubernetes, Jenkins
  • Additional Technologies : Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
  • Popular Certifications : AWS Cloud Practitioner, Microsoft Azure Data Fundamentals, Google Associate Cloud Engineer
  • Additional Information

    We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions. You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way. Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness
  • CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness — each foundational to our core values. We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click HERE. As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and / or to receive other benefits and privileges of employment, please contact Laura Massa directly via email lmassa@captechconsulting.com.

    At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

    #LI-LM1

    Create a job alert for this search

    Azure Data Engineer • Philadelphia, PA, United States

    Related jobs
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Senior Cloud Engineer.Key Responsibilities Architect, deploy, and manage EKS clusters on AWS, ensuring scalability, reliability, and cost efficiency Design and impleme...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Platform Engineer

    Senior Platform Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Senior Platform Engineer to enhance their technical infrastructure for pediatric care.Key Responsibilities Design and build secure AWS infrastructure and manage network...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Omni InclusiveLansdale, PA, United States
    Full-time
    Need Data Engineer having good experience in Databricks.Strong Data Analytics experience Knowledge of data modeling and Schema design Build processes supporting data transformation, data structures...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Data Engineer (AWS + Python)

    Remote Data Engineer (AWS + Python)

    Motion RecruitmentPhiladelphia, PA, United States
    Remote
    Full-time
    Are you passionate about building scalable, cloud-based data systems?.A leading digital media & streaming company is looking for a Remote Data Engineer to help power their next generation of conten...Show moreLast updated: 3 days ago
    • Promoted
    Data Cloud Solution Engineer

    Data Cloud Solution Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Solution Engineer, Data Cloud.Key Responsibilities Conduct in-person and web-based meetings to drive technical discovery and close opportunities Collaborate with Accou...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    ZipRecruiterPhiladelphia, PA, United States
    Full-time
    Job DescriptionJob DescriptionCompany Description.CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology.At CapTech, w...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer - Pipelines & Analytics

    Data Engineer - Pipelines & Analytics

    Soni ResourcesConshohocken, PA, United States
    Full-time
    Soni's client is seeking a highly skilled Data Engineer to design, build, and maintain scalable, reliable data pipelines that power their analytics ecosystem. You will be responsible for ensuring th...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Azure Engineer

    Sr. Azure Engineer

    WEIDENHAMMER SYSTEMS CORPORATIONBlue Bell, PA, United States
    Full-time
    Azure Solutions Engineer is responsible for designing, creating, and supporting the Azure relationship used in our hosting services operation. The engineer will be focused on improving the stability...Show moreLast updated: 28 days ago
    • Promoted
    Python Engineer with AWS

    Python Engineer with AWS

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Python Engineer with AWS Experience.Key Responsibilities Develop API endpoints and integrations for the U. Department of Veterans Affairs Write code, develop tests, and...Show moreLast updated: 2 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Management Engineer

    Senior Data Management Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Senior Engineer, Data Management (Remote).Key Responsibilities Build and automate data ingestion, transformation, and aggregation pipelines Conduct complex data analys...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingPhiladelphia, PA, US
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for a Senior Data Engineer to lead the data engineering function and enhance data capabilities.Key Responsibilities Design, build, and optimize data architecture, pipelines, ...Show moreLast updated: 30+ days ago
    • Promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocationsPhiladelphia, Pennsylvania, United States
    Full-time
    A company is looking for an Analytics Engineer II (REMOTE).Key Responsibilities Design and build data models and BI dashboards to solve business problems Collaborate with Agile teams to understa...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingPhiladelphia, PA, US
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 1 day ago
    • Promoted
    AI Data Engineer (AIRE)

    AI Data Engineer (AIRE)

    Wipro USAAvance ConsultingPhiladelphia, PA, United States
    Full-time
    Experience in Data Ingestion and integration from various sources and experience building automated ingestion pipelines using AWS . Experience in Data cleaning, processing and transformation for uns...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RIT Solutions, Inc.Wayne, PA, United States
    Full-time
    Location : Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one.Data Engineers will be data mining, writing code, and creating tables / environments in S3.SQL, Pytho...Show moreLast updated: 3 days ago
    • Promoted
    Lead Databricks Data Engineer

    Lead Databricks Data Engineer

    MindteckPhiladelphia, PA, United States
    Full-time
    We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will lever...Show moreLast updated: 30+ days ago