Job Description
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers.
We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients.
Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future.
We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.
The Value You Deliver (or What You’ll Do)
- Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
- Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
- Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
- Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
- Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.
Qualifications
- Experience building / operating highly available distributed systems of data extraction, ingestion, and processing large data sets
- 5+ years of experience delivering data engineering solutions on cloud platform
- 5+ years of experience implementing modern designs using at least one cloud-based solution / platform (AWS, Azure, GCP)
- Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
- Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
- 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
- Expertise with SQL, database design / structure and data structure (star, snowflake schemas, de / normalized designs)
- 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
- Familiarity with one or more DevOps tools (git, Jenkins, CI / CD, Jira)
- Fundamental understanding of big data, open source, and data streaming concepts
- Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
- Experience providing technical leadership and mentoring other engineers in data engineering space
- Cloud certification on any platform a plus
Additional Information
We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.
You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.
Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs.
- CapFlex Employee-first mentality that supports a hybrid workforce and empowers daily flexibility while servicing our clients
- Learning & Development Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
- Modern Health A mental health and well-being platform that provides 1 : 1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
- Carrot Fertility Inclusive fertility and family-forming coverage for all paths to parenthood including adoption, surrogacy, fertility treatments, pregnancy, and more and opportunities for employer-sponsored funds to help pay for care
- Fringe A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
- Employee Resource Groups Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
- Philanthropic Partnerships Opportunities to engage in partnerships and pro-bono projects that support our communities.
- 401(k) Matching Generous matching and no vesting period to help you continue to build financial wellness
Lead Data Engineer (AWS, Azure, GCP)
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. Experience provid...
Lead Security Engineer - AI ML Data Scientist
Extract and analyze data from JPMC data sources, evaluating the effectiveness and precision of new data sources and data collection techniques. As a Senior Lead Security Engineer at JPMorgan Chase within the Cybersecurity and Technology Controls organization, you are an integral part of an agile tea...
Data Engineer (AWS, Azure, GCP)
Developing data pipelines and other data products using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) . CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable deci...
Lead Data Engineer
As a Lead Data Engineer at McKesson, you will play a crucial role in designing, constructing, and maintaining data architectures, databases, and large-scale processing systems. Excellent understanding of data engineering principles, data architecture, and database management. Implement best practice...
Senior Lead Software Engineer - Data Engineering
As a Senior Lead Software Engineer - Data Engineering at JPMorgan Chase within Employee Platforms, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Experience with large scale dataset...
Air Quality Engineer, AWS Environmental
The AWS Enviromental team is a dynamic team that is critical to enabling AWS’s growth around the world, as well as ensuring compliance of AWS’s global operations, including physical data centers, as well as other AWS facilities, customer-facing enterprises and products. Join a diverse, dynamic, and ...
Lead Software Engineer- Java/AWS
Job responsibilities * Serve as lead developer overseeing the delivery of high-quality, full-stack solutions using Java, JavaScript (Angular, React, Node) and cloud-based technologies while actively contributing to the code base * Utilize AWS services (serverless architecture, La...
AWS Data Engineer
Experienced in data ingestion using various methods API Direct database reads AWS Cross account data copy third party vendor data using FTP process etc. Extensive experience in Databricks Data engineering Job Runs Data Ingestion and Delta Live Tables. As well as previous experience data architecture...
Lead Software Engineer- Java/AWS
As a Lead Software Engineer at JPMorgan Chase within the Workforce Technology team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. We have an exciting and rewarding opportunity for you to take yo...
Lead Software Engineer - Python/AWS
As a Lead Software Engineer at JPMorgan Chase within Consumer & Community Banking Data Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Formal training or certification on...