Senior Data Engineer
Apptad IncGA, United States5 days ago
Job type
- Full-time
- Quick Apply
Job descriptionDevelop, optimize, and maintain BigQuery stored procedures (SPs), SQL scripts, and Build and manage data orchestration workflows using Cloud Composer (Airflow) with appropriate Establish secure and efficient connections to source systems for data ingestion and integration. Manage data ingestion workflows from on-premise and cloud sources into Google Cloud Storage Execute history data migration from legacy data warehouses (preferably Snowflake, Teradata, Collaborate with data analysts and architects to define scalable and reusable data models, views, Troubleshoot data pipeline failures, perform root cause analysis, and implement preventive Optimize cost and performance of GCP workloads using best practices for BigQuery and Strong hands-on experience in Google Cloud Platform (GCP) with expertise in BigQuery, Proficient in Python programming for data engineering (Dataflow pipelines, validation scripts, Expertise in BigQuery SQL, Stored Procedures, Views, and User Defined Functions (UDFs). Experience with data migration from on-premise or cloud data warehouses (preferably Snowflake, Strong understanding of ETL / ELT frameworks, data modeling, and schema design Familiarity with data governance, metadata, and lineage frameworks on GCP. Knowledge of data validation and testing techniques, including reconciliation, rule-based checks, Hands-on experience in workflow orchestration using Cloud Composer (Airflow) with custom Strong SQL tuning and BigQuery performance optimization skills. Good communication and collaboration skills to work with cross-functional teams in Agile Proven ability to troubleshoot, optimize, and enhance complex data workflows at scale.
Job Title : Senior Data Engineer
Location : Secaucus, NJ(Remote)
Mandatory - GCP BigQuery, Dataflow, Python, Cloud Composer, Data Governance & Validation
Job Description : Key Responsibilities
- Design and implement end-to-end data pipelines using Cloud Dataflow (Python / Apache Beam) for
batch and streaming data.
user-defined functions (UDFs) for complex transformations and business logic implementation.
operators and dependencies.
(GCS) and BigQuery.
Netezza, Oracle, SQL Server) to BigQuery, ensuring accuracy and performance optimization.
and semantic layers in BigQuery.
measures.
Dataflow.
Technical & Soft Skills Required
Dataflow, Cloud Composer, and GCS.
automation).
Teradata, Netezza, Oracle, SQL Server) to BigQuery.
(Star / Snowflake).
and automation.
operators.
environments.
Create a job alert for this search
Senior Data Engineer • GA, United States
Related jobs
Job Summary We are seeking a highly experienced Lead GCP Data Engineer to design, build, and optimize scalable data engineering solutions on Google Cloud Platform.The ideal candi...Show moreLast updated: 3 days ago Position : Cloud Engineer Openings : 2 Location : 100% Remote Method : CTH Duration : 6 9 month CTH Interview Process : technical screening with the team.
Competition : likely Start Date : ASAP <...Show moreLast updated: 30+ days ago Job Summary We are seeking an experienced Data Modeler with strong expertise in Teradata and Erwin Data Modeler tools.The ideal candidate will be responsible for designing, implementing, and mainta...Show moreLast updated: 2 days ago 
Job Title : Shopper Team Member Employer : Amazon.As a Shopper Team Member at Amazon, you will be responsible for shopping and preparing customer orders for delivery.
You will use your knowledge of th...Show moreLast updated: 19 days ago Job Summary : We are seeking a highly skilled Senior Data Engineer with 12+ years of experience to design, build, and optimize large-scale data processing solutions.The ideal cand...Show moreLast updated: 2 days ago 
Job ID : Data Strategy and Analytics Lead Data Architect Client : State of CT - DAS ...Show moreLast updated: 2 days ago
The billing specialist performs a wide variety of duties relating to review, analysis, billing, adjusting, finalizing, and filing of all third-party and private insurance company claims.The evaluat...Show moreLast updated: 1 day ago
Interventional Cardiologist Opportunity in Florida Location : Florida Income Source : Private Practice Primary Specialty : Cardiology-Interventional About Us : We are a dynamic healthcare practice loca...Show moreLast updated: 30+ days ago Job Title : GCP Infrastructure & AI Engineer Show moreLast updated: 3 days ago Position : AWS Engineer- Python scripting, CI / CD pipelines, (IaC) Terraform- Visa Independent Job Description AWS Engineer Python scripting, CI / CD pipelines...Show moreLast updated: 3 days ago 
PTL Offers OTR, running primarily east of I35, with Dedicated and Regional positions to ensure a home time schedule that will meet your needs.
PTL offers some of the highest take home pay by paying ...Show moreLast updated: 1 day ago
It will be your responsibility to tag molds properly, de-hook, grind, dewax, flash fire, and program fire molds.Provide the floor area with product on time.
You will be required to run sensitive equ...Show moreLast updated: 30+ days ago Job Role - Cloud Data Engineer Location - Minneapolis, MN(Remote) $65 / hr.Job Details : Minimum of 5+ years of experience as a Cloud Da...Show moreLast updated: 2 days ago Greetings from IT Resonance!! We are looking for a Azure Data Engineer Remote + Occasional Direct Client for the below role.
Kindly let me know if you are inter...Show moreLast updated: 3 days ago Required Skills & Experience : 7+ years of exp as a data engineer Ability to help with solution design Developed within Azure Data Bricks Expert at ETL Proficiency in 2 script...Show moreLast updated: 3 days ago PLEASE NO C2C SUBMISSIONS OR AGENCIES - ONLY DIRECT APPLICANTS ONLY • • Our client, a mid-sized and forward-thinking consulting firm (named to Forbes' Best Management Consulti...Show moreLast updated: 3 days ago 
Make sure to read the full description below, and please apply immediately if you are confident you meet all the requirements.
DoorDash is the #1 category leader in food delivery, food pickup, and c...Show moreLast updated: 14 days ago
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...Show moreLast updated: 30+ days ago
Director of Cloud Engineering
OpenkyberGA, United StatesFull-time
Quick Apply
Nexus
OpenkyberGA, United StatesFull-time
Quick Apply
Data Warehouse Architect
OpenkyberGA, United StatesFull-time
Quick Apply
- Promoted
Shopper Team Member
AmazonAiley, GAFull-time
Spark Architect
OpenkyberGA, United StatesFull-time
Quick Apply
Data Architect
nLeagueGA, United StatesFull-time
Quick Apply
- Promoted
Billing Specialist
Coffee Regional Medical CenterDouglas, GA, United StatesFull-time
- Promoted
Physician / Cardiology - Interventional / Georgia / Permanent / Interventional Cardiology Job in Geo
Hayman Daugherty Associates, IncHazlehurst, GA, USPermanent
GCP Engineer
OpenkyberGA, United StatesFull-time
Quick Apply
AWS Engineer
OpenkyberGA, United StatesFull-time
Quick Apply
- Promoted
CDL A Company Driver
Paschall Truck LinesHazlehurst, GA, USFull-time
- Promoted
Investment Operator - 1st Shift
Precision Castparts CorpDouglas, GA, United StatesFull-time +1
Cloud Data Engineer
Apptad IncGA, United StatesFull-time
Quick Apply
Azure Engineer
OpenkyberGA, United StatesFull-time
Quick Apply
Chief AI Architect
OpenkyberGA, United StatesFull-time
Quick Apply
Enterprise Cloud Architect
OpenkyberGA, United StatesFull-time
Quick Apply
- Promoted
Restaurant Delivery
DoordashDouglas, Georgia, USFull-time +2
- Promoted
Work from Home
HomeJobFinderTarrytown, GARemote
Full-time