Talent.com
No longer accepting applications
Data Engineer - GCP

Data Engineer - GCP

Northwell HealthMelville, NY, United States
1 day ago
Job type
  • Full-time
Job description
  • Job Description
  • We are seeking a GCP Data Engineer to design, build, and maintain our enterprise data platform, with a primary focus on BigQuery development and optimization. You will be responsible for developing robust ETL pipelines to migrate and load data from our on-premises systems to GCP, ensuring data quality and reliability at scale. In this role, you will support our existing data infrastructure, troubleshoot production issues, and collaborate with analytics and business teams to enable data-driven decision-making. Ensures systems compliance to applicable laws, regulatory standards and policies.

    Job Responsibility

    • Design, build, and maintain scalable and reliable ELT / ETL pipelines to ingest data from a wide variety of sources (APIs, databases, event streams, flat files).
    • Orchestrate, schedule, and monitor data workflows using tools like Cloud Composer (Airflow), ensuring high data availability and quality.
    • Collaborate with analysts, data scientists, and product managers to understand data requirements and deliver high-impact data solutions.
    • Implement and manage data infrastructure using Infrastructure as Code (IaC) principles (e.g., Terraform).
    • Analyze query performance, diagnose execution plan bottlenecks, and refactor complex SQL to improve speed and efficiency.
    • Monitor Google BigQuery slot utilization, identify resource-intensive jobs, and make data-driven recommendations on optimization opportunities
    • Develop and enforce a robust data security framework using IAM roles, Row-Level Security , and Column-Level Security to ensure data is secure and compliant with the principle of least privilege
    • Implement data masking policies to protect personally identifiable information (PII) and other sensitive data
    • Utilize Cloud Logging and audit logs to monitor data access, support compliance requirements (GDPR, CCPA, etc.), and investigate security events
    • Implements the information system initiatives to meet user requirements; communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility; develops system specifications that appropriately meet department requirements.
    • Assesses the patient management inpatient and outpatient registration pathways for constant improvement and enhancement; incorporates financial regulatory requirements; administers system support for patient management system users; evaluates information technology to promote operational efficiency and financial reimbursement.
    • Reviews contractual obligations, ensures status of deliverables, and resolves related issues; performs periodic post-installation reviews of system initiatives.
    • Reviews and evaluates post-installation processing per documented specifications; creates ad-hoc reports to ensure system builds are functioning according to specifications and ensures accurate payments.
    • Develops and conducts in-services for Patient Financial Services / Accounts; creates appropriate in-service training materials.
    • Conducts system-wide in-services with managers and staff, as necessary; ensures systems compliance to applicable laws, regulatory standards and policies.
    • Operates under general guidance and work assignments are varied and require interpretation and independent decisions on course of action.
    • Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions.
    • Job Qualification

    • Bachelor's Degree required, or equivalent combination of education and related experience
    • Minimum of two (2) years of experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required.
    • Experience in software development in enterprise / web / cloud applications, solutioning, architecture and frameworks.
    • Big data expertise with cloud and enterprise level design / implementation.
    • Experience in architecting data warehouses and / or data lakes with traditional database enterprise-class RDBMS technologies.
    • Strong knowledge of programming languages / tools including : Java, Python, Spark, SQL, R, and Shell Scripts.
    • HIGHLY PREFERRED

    • Deep, hands-on expertise with Google BigQuery is a must.
    • Expert-level SQL skills, including experience with query plan analysis and optimization.
    • Strong experience building and managing ELT / ETL pipelines using modern data stack tools (e.g., dbt, Airflow, etc).
    • Proficiency in a scripting language, preferably Python.
    • Solid understanding of the broader Google Cloud Platform (GCP) ecosystem (e.g., Cloud Storage, IAM, Cloud Functions, Cloud Logging).
    • A governance-first mindset with a passion for data quality, security, and cost control.
    • Experience supporting BI tools like Looker, Tableau, or Power BI that are connected to BigQuery.
    • Additional Salary Detail
    • The salary range and / or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future. When determining a team member's base salary and / or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).

    Create a job alert for this search

    Gcp Data Engineer • Melville, NY, United States

    Related jobs
    • Promoted
    C++ Market Data Engineer

    C++ Market Data Engineer

    Trexquant InvestmentStamford, Connecticut, United States
    Full-time
    Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading ope...Show moreLast updated: 30+ days ago
    eCom Data Engineer Specialist

    eCom Data Engineer Specialist

    PepsiCoUSA, New York, Purchase
    Full-time
    PepsiCo operates in an environment undergoing immense and rapid change.Big data and digital technologies are driving business transformation that is unlocking new capabilities and business innovati...Show moreLast updated: 30+ days ago
    Data Operations Engineer (USA)

    Data Operations Engineer (USA)

    Trexquant InvestmentStamford, CT, US
    Full-time
    Quick Apply
    Trexquant is a growing systematic fund manager with a core team of highly accomplished technologists.We are currently seeking an enthusiastic and skilled Data Operations Engineer with a strong oper...Show moreLast updated: 30+ days ago
    • Promoted
    Software Development Engineer II

    Software Development Engineer II

    Altice USABethpage, NY, United States
    Full-time
    Are you looking to Optimize your life? Start your exciting path to a rewarding career today!.We are Optimum, a leader in the fast-paced world of connectivity, and we're on the hunt for enthusiastic...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AqrGreenwich, Connecticut, United States
    Full-time
    AQR is a global investment firm built at the intersection of financial theory and practical application.We strive to deliver concrete, long-term results by looking past market noise to identify and...Show moreLast updated: 30+ days ago
    Data Analytics Engineer (Onsite, not remote)

    Data Analytics Engineer (Onsite, not remote)

    Westchester Medical CenterValhalla, New York, United States, 10595
    Remote
    Full-time
    Data Analytics Engineer (Onsite, not remote).As an Analytics Engineer within the Operational Excellence & Enterprise Analytics Department, you will be responsible for expanding and optimizing our n...Show moreLast updated: 23 days ago
    • Promoted
    Electronics Packaging Design Engineer

    Electronics Packaging Design Engineer

    P Chappel Associates IncRonkonkoma, NY, US
    Full-time
    We are seeking an experienced Electronics Packaging Design Engineer to join our team.In this role, you will lead the design of advanced packaging solutions including flip-chip BGA, ceramic packages...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Bioinformatics Engineer (Hybrid Onsite / Remote)

    Senior Bioinformatics Engineer (Hybrid Onsite / Remote)

    Northwell HealthLake Success, NY, United States
    Remote
    Full-time
    This role involves engaging directly with the Northwell Genomics Health Initiative (NGHI) team to develop and maintain bioinformatics pipelines for next-generation sequencing (NGS) data processing ...Show moreLast updated: 1 day ago
    Sr. Data Analytics Engineer (on-site, not remote)

    Sr. Data Analytics Engineer (on-site, not remote)

    Westchester Medical CenterValhalla, New York, United States, 10595
    Remote
    Full-time
    Data Analytics Engineer (on-site, not remote).Data Analytics Engineer within the Operational Excellence & Enterprise Analytics Department, you will be responsible for expanding and optimizing our n...Show moreLast updated: 23 days ago
    • Promoted
    Fulltime BI Data Engineer in NYC

    Fulltime BI Data Engineer in NYC

    Nuware TechnologiesFloral Park, NY, US
    Full-time
    What we're seeking Bachelor’s degree in Engineering or Computer Science 6+ years of experience in Microsoft SQL Server 6+ years of experience in ETL tools like Microsoft SSIS 3 years software devel...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Innovative Rocket Technologies Inc.New Hyde Park, NY, US
    Full-time
    Quick Apply
    Data is pivotal to our goal of frequent launch and rapid iteration.We’re recruiting a Data Engineer at iRocket to build pipelines, analytics, and tools that support propulsion test, launch operatio...Show moreLast updated: 30+ days ago
    • Promoted
    Early Careers : Data Solutions Launch

    Early Careers : Data Solutions Launch

    AonNorwalk, CT, United States
    Full-time +1
    Early Careers : Associate Consultant - Data Solutions.Aon is in the business of better decisions.At Aon, we shape decisions for the better to protect and enrich the lives of people around the world....Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Interactive BrokersGreenwich, Connecticut, United States
    Remote
    Full-time
    Interactive Brokers Group, Inc.Nasdaq : IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial...Show moreLast updated: 30+ days ago
    • Promoted
    Talend Engineer

    Talend Engineer

    Resourcesoft Inc.Greenwich, CT, US
    Full-time
    Data Engineering and ETL development.Proficiency in Talend Data Integration tools.Experience with advanced SQL for query optimization. Experience with cloud data warehouses (Snowflake, Redshift, Big...Show moreLast updated: 18 days ago
    Data Engineer

    Data Engineer

    Suffolk Credit UnionMedford, NY, USA
    Full-time
    Quick Apply
    At Suffolk Credit Union, we empower our members and strengthen our community by promoting financial wellness, transparency, and respect. Join us to enjoy comprehensive benefits, including health pla...Show moreLast updated: 2 days ago
    • Promoted
    Engineer, Data Visualization and Business Intelligence

    Engineer, Data Visualization and Business Intelligence

    KPMGStamford, CT, United States
    Full-time
    Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries. Our growth is driven by delivering re...Show moreLast updated: 11 days ago
    C++ Market Data Engineer (USA)

    C++ Market Data Engineer (USA)

    Trexquant InvestmentStamford, CT, US
    Full-time
    Quick Apply
    Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading ope...Show moreLast updated: 30+ days ago
    • Promoted
    RELIABILITY ENGINEER

    RELIABILITY ENGINEER

    Brains Workgroup, Inc.Huntington Station, NY, US
    Permanent
    One of our clients, a major electronics manufacturer is looking for a talented RELIABILITY ENGINEER Permanent position with excellent compensation package and benefits. Salary range is 100 - 117K Lo...Show moreLast updated: 30+ days ago