Talent.com
Data Engineer

Data Engineer

ProSearchWestbrook, ME, United States
3 days ago
Job type
  • Full-time
Job description

Hybrid role

Candidates must be able to work on-site in Westbrook as required.

We are seeking a highly motivated and experienced Data Engineer to join our team and support the accelerated advancement of instrument data pipelines. This role is pivotal in developing changes that deliver instrument data to stakeholders.

This position reports directly to the Development Manager while working on an Agile team and involves collaboration with cross-functional teams including engineering, product, and quality.

TOP (3) REQUIRED SKILLSETS :

  • Strong background in AWS cloud services, with a focus on data storage and pub / sub platforms (S3, SNS, SQS, Lambda, etc.)
  • Proven experience in building and maintaining operational data pipelines, particularly with modern technologies like dbt, Airflow, and Snowflake.
  • Strong proficiency in Python, and SQL.

NICE TO HAVE SKILLSETS :

  • Familiarity with Infrastructure as Code solutions like Terraform
  • Experience with Quality Engineering processes

    • Key Responsibilities

  • Design and implement ingestion and storage solutions using AWS services such as S3, SNS, SQS, and Lambda.
  • Develop and implement analytical solutions leveraging Snowflake, Airflow, Apache Iceberg
  • Collaborate with cross-functional teams to understand and meet data needs for processing.
  • Develop and maintain scalable and reliable data solutions that support IDEXX's operational and business requirements.
  • Document data flows, architecture decisions, and metadata to ensure maintainability and knowledge sharing.
  • Design and implement fault-tolerant systems, ensuring high availability and resilience in our data processing pipelines.
  • Actively participate in testing and quality engineering (QE) processes, collaborating closely with the QE team to ensure the reliability and accuracy of data solutions.

    • Required Skills

  • Strong problem-solving skills and the ability to operate independently, sometimes with limited information.
  • Strong communication skills, both verbal and written, including the ability to communicate complex issues to both technical and non-technical users in a professional, positive, and clear manner.
  • Initiative and self-motivation with strong planning and organizational skills.
  • Ability to prioritize and adapt to changing business needs.
  • Proven experience in building and maintaining operational data pipelines, particularly with modern technologies like dbt, Airflow, and Snowflake.
  • Strong proficiency in Python, and SQL.
  • Strong background in AWS cloud services, with a focus on data storage and pub / sub platforms (S3, SNS, SQS, Lambda, etc.).

    • o Familiarity with Infrastructure as Code solutions like Terraform is a plus

  • Familiarity with a broad range of technologies, including :

    • o Cloud-native data processing and analytics

    o SQL Databases, specifically for analytics

    o Orchestration and ELT technologies like Airflow and dbt

    o Scripting and programming with Python, or similar languages

    o Infrastructure as Code languages like terraform

  • Ability to translate complex business requirements into scalable and efficient data solutions.
  • Strong multitasking skills and the ability to prioritize effectively in a fast-paced environment.

    • Preferred Background

  • Candidates should have a minimum of eight years of experience in a similar role, preferably within a technology-driven environment.
  • Experience building data services and ETL / ELT pipelines in the cloud using Infrastructure as Code and large-scale data processing engines
  • Strong experience with SQL and one or more programming languages (Python preferred)

    • Success Metrics

  • Meeting delivery timelines for project milestones.
  • Effective collaboration with cross-functional teams.
  • Ensure high standards of data accuracy and accessibility in a fast-paced, dynamic environment.
  • Reduction in data pipeline failures or downtime through resilient and fault-tolerant design.
  • Demonstrated contribution to the stability and scalability of the platform through well-architected, maintainable code.
  • Positive feedback from stakeholders (engineering, product, or customer-facing teams) on delivered solutions.
  • Active contribution to Agile ceremonies and improvement of team velocity or estimation accuracy.
  • Proactive identification and mitigation of data-related risks, including security or compliance issues.
    • Create a job alert for this search

    Data Engineer • Westbrook, ME, United States

    Related jobs
    • Promoted
    Data Engineer (Entry-Level)

    Data Engineer (Entry-Level)

    SynergisticITPortland, ME, United States
    Full-time
    SYNERGISTICIT = exceptional skills and technologies enabled Candidates.Tech Clients which you resume requires.Position open for all visas and US citizens. We at Synergisticit understand the problem ...Show moreLast updated: 30+ days ago
    • Promoted
    Information Technology Professional

    Information Technology Professional

    U.S. NavyBuxton, ME, United States
    Full-time +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.At any given moment, hundreds of complex networked computer systems are operating in tandem to keep ships and su...Show moreLast updated: 30+ days ago
    • Promoted
    Nuclear Engineer

    Nuclear Engineer

    U.S. NavyBuxton, ME, United States
    Full-time
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.The most powerful energy sources in the world need the most powerful minds behind them.As a Nuclear Reactors Eng...Show moreLast updated: 30+ days ago
    Stationary Engineer

    Stationary Engineer

    SodexoLEWISTON, ME, US
    Full-time
    Central Maine Medical Center - 44426001.Varying shifts, days / hours (open availability preferred).More details will be provided during the interview process. Working with Sodexo is more than a job; i...Show moreLast updated: 30+ days ago
    • Promoted
    Electronics Engineer

    Electronics Engineer

    U.S. NavyBiddeford, ME, United States
    Full-time +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.Every successful engineering career needs a solid foundation, and thats exactly what youll get.Do your job right...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Echo IT Solutions, Inc.Freeport, ME, United States
    Full-time
    Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.Works independently and collaboratively with team. keeping the project team and leaders...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer - AWS

    Cloud Engineer - AWS

    WEXPortland, ME, United States
    Full-time
    WEX is a global commerce platform that helps businesses solve operational complexities like employee benefits, managing and mobilizing fleets, and streamlining payments. With over 5,500 employees, w...Show moreLast updated: 1 day ago
    • Promoted
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    RelativityPortland, ME, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MaineHealthWestbrook, ME, United States
    Full-time
    The Senior Data Engineer role identifies, designs, tests and develops data load processes and data warehouse architecture solutions that support the business needs of the organization.This role lea...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Staffing the UniverseFreeport, ME, United States
    Full-time
    Location : Freeport, ME (100% Remote).United States are encouraged to apply.We are unable to sponsor at this time.Education : 4-Year Bachelor's Degree. Experience : 3+ years of professional experience.Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    h3 TechnologiesFreeport, ME, United States
    Temporary
    A client of ours is looking for an IT Data Engineer for a 6 month contract opportunity.Qualified candidates will have the following qualifications : . Location of assignment can be remote only but wor...Show moreLast updated: 4 days ago
    • Promoted
    Staff Data Platform Engineer

    Staff Data Platform Engineer

    CVS HealthSanford, ME, United States
    Full-time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    CVS HealthSanford, ME, United States
    Full-time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 4 days ago
    • Promoted
    Staff Enterprise Application Engineer - Palantir

    Staff Enterprise Application Engineer - Palantir

    GE AerospaceAuburn, ME, United States
    Full-time
    Do you have a passion for leveraging data, analytics, and AI to drive meaningful change? At GE Aerospace, we are transforming supply chain processes to address one of our most critical business cha...Show moreLast updated: 4 days ago
    • Promoted
    QA Data Engineer

    QA Data Engineer

    h3 TechnologiesFreeport, ME, United States
    Temporary
    This is a high PRIORITY requisition.This is a PROACTIVE requisition.QA Data Engineer for a 6 month contract opportunity.Qualified candidates will have the following qualifications : .This role involv...Show moreLast updated: 4 days ago
    M-78-Data Architect 144227.

    M-78-Data Architect 144227.

    FHRPortland, ME, US
    Temporary
    Quick Apply
    Data Architect (Job ID : 144227).Location : Hybrid – Augusta, ME (Onsite once per month; candidates in New England preferred). Travel : Client does not cover travel expensesOur direct client in Augusta...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Atlas Technologies IncPortland, ME, United States
    Full-time
    Atlas Tech, a nationally recognized Best Place to Work, supports the US military by providing Enterprise IT solutions to mission-critical, high-availability, and tactical applications.If you thrive...Show moreLast updated: 4 days ago
    • Promoted
    QA Data Engineer

    QA Data Engineer

    SparktekFreeport, ME, United States
    Temporary
    A client of ours is looking for a QA Data Engineer for a 6 month contract opportunity.Qualified candidates will have the following qualifications : . This role involves developing and implementing tes...Show moreLast updated: 4 days ago