Talent.com
Sr. Data Engineer

Sr. Data Engineer

A.M. BestJersey City, NJ, United States
3 days ago
Job type
  • Full-time
Job description

Benefits Summary

  • Flexible and hybrid work arrangements
  • Paid time off / Paid company holidays
  • Medical plan options / prescription drug plan
  • Dental plan / vision plan options
  • Flexible spending and health savings accounts
  • 401(k) retirement savings plan with a Roth savings option and company matching contributions
  • Educational assistance program

Overview

The Sr. Data Engineer requires expertise in DataOps and is responsible for guaranteeing dependable, scalable and effective data processes and solutions by combining components, functions and skills from data engineering, software engineering and IT Operations. This role is critical to AM Best's goal of developing, maintaining and scaling a sophisticated platform for data and analytics.

Responsibilities

Create and support scalable data solutions :

  • Build high performance data systems including databases, APIs, and data integration pipelines
  • Implement a metadata-driven architecture and infrastructure as code approach to automate and simplify the design, deployment, and management of data systems
  • Facilitate the adoption of data and software engineering best practices, including code review, testing, and continuous integration and delivery (CI / CD)
  • Develop and establish a data governance framework
  • Continuous monitoring of process performance and implement improvements for efficiency including fine-tuning existing ETL processes, optimizing queries, or refactoring code
  • Assess and make optimal use of cloud platforms and technologies, especially Azure and Databricks to enhance system architecture
  • Implement data quality checks and build processes to identify and resolve data issues
  • Create and maintain documentation for data architecture, standards, and best practices
  • Contribute designs, code, tooling, testing, and operational support
  • Increase operational efficiency :

  • Identify opportunities for process optimization and automation to enhance data operations efficiency
  • Leadership and innovation :

  • Provide technical leadership to the data engineering team and actively lead design discussions
  • Ensure that the new data infrastructure remains modern and efficient by staying knowledgeable of the latest tools, technologies, and methodologies in the data and analytics space
  • Qualifications

  • 7 plus years of experience working as a Data Engineer, Data Architect, Database Developer or similar roles
  • Bachelor's Degree in Computer Science, Data Science, Engineering or related field
  • Skills

  • 7+ years of experience in programming languages such as Python, Scala, Java, Rust or similar
  • 7+ years of experience in Oracle OLTP database design and development
  • 7+ years of experience in building ETL / ELT data pipelines using Apache Spark, Airflow, dbt or similar
  • 7 years of experience in developing APIs that include REST, SOAP, RPC, GraphQL or similar
  • 7 years of experience in OLAP / data warehouse design and development using dimensional (Kimball star-schema), data vault or Inmon methodologies
  • 5 years of experience in NoSQL database design and development preferably on MongoDB or similar
  • 5 years of experience working with message broker platforms like RabbitMQ, Apache Kafka, Red Hat AMQ or similar
  • 5 years of experience working with Azure or AWS cloud-native technologies / services
  • Working knowledge of CI / CD automation tools or services like Jenkins, Ansible, Chef, Puppet or similar
  • Working knowledge of containerized platform or services like Docker, Kubernetes or similar
  • Must be hands-on, have a passion for data and problem solving, and an innovative mind-set to help deliver results across projects
  • Pluses :

  • Experience working with Databricks data intelligence platform
  • Experience working with business intelligence tools / platforms like PowerBI, Cognos, Tableau or similar
  • Experience working with caching databases : Memcache,Redis or similar
  • Experience working with search databases and platforms : Elasticsearch, Apache Solr or similar
  • Experience working with data modeling tools : ERwin, ERStudio, Navicat, SqlDBM or similar
  • Knowledge of data governance tools : Colibra, Alation or similar
  • Knowledge of master data management tools : Informatica, TIBCO, Riversand, Ataccama or similar
  • Create a job alert for this search

    Sr Data Engineer • Jersey City, NJ, United States

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Interactive BrokersGreenwich, CT, US
    Full-time
    Interactive Brokers Group, Inc.Nasdaq : IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial...Show moreLast updated: 1 day ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, IncNew York, NY, United States
    Full-time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    CVS HealthRutherford, NJ, United States
    Full-time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 2 days ago
    • Promoted
    Data Platform Engineer (USA)

    Data Platform Engineer (USA)

    Trexquant InvestmentStamford, CT, US
    Full-time
    Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading ope...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr Data Engineer

    Sr Data Engineer

    APN ConsultingJersey City, NJ, United States
    Full-time
    IT staffing and services company offering innovative business solutions to improve client business outcomes.We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and ...Show moreLast updated: 17 hours ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Diverse LynxNew York, NY, United States
    Full-time
    Job Description : The ideal candidate will have a strong background in data engineering and development, with expertise in various data skills and tools. The role involves working on complex data pro...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    VimeoNew York, NY, US
    Full-time
    Vimeo's mission is to help every business and video professional grow their brand with video.Through our ever expanding suite of tools that allows everyone to create, manage, share, and sell vi...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Gametime UnitedNew York, NY, US
    Full-time
    Live experiences help people cross today's digital divide and focus on what truly connects us – the here, the now, this once-in-a-lifetime moment that's bringing us together.To fulfil...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Interactive BrokersGreenwich, CT, US
    Full-time
    Interactive Brokers Group, Inc.Nasdaq : IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Maven ClinicNew York, NY, US
    Full-time
    Maven is the world's largest virtual clinic for women and families on a mission to make healthcare work for all of us.Maven's award-winning digital programs provide clinical, emotional, and...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    Garner HealthNew York, NY, US
    Full-time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique...Show moreLast updated: 30+ days ago
    • Promoted
    Integration Data Engineer

    Integration Data Engineer

    Shulman Fleming & PartnersIselin, NJ, US
    Full-time
    MUST be local to Iselin, NJ, Hybrid Schedule at least 3 days onsite.We are seeking an Integration Data engineer with a background in SQL and data warehousing for enterprise level systems.The ideal ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    QodeFlorham Park, NJ, US
    Full-time
    We are looking for an enthusiastic Campus Data Engineer who is eager to start a career in data engineering and analytics. The ideal candidate should have a strong academic background in computer sci...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SW5 ConsultingNew York, NY, US
    Full-time
    We're seeking a talented Senior Data Engineer to help reshape how brands communicate—by empowering them to market with precision, not excess. You’ll play a pivotal role in building s...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Software Engineer (Data and Personalization)

    Sr. Software Engineer (Data and Personalization)

    Consumer ReportsYonkers, NY, US
    Full-time
    Consumer Reports is an independent, nonprofit organization dedicated to a fair and just marketplace for consumers.Our team is made up of truth tellers, change agents, and consumer advocates who inv...Show moreLast updated: 1 day ago
    • Promoted
    Data Analytics Engineer II

    Data Analytics Engineer II

    Garner HealthNew York, NY, US
    Full-time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineer - Data Platforms

    Senior Engineer - Data Platforms

    CoreWeaveLivingston, NJ, US
    Permanent
    CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI.Our technology provides enterprises and leading AI labs with the most perfo...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    ThrotleRed Bank, NJ, US
    Full-time
    Please consider joining our technology team at Throtle as a Big Data Developer.In this role, you will be part of the team that is responsible for transforming and maintaining several billion record...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Contact Government Services, LLCNew York, NY, United States
    Full-time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ApplecartNew York, NY, US
    Full-time
    Decision Maker Marketing".The most important decisions are made by the hardest people to reach and influence.Historically, C-suite leaders have lacked the tools to reach the stakeholders that ...Show moreLast updated: 30+ days ago