Talent.com
Lead Data Engineer
Lead Data EngineerNextWave Consulting Ltd • New York, NY, US
Lead Data Engineer

Lead Data Engineer

NextWave Consulting Ltd • New York, NY, US
3 days ago
Job type
  • Permanent
Job description

About NextWave

NextWave is an award-winning Digital Acceleration Consultancy for Financial Services with a particular focus on rapidly driving business outcomes and modernizing Financial Institutions through technology. Clients come to NextWave because they have key integration, business growth, efficiency and control objectives and seek a more future-focused alternative to the big-name consultancies. Strategy, Innovation, Complex Transformation, FinTech Solutioning and Social Enterprise are at the heart of what we do.

By combining deep industry expertise with the innovative deployment of business solutions built on market-leading technology, we enable clients to realize business outcomes better, faster and safer. We help our clients to define their strategies and partner with them to execute, often deploying fintech and low-code solutions which can typically be delivered 5x faster than traditional approaches, resulting in processes automated from weeks to minutes and data decision accuracy improvements of up to 90%.

The NextWave team comprises high-caliber Financial Services industry change leaders, including ex-MDs from top-tier firms and new talent. We are the consulting partner of choice for leading FinTechs, Banking, Asset & Wealth Management, Insurance, and Market Infrastructure clients.

Role Outline

As a Lead Data Engineer, you'll lead and mentor a team of data engineers to build scalable, production-grade data solutions within an agile environment. You'll play a key role in deploying Quantexa solutions using technologies such as Spark, Hadoop, Scala, and Elasticsearch, across cloud environments including GCP, Azure, and AWS. You'll collaborate with solution architects and engineers to deliver high-quality, fault-tolerant systems for complex data challenges. You'll also act as a technical advisor to clients, simplifying complex concepts to support informed decision-making.

Key Responsibilities

  • Lead, mentor, and support a team of data engineers within an agile delivery framework.
  • Design and write robust, fault tolerant code, efficient code for production level data processing systems.
  • Configure and deploy the Quantexa software using modern big data tools and cloud platforms, such as Spark, Hadoop, Scala, Elasticsearch; and hosting on both private and public virtual clouds, using tools such as Google cloud, Microsoft Azure and Amazon.
  • Collaborate with solution architects, product owners and technical analysts to establish design and build requirements and be able to translate technical concepts for non-technical stakeholders and clients.
  • Promote best practices, collaboration, and knowledge sharing across engineering teams.

Requirements

  • Hands on data engineering or a similar technical development, with 5+ years of experience of industry and at least 2 years in a leadership position.
  • Proficient in Scala (preferred), Java, Python, or equivalent, and a strong adherence to engineering principles
  • Experience building and deploying production-level batch data processing systems.
  • Strong understanding of software development best practices and release processes.
  • Hands-on experience with tools like Git, Gradle, Jenkins, Docker, and Nexus, and technologies supporting automation and DevOps (e.g. Jenkins, Docker and a little bit of good old Bash scripting). You'll be familiar with developing within a version-controlled process that regularly makes use of these tools and technologies
  • Skilled communicator, comfortable working with clients and cross-functional teams in rapidly changing client environments.
  • Familiarity with testing libraries (e.g., ScalaTest) and different testing approaches (unit, integration) and can give examples of self-written tests
  • Hold Quantexa certification(s).
  • Experience mentoring or managing engineering teams.
  • A passion for innovation and driving business growth.
  • Strong technical, analytical, and communication skills across all organisational levels, both written and verbal
  • Proven stakeholder management and engagement expertise
  • Excellent problem-solving with a logical, structured approach
  • Highly organized with a track record of delivering complex outcomes
  • Benefits

  • Competitive salary
  • Agile / Flexible working
  • Professional training and accreditation
  • Central London location
  • All our opportunities require that applicants are eligible to work in the specified country / location, unless otherwise stated in the job description.

    Our commitment to you :

    We will provide mentoring, training and guidance (technical skills, soft skills and Finance business skills) from our leadership team who have many years of practical experience delivering business outcomes in the Finance arena.

    Work pattern :

    This is a permanent role with a potential for flexibility for agile ways of working, both formal and informal, that allow for the best outcomes for our people and our clients.

    What we do :

    We provide Consulting expertise and delivery services with a focus on a select group of progressive technology platforms which are helping to change the FS Industry.

    The evolution of today's digital business landscape requires firms to reinvent to stay relevant and succeed in the new market, at a pace not seen before. Opportunities and threats are emerging from traditional and non-traditional sectors, driving new strategies across the dimensions of clients, competition, data, innovation and value. A new stack of FinTech platform technologies is enabling firms to reinvent their value proposition to collaborate and compete on customer experience, data insights, operational resilience and time to market.

    Location :

    You will be based in the NextWave USA office, however, travel may be required for client-based projects and some projects will be located fully at client office locations.

    J-18808-Ljbffr

    Create a job alert for this search

    Lead Data Engineer • New York, NY, US

    Related jobs
    Data Engineer Lead

    Data Engineer Lead

    VirtualVocations • Jackson Heights, New York, United States
    Full-time
    A company is looking for a Data Engineer Lead to support and enhance their AWS cloud analytical environment.Key Responsibilities Monitor system performance and ensure optimal operation of the AWS...Show more
    Last updated: 30+ days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    VirtualVocations • Jamaica, New York, United States
    Full-time
    A company is looking for a Data Engineer for a contract role.Key Responsibilities Develop Ab Initio jobs and workflows within the existing metadata-driven framework Review requirements and sourc...Show more
    Last updated: 2 days ago • Promoted
    Lead Analytics Engineer

    Lead Analytics Engineer

    VirtualVocations • Jackson Heights, New York, United States
    Full-time
    A company is looking for a Lead Analytics Engineer.Key Responsibilities Design and build dimensional models, data marts, and semantic layers using DBT Collaborate with stakeholders to understand...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Newark, New Jersey, United States
    Full-time
    A company is looking for a Cloud Data Engineer to join the Data Office Team in modernizing enterprise analytics.Key Responsibilities Design and develop data pipelines and ELT processes to integra...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    Relativity • Newark, NJ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocations • Jamaica, New York, United States
    Full-time
    A company is looking for a Principal Data Engineer to join their Data Engineering team.Key Responsibilities Design, implement, and maintain data models, pipelines, and architecture for healthcare...Show more
    Last updated: 30+ days ago • Promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocations • Bronx, New York, United States
    Full-time
    A company is looking for an Analytics Engineer to lead the development of data infrastructure for data monetization products. Key Responsibilities Act as a technical leader and mentor for the engi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocations • Yonkers, New York, United States
    Full-time
    A company is looking for a Data Engineer II - Data Platform (REMOTE).Key Responsibilities Supports end users in designing and building data pipelines using platforms like Snowflake, Databricks, a...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Spectraforce Technologies • Newark, NJ, United States
    Full-time
    Please update the job description andor attach a rolespecific job description below.Prepares data for analytical or operational uses. Builds data pipelines to pull information from different source ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Data Engineer (AML).Key Responsibilities Design and build reliable data load processes and utilities for data transformation Implement data solutions using.NET, SSIS, ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    The Computer Merchant, LTD. • Newark, NJ, US
    Full-time
    JOB TITLE : DATA ENGINEER JOB LOCATION : NEWARK, NJ (HYBRID) WAGE RANGE • : 60.PER HOUR JOB NUMBER : SAIJP00038347 REQUIRED EXPERIENCE : Ingest data from SAP, Salesforce, Google Analytics, OKTA, and othe...Show more
    Last updated: 5 days ago • Promoted
    Azure Cloud Data Engineer

    Azure Cloud Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Data Engineer for a fully remote contract opportunity.Key Responsibilities Manage data / cloud generalist responsibilities related to Oracle, DevOps, and Azure Cloud Bui...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    VirtualVocations • Yonkers, New York, United States
    Full-time
    A company is looking for a Staff Data Pipeline Engineer.Key Responsibilities Design, build, and optimize high-performance data pipelines for business and customer-facing systems Implement and ma...Show more
    Last updated: 20 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Lead Data Engineer (Remote).Key Responsibilities Lead the design, implementation, and management of Data Integration Frameworks Develop and maintain infrastructure sys...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer / DBA

    Data Engineer / DBA

    VirtualVocations • Jamaica, New York, United States
    Full-time
    A company is looking for a Data Engineer / DBA to manage and optimize their data systems.Key Responsibilities Design and manage MySQL databases focusing on speed, scalability, and reliability Bu...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    New York City Department of Transportation • New York, NY, United States
    Full-time
    The Department of Sustainable Delivery (DSD) is a new division within the NYC Department of Transportation (DOT), launched in 2025 to respond to the rapid growth of app-based delivery and the wides...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data and AI Engineer

    Senior Data and AI Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Senior Engineer specializing in Data and AI to transform business operations through advanced AI applications. Key Responsibilities Lead the design, development, and dep...Show more
    Last updated: 2 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Flushing, New York, United States
    Full-time
    A company is looking for an AWS Data Engineer to support cloud migration and optimize data queries.Key Responsibilities Review and rewrite existing SQL / Power BI queries for Amazon Redshift Optim...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineering Team Lead (Hybrid)

    Data Engineering Team Lead (Hybrid)

    Selective Insurance • Millburn, NJ, United States
    Temporary
    At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Flushing, New York, United States
    Full-time
    A company is looking for a Senior Data Engineer to help curate and understand their data for smarter business decisions.Key Responsibilities Design and build ELT / ETL processes and connectors, dis...Show more
    Last updated: 30+ days ago • Promoted