Talent.com
Lead Data Engineer
Lead Data EngineerMedStar Health • New Orleans, LA, United States
No longer accepting applications
Lead Data Engineer

Lead Data Engineer

MedStar Health • New Orleans, LA, United States
12 days ago
Job type
  • Full-time
Job description

Posting Type

Hybrid

Job Overview

Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?

Job Description and Requirements

Your role in action

  • Assist in building our next-generation data platform tooling and services to support the ingestion and processing of large volumes of documents at scale. Contribute to improving and extending our Spark-based distributed data processing pipeline.
  • Help enhance our Rust-based distributed query engine used to request large amounts of document data.
  • Create tools to automate and optimize processes across disciplines.
  • Participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
  • Participate in code reviews for projects written by your team.
  • Focus on quality through comprehensive unit and integration testing.

Your Skills

  • 6+ years of software development experience in writing performant, commercial-grade systems and applications
  • Experience with monitoring and troubleshooting production environments
  • Proficiency in programming languages used in high volume data processing and applications like Java, Scala, and Python
  • Experience building data pipelines with distributed compute frameworks like Hadoop, Spark, or Dask
  • Knowledge of Linux / Unix systems, Docker / Kubernetes, and CI / CD including scripting in Python or other scripting languages to automate build and deployment processes
  • Knowledge of professional software engineering practices & software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Leverages best practices and past experiences to mentor and improve team productivity
  • We'd particularly love it if you have : Deep experience building and debugging distributed data pipelines; experience with columnar databases and storage formats like Delta Lake and Parquet; experience deploying and managing services on Kubernetes; experience building with Rust.

    Relativity is committed to competitive, fair, and equitable compensation practices.

    This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.

    The expected salary range for this role is between $150,000 and $224,000.

    The final offered salary will be based on several factors, including but not limited to the candidate's experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would not be typical, to allow for future meaningful salary growth in this position.

    #J-18808-Ljbffr

    Create a job alert for this search

    Lead Data Engineer • New Orleans, LA, United States

    Related jobs
    Cloud Engineering Lead

    Cloud Engineering Lead

    TEKsystems • New Orleans, LA, United States
    Full-time
    Our client • is seeking a •Cloud Engineering Lead • to own and evolve their Azure and Oracle Cloud Infrastructure (OCI) portfolio. This strategic yet hands-on role will drive enterprise monitoring, au...Show more
    Last updated: 1 day ago • Promoted
    Registered Nurse-IMC Telemetry-Full Time

    Registered Nurse-IMC Telemetry-Full Time

    Christus Health • Pointe A La Hache, Louisiana, US
    Full-time +1
    Description Summary : The competent Nurse, in the same or similar clinical setting, practices independently and demonstrates an awareness of all relevant aspects of a situation.Increase your chances...Show more
    Last updated: 30+ days ago • Promoted
    Need a gig? Deliver with Uber Eats!

    Need a gig? Deliver with Uber Eats!

    Uber eats • Larose, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Entry Level Sales Representative

    Entry Level Sales Representative

    American Income Life • Ponchatoula, LA, US
    Full-time
    American Income Life is growing! We are seeking ambitious individuals who are driven to build their own business while also leaving a positive impact within the community they serve.American Income...Show more
    Last updated: 30+ days ago • Promoted
    Deliver with Uber Eats

    Deliver with Uber Eats

    Uber eats • Cut Off, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Deliver Food with Uber - Flexible Gig

    Deliver Food with Uber - Flexible Gig

    Uber eats • Larose, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Students - Deliver with Uber Eats

    Students - Deliver with Uber Eats

    Uber eats • Barataria, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Director of Data & Learning Analytics

    Director of Data & Learning Analytics

    FirstLine Schools • New Orleans, LA, US
    Full-time
    FirstLine Schools : DIRECTOR OF DATA & LEARNING ANALYTICS.Creating and inspiring great open admissions public schools in New Orleans. Our mission is to create and inspire great open admissions pu...Show more
    Last updated: 1 day ago • Promoted
    Food Delivery Driver

    Food Delivery Driver

    Uber eats • Lafitte, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Flexible Schedule - Deliver with Uber Eats

    Flexible Schedule - Deliver with Uber Eats

    Uber eats • Des Allemands, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Medical HPSP

    Medical HPSP

    United States Army • Jean Lafitte, LA, United States
    Full-time
    THE ARMY HEALTH CARE ADVANTAGE As a member of the Army health care team, you’ll receive benefits that you won’t be able to get in a civilian career. Challenging Work Feel inspired with great case di...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    MedKoder • Mandeville, LA, US
    Full-time
    MedKoder, LLC is a full-service medical coding management services provider based in Mandeville, Louisiana, specializing in expert medical coding for health systems, providers, and payers.MedKoder ...Show more
    Last updated: 7 days ago • Promoted
    Deliver with Uber - Flexible Gig

    Deliver with Uber - Flexible Gig

    Uber eats • Des Allemands, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Make money your way. Deliver with Uber!

    Make money your way. Deliver with Uber!

    Uber eats • Barataria, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Deliver with Uber Eats - Great for Students

    Deliver with Uber Eats - Great for Students

    Uber eats • Lafitte, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Delivery Driver - Uber Eats

    Delivery Driver - Uber Eats

    Uber eats • Barataria, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Data Architect (Data Analytics)

    Data Architect (Data Analytics)

    Delta Utilities Services, LLC • New Orleans, LA, US
    Full-time
    Delta Utilities is seeking a Data Architect to stand up a modern, cloud‑first IT landscape that will serve 580,000 natural gas customers across Louisiana and Mississippi.This Data Architect ...Show more
    Last updated: 30+ days ago • Promoted
    Deliver Food with Uber Eats

    Deliver Food with Uber Eats

    Uber eats • Lafitte, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Deliver Eats with Uber Eats

    Deliver Eats with Uber Eats

    Uber eats • Larose, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted
    Food Delivery with Uber Eats

    Food Delivery with Uber Eats

    Uber eats • Cut Off, LA, US
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show more
    Last updated: 1 day ago • Promoted