Talent.com
Manager - Data Engineering

Manager - Data Engineering

MphasisNew York, NY, United States
3 days ago
Job type
  • Full-time
Job description

Role description

Position / TITLE : Data E ngineer Lead

Location : US(preferably Texas / Florida)

Job Description :

Looking for a data professional who has 8+ years of experience in data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business requirements. As a Data Engineer, you'll play a crucial role in ensuring data reliability, quality, and efficiency within the organization.

Responsibilities :

  • Analyze and organize raw data : Work with various data sources, document parsing, extracting relevant information and structuring it for further processing.
  • Build data systems and pipelines : Construct robust data pipelines that facilitate data flow from source to Target.
  • Interpret trends and patterns : Use your analytical skills to identify data patterns.
  • Conduct complex data analysis and report on results : Dive deep into data to extract meaningful information.
  • Prepare data for prescriptive and predictive modeling : Ensure data is ready for machine learning and statistical analysis.
  • Build algorithms and prototypes : Develop and test data processing algorithms.
  • Combine raw information from different sources : Integrate data from various systems.
  • Explore ways to enhance data quality and reliability : Continuously improve data processes.
  • Identify opportunities for data acquisition : Stay informed about new data sources.
  • Develop analytical tools and programs : Create tools to facilitate data analysis.
  • Collaborate with data scientists and architects : Work closely with other data professionals to achieve common goals.
  • Design, implement, and maintain data catalog to enhance data discovery, accessibility, and governance within the organization
  • Implement data access controls, data encryption, and data masking techniques
  • Familiarity with data visualization tools and techniques for presenting data

Mandatory Skills :

  • Previous experience as a data engineer lead or in a similar role with at least 8+ years of relevant work experience.
  • Good knowledge of programming languages (e.g., Python, Java, Spark, etc).
  • Design, develop, and maintain data pipelines.
  • Experience in working with Data Catalog tools (e.g., OpenMetadata, DataHub, etc)
  • Experience in connecting and configuring data sources (databases, data warehouses, BI tools, etc.) to the data catalog using native connectors or APIs.
  • Experience working with REST APIs and services, messaging and event technologies.
  • Experience working with large and complex data sets.
  • Hands-on experience with SQL / No-SQL database (RDS, Redshift, DynamoDB, synapse, big query, mongo, etc.)
  • Batch / stream data processing experience
  • LLM, NLP, Ontology and working for AI / ML projects
  • Monitor, troubleshoot, and optimize the performance of data infrastructure to ensure scalability, reliability, and cost efficiency.
  • Stay up to date with cloud services and best practices in data engineering to continuously improve our data ecosystem.
  • Good exposure on at least two public cloud platforms (Azure / AWS / GCP)
  • Experience with Graph database (e.g. Neptune, RDF4j, etc.)
  • Experience with Vector database (e.g. Pinecone, FAISS, etc.)
  • Good-to-Have Skills :

  • knowledge or work experience in mortgage and banking domains.
  • Proficiency in building stream processing systems using kinesis, Kafka, etc.
  • Familiarity with Docker, Kubernetes, CI / CD and cloud services (AWS, Azure, GCP).
  • Technical expertise with segmentation techniques.
  • Create a job alert for this search

    Data Engineering Manager • New York, NY, United States

    Related jobs
    • Promoted
    Senior Data Engineering Manager

    Senior Data Engineering Manager

    CVS HealthRutherford, NJ, United States
    Full-time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 2 days ago
    • Promoted
    Manager, Data Engineering

    Manager, Data Engineering

    Garner HealthNew York, NY, United States
    Full-time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique inc...Show moreLast updated: 3 days ago
    • Promoted
    Senior Engineering Manager - Data and AI / ML PlatformsNew York, New York, United States

    Senior Engineering Manager - Data and AI / ML PlatformsNew York, New York, United States

    Lane (Acquired by VTS)New York, NY, US
    Full-time
    Senior Engineering Manager - Data and AI / ML Platforms.We're seeking a Senior Engineering Manager to own the engineering for AI / ML and Core data platforms for VTS products.This role will drive new A...Show moreLast updated: 30+ days ago
    • Promoted
    Manager, Cloud Engineering

    Manager, Cloud Engineering

    KPMGMontvale, NJ, United States
    Full-time
    We are The Lighthouse within KPMGs Consulting practice.We tap into the power of emerging technologies and scientific breakthroughs to create solutions and products that address the largest and most...Show moreLast updated: 3 days ago
    • Promoted
    Engineering Manager- Backend (Data)New York or US-based Remote

    Engineering Manager- Backend (Data)New York or US-based Remote

    UniswapNew York, NY, US
    Remote
    Full-time
    Engineering Manager- Backend (Data).Uniswap Labs builds products that help millions of people access DeFi simply and securely ? from the Uniswap Web App and Wallet to crypto infrastructure like the...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager, Applied AI

    Engineering Manager, Applied AI

    VirtualVocationsFlushing, New York, United States
    Full-time
    A company is looking for an Engineering Manager, Applied AI.Key Responsibilities Lead and build the Applied AI Team, defining technical vision and success metrics Oversee end-to-end ownership of...Show moreLast updated: 3 days ago
    • Promoted
    Engineering Manager, Data Infrastructure

    Engineering Manager, Data Infrastructure

    VirtualVocationsBronx, New York, United States
    Full-time
    A company is looking for an Engineering Manager, Data Infrastructure & Serving Layer.Key Responsibilities Lead and manage a high-performing engineering team focused on the serving layer Design a...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineering Manager, Analytics

    Data Engineering Manager, Analytics

    METANew York, NY, United States
    Full-time
    We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers to support product launches and roadmaps by building the data a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineering Manager

    Data Engineering Manager

    PennylaneNew York, NY, US
    Full-time
    Are you looking to have an impact on the daily life of millions of entrepreneurs in France (and tomorrow in Europe)? Are you looking for a work environment that values trust, proactivity, and auton...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Manager, Data Engineering

    Senior Manager, Data Engineering

    Capital OneNEW YORK, New York, United States
    Full-time +1
    Senior Manager, Data Engineering.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll b...Show moreLast updated: 30+ days ago
    • Promoted
    Manager, Data Engineering

    Manager, Data Engineering

    Publicis Groupe Holdings B.VNew York, NY, United States
    Full-time
    CoLab is a fully integrated, cross-discipline team that provides best-in-class services in a fluid and modular way.With our clients at the center, we create brand movement at the speed of people's ...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Manager Lab Data Engineering

    Manager Lab Data Engineering

    VirtualVocationsYonkers, New York, United States
    Full-time
    A company is looking for a Manager of Lab Data Engineering - Business Intelligence.Key Responsibilities Build and lead a high-performing Lab Data Engineering team Drive the development and execu...Show moreLast updated: 10 hours ago
    • Promoted
    Digital Data Systems and Applications Sr. Manager, Engineering

    Digital Data Systems and Applications Sr. Manager, Engineering

    Novartis Group CompaniesEast Hanover, NJ, United States
    Full-time
    This position will be located at East Hanover, NJ site and will not have the ability to be located remotely.Please note that this role would not provide relocation and only local candidates will be...Show moreLast updated: 30+ days ago
    • Promoted
    Applied AI Engineering Manager, Enterprise

    Applied AI Engineering Manager, Enterprise

    Scale AI, Inc.New York, NY, United States
    Full-time
    AI is becoming vitally important in every function of our society.At Scale, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, ...Show moreLast updated: 30+ days ago
    • Promoted
    Director Data Engineering

    Director Data Engineering

    Cardinal IntegratedSecaucus, NJ, US
    Full-time
    You will be part of a growing Data Engineering team that handles client data for internal and external users.The IT department services over 10 internal groups and the one will be a seasoned techno...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Data Engineering

    Director, Data Engineering

    VimeoNew York, NY, United States
    Full-time
    Vimeo is seeking a Director of Data Engineering to lead our data strategy, architecture, and automation efforts.This role will drive the development of a modern, scalable lakehouse architecture wit...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineering Director

    Data Engineering Director

    FanDuelNew York, NY, United States
    Full-time
    Our roster has an opening with your name on it.We are seeking an experienced and forward-thinking.This role is key to executing our data strategy, building data products that serve internal and ext...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Data Engineering Manager - Apple Ads

    Data Engineering Manager - Apple Ads

    AppleNew York, NY, United States
    Full-time
    Data Engineering Manager - Apple Ads.New York City, New York, United States.At Apple, we work every day to create products that enrich people’s lives. Our Advertising Platforms group enables people ...Show moreLast updated: 21 hours ago