Talent.com
Sr. Databricks Architect

Sr. Databricks Architect

RIT Solutions, Inc.New York, NY, United States
20 hours ago
Job type
  • Full-time
Job description

Azure / Microsoft Fabric Technical Lead - Master Person Index (MPI)

(Real consolidated version based on JD + the two selected resumes)

Overview

We are seeking a hands-on Azure Architect / Technical Lead to design and implement a Master Person Index (MPI) and identity-resolution platform using Microsoft Fabric , Azure Data Services, and modern lakehouse patterns. This role requires strong Azure engineering, data architecture, governance, and MDM / identity-matching expertise, with the ability to guide a cross-functional technical team and own delivery.

  • Core Responsibilities

Architecture & Implementation

  • Lead architecture and engineering for MPI in Microsoft Fabric (Lakehouse, Dataflows, Pipelines, Event-driven ingestion).
  • Build identity resolution workflows (standardization, matching, survivorship, MDM patterns).
  • Design and deploy secure Azure data pipelines integrating ADF, Synapse, Databricks, Event Hub, and Purview.
  • Ensure interoperability across clinical, operational, and member datasets.

    • Data Engineering & Governance

  • Implement Medallion lakehouse architecture with strong lineage, security, and governance.
  • Define data models, metadata strategies, and data quality frameworks.
  • Use Purview / Collibra for lineage, catalog, and stewardship integration.

    • Cloud Engineering & DevOps

  • Develop IaC and CI / CD using Azure DevOps, Terraform, Bicep, ARM .
  • Optimize compute, storage, pipelines, and security with Azure-native best practices.

    • Collaboration & Leadership

  • Partner with product owners, architects, and data SMEs to align MPI design to enterprise standards.
  • Mentor engineering teams and provide technical oversight across development lifecycle.

    • ML / AI Integration (Future)

  • Collaborate with ML / AI teams to prepare MPI for identity-matching models, anomaly detection, and embeddings-based matching.
  • Required Skills
  • 7+ years Cloud Engineering, 3+ years Azure architecture
  • Hands-on experience with :

    • Microsoft Fabric (Lakehouse / OneLake / Dataflows)

  • Azure Data Factory, Synapse, Databricks, Event Hub
  • Purview (catalog, lineage, security)
  • Data Lakehouse / Medallion architecture
  • Experienced in MDM, MPI, or identity-resolution patterns
  • Strong understanding of governance, metadata, and security
  • Expertise with CI / CD, IaC (Terraform / Bicep)
  • Excellent communication and leadership skills
  • Preferred Skills
  • Experience with ML / AI, LLM, or embeddings for identity matching
  • Prior work with healthcare member data, MPI, or MDM platforms
  • Experience with vector search, anomaly detection, or entity resolution models
    • Create a job alert for this search

    Sr Architect • New York, NY, United States

    Related jobs
    • Promoted
    Databricks Architect

    Databricks Architect

    Inizio PartnersJersey City, NJ, United States
    Full-time
    About the job Databricks Architect.Hands on experience in Databricks, SQL, PySpark.Must have Insurance domain experience. Hybrid (2 days work from office).Role & Responsibilities Overview : .Develop a...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr. Cloud Data Analytics Solution Architect(Onsite)

    Sr. Cloud Data Analytics Solution Architect(Onsite)

    The Dignify Solutions, LLCAllendale, NJ, United States
    Full-time
    Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on AWS and Azure Cloud. Deep hands-on experience in Azure Databricks and all AZ...Show moreLast updated: 20 hours ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    Wakefern Food Corp.Edison, New Jersey, United States
    Full-time
    The ideal candidate will have a strong background in designing, developing, and implementing complex projects, with focus on automating data processes and driving efficiency within the organization...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    The Computer Merchant, LTD.Newark, NJ, US
    Full-time
    JOB TITLE : DATA ARCHITECT JOB LOCATION : NEWARK, NJ (HYBRID) WAGE RANGE • : 65.PER HOUR JOB NUMBER : SAIJP00038349 REQUIRED EXPERIENCE : Bachelor's degree in related field with 8+ years of experience as ...Show moreLast updated: 24 days ago
    • Promoted
    Cloud Sr Architect AWS

    Cloud Sr Architect AWS

    Diverse LynxJersey City, NJ, United States
    Full-time
    What are the top 3 skills required for this role?.AWS MGN, EFS, FSX, RDS, Active Directory, AWS Config, Guard Rail, IAM,VPC, Subnet, TGW, VPN,. Job Description / Responsibilities.Understand the exist...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Solution Architect - Advanced Analytics - Remote

    Sr. Solution Architect - Advanced Analytics - Remote

    The Dignify Solutions LLCJersey City, NJ, United States
    Remote
    Full-time
    Total 14 to 15 Years of experience.Relevant experience 6 to 7 Years.Experience in solutions architecture or equivalent experience. Experience in technical domains such as AI / ML, multimodal ML, model...Show moreLast updated: 30+ days ago
    Senior Architect - Data & Analytics COE

    Senior Architect - Data & Analytics COE

    United Nations Federal Credit UnionUSA, New York, New York
    Full-time
    Collaborate with various data management team and business units, enhancing and architecting data warehouse and data lake solutions, extracting data (ETL), and testing it upon completion.Possess kn...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    R&D Solution Architect - Data Products

    R&D Solution Architect - Data Products

    SanofiMorristown, New Jersey, US
    Full-time +1
    R&D Solution Architect - Data Products.At Sanofi, were committed to providing the next-gen healthcare that patients and customers need. Its about harnessing data insights and leveraging AI respo...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Sr. Solutions Architect

    Sr. Solutions Architect

    Digital RealtyNew York, NY, United States
    Full-time
    Digital Realty is seeking an innovative and outcome-driven individual to join our growing team as a Sr.This role will focus on supporting our clients in developing and executing AI-driven solutions...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Senior Solution Architect Cloud (Enterprise Observability & Serv

    Senior Solution Architect Cloud (Enterprise Observability & Serv

    TEPHRAEdison, NJ, United States
    Full-time
    Lead pre-sales engagements and transformation initiatives in IT operations with C-level stakeholders.Define GTM strategies for modern observability and AIOps solutions. Architect scalable, multi-clo...Show moreLast updated: 20 hours ago
    • Promoted
    Data Architect

    Data Architect

    Macmillan LearningNew York, NY, United States
    Full-time
    We are looking for a highly skilled and technical Data Architect to lead the design and implementation of our data ecosystem. In this role, you will be responsible for the end-to-end architecture of...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Sr. Architect AWS

    Cloud Sr. Architect AWS

    Diverse LynxJersey City, NJ, United States
    Full-time
    Onsite - New Jersey, Philadelphia, New York.What are the top skills required for this role?.Job Description / Responsibilities. Cloud Architect will play a pivotal role in designing and implementing ...Show moreLast updated: 30+ days ago
    Data Architect

    Data Architect

    Zone IT SolutionsNew York, NY, US
    Full-time
    Quick Apply
    Zone IT Solutions is in search of a highly skilled.In this pivotal role, you will be responsible for designing, implementing, and managing our data architecture strategies to support our business o...Show moreLast updated: 1 day ago
    Solution Data Architect

    Solution Data Architect

    FusemachinesNew York, NY, US
    Full-time
    Quick Apply
    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizin...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Cloud Data Analytics Solution Architect(Onsite)

    Sr. Cloud Data Analytics Solution Architect(Onsite)

    The Dignify Solutions LLCAllendale, NJ, United States
    Full-time
    Overall 15+ years in data analytics consulting and at least 10+ Senior Architect role within a consulting firm with a focus on data analytics, advanced analytics, Cloud and Artificial Intelligence....Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Startup Solutions Architect

    Sr. Startup Solutions Architect

    AmazonNew York, NY, United States
    Full-time
    Are you passionate about startups? Are you interested in modern technologies and making a positive difference? We are looking for technical builders who love the idea of working with startups to he...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Startup Solutions Architect, AWS Startups

    Sr. Startup Solutions Architect, AWS Startups

    AmazonNew York, NY, United States
    Full-time
    Are you passionate about startups? Are you interested in modern technologies and making a positive difference? We are looking for technical builders who love the idea of working with startups to he...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    R&D Solution Architect - Data Products

    R&D Solution Architect - Data Products

    Sanofi GroupMorristown, NJ, United States
    Full-time
    R&D Solution Architect - Data Products.At Sanofi, we're committed to providing the next-gen healthcare that patients and customers need. It's about harnessing data insights and leveraging AI respons...Show moreLast updated: 10 hours ago