Talent.com
Lead Databricks Data Architect

Lead Databricks Data Architect

Purple DriveAtlanta, GA, Georgia, USA
30+ days ago
Job type
  • Full-time
Job description

Job Title : Lead Databricks Data Architect

Location : Atlanta, GA (Onsite / Hybrid / Remote as per requirement)

Experience : 8 – 10 Years

Job Type : Full Time

Job Overview

We are seeking an experienced Lead Databricks Data Architect to design and implement robust, scalable, and secure cloud-based data solutions. This role involves working with Azure cloud services, leading development of data ingestion pipelines, and optimizing data architecture to meet evolving business needs.

Key Responsibilities

  • Architect and build end-to-end data solutions using Azure Databricks, Azure Data Factory, and Azure SQL Database.
  • Lead the development of real-time and batch data pipelines using Delta Live Tables (DLT) and Structured Streaming.
  • Collaborate with stakeholders to translate business requirements into scalable data warehouse solutions on Azure.
  • Provide strategic leadership for large-scale data programs and ensure alignment with organizational goals.
  • Drive performance optimization of Spark jobs and Databricks workflows through advanced tuning techniques.
  • Build and maintain metadata-driven ingestion frameworks to support automation and scalability.
  • Work cross-functionally with data scientists, analysts, and other stakeholders to deliver business-aligned data solutions.
  • Implement data governance, quality checks, and security measures to maintain data integrity and compliance.
  • Monitor and enhance cloud-based data infrastructure for performance and cost-efficiency.
  • Lead or support migration and upgrade efforts of legacy applications (e.g., .NET Framework) to cloud platforms.
  • Utilize Azure DevOps tools including Git, pipelines, and work item management.
  • Troubleshoot issues on Windows Server environments (e.g., IIS, Event Viewer, Performance Monitor).
  • Participate in Agile / Scrum ceremonies including sprint planning, retrospectives, and daily standups.

Technical Skills Required

  • Strong proficiency in :
  • Azure Databricks, ADF, Azure SQL

  • Apache Spark (job tuning and internals)
  • Structured Streaming, Delta Live Tables
  • Experience in :
  • .NET Frameworks 4.8.2 and Core 6 / 8
  • ASP.NET MVC, Blazor, WebForms
  • Web services & API integrations
  • Microsoft SQL Server (DDL, DML, stored procedures)
  • Nota Fiscal integration (Preferred in finance / logistics / related domains)
  • Familiarity with :
  • Azure authentication and key vault

  • Agile / Lean methodologies
  • Preferred Qualifications

  • Proven experience designing and delivering enterprise-level cloud data platforms.
  • Ability to lead cross-functional teams and mentor junior developers.
  • Excellent communication, documentation, and stakeholder management skills.
  • Familiarity with CI / CD and infrastructure-as-code in cloud environments.

    Create a job alert for this search

    Data Architect • Atlanta, GA, Georgia, USA

    Related jobs
    • Promoted
    • New!
    Data Architect / SQL Developer

    Data Architect / SQL Developer

    STRATEGIC MINDZ LLCAtlanta, GA, US
    Full-time
    At least ten (10) years of experience planning, designing, building, and implementing IT systems.Ten (10)+ years of overall IT experience with six (6)+ years in solution architecture, system.Strong...Show moreLast updated: 7 hours ago
    • Promoted
    Databricks Data Engineer - Manager - Consulting - Location Open

    Databricks Data Engineer - Manager - Consulting - Location Open

    EYAlpharetta, GA, United States
    Full-time
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show moreLast updated: 3 days ago
    • Promoted
    Azure Cloud Data Architect (GenAI)

    Azure Cloud Data Architect (GenAI)

    Diverse LynxAtlanta, GA, United States
    Full-time
    Azure Cloud Data Architect (GenAI).Atlanta, Vienna, VA and Chicago.Design and modernize data architectures for Azure AI Foundry aligning with enterprise AI and analytics strategies.Develop scalable...Show moreLast updated: 3 days ago
    • Promoted
    Architect, Cloud Performance

    Architect, Cloud Performance

    Oracle DefunctAtlanta, GA, United States
    Full-time
    Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.As a member of the software engineering division, you will take an active role in the defi...Show moreLast updated: 3 days ago
    • Promoted
    Azure Cloud Data Architect

    Azure Cloud Data Architect

    Diverse LynxAtlanta, GA, United States
    Full-time
    Deep expertise in Azure data services Azure SQL Synapse Data Factory Data Lake Cosmos DB.Experience with AIML platforms Azure Machine Learning Azure OpenAI Databricks PyTorch scikitlearn.Strong und...Show moreLast updated: 3 days ago
    • Promoted
    Data and AI Enablement Lead

    Data and AI Enablement Lead

    SiemensPeachtree Corners, GA, United States
    Full-time
    Here at Siemens, we take pride in enabling sustainable progress through technology.We do this through empowering customers by combining the real and digital worlds. Improving how we live, work, and ...Show moreLast updated: 3 days ago
    Data Architect

    Data Architect

    Charter GlobalAlpharetta, GA, United States
    Full-time
    Quick Apply
    Job Title : Data Architect Location : Remote / WFH and travel once a month to Alpharetta, GA or Houston / Dallas, TX (The first 5 days are going to be onsite too).D...Show moreLast updated: 4 days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    VeracityAlpharetta, GA, United States
    Full-time
    Design, build, and test cloud architecture to ensure large amounts of data can be transferred and stored efficiently.Use prior knowledge and creativity to troubleshoot and solve technical issues as...Show moreLast updated: 30+ days ago
    Sr. Data Architect

    Sr. Data Architect

    Sunrise SystemsAtlanta, Georgia, United States
    Full-time
    Quick Apply
    Location : Atlanta, GA (Hybrid).Duration : 08 months of contract.Plans and schedules team resources, status reporting and completion of required documentation for team assignment and projects.Analyze...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    Purple DriveAtlanta, GA, United States
    Full-time
    Key Responsibilities Architect Design Design and implement end-to-end modern data architecture on the Azure cloud platform, including data lakes, data warehouses, and analytics solutions.Lead Techn...Show moreLast updated: 1 day ago
    • Promoted
    Solution Architect - Agentic AI Data

    Solution Architect - Agentic AI Data

    TEPHRAAtlanta, GA, United States
    Full-time
    Role : Agentic AI Data Architect.Location options : San Francisco Bay Area, New York / New Jersey, Atlanta, Chicago, and Dallas. The Agentic AI Data Architect is a specialized role in TCS's AI & Data ...Show moreLast updated: 3 days ago
    Data Architect (Microsoft Fabric & Azure Databricks)

    Data Architect (Microsoft Fabric & Azure Databricks)

    Sunrise SystemsAtlanta, Georgia, United States
    Full-time
    Quick Apply
    Job Title : Data Architect (Microsoft Fabric & Azure Databricks).Location : Atlanta, Georgia (Hybrid).Duration : 06 months of contract. Supervises the coordination of design and security for comput...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Syntricate TechnologiesAtlanta, GA, United States
    Full-time
    Python, SQL, ETL / ELT, Airflow, Github, CI / CD, GCP / AWS / Azure.Strategically architect, Design, develop industry-specific solutions in support of core enterprise functions based on client requirement ...Show moreLast updated: 30+ days ago
    AWS Data Architect

    AWS Data Architect

    ProArchAtlanta, GA, US
    Remote
    Full-time
    Quick Apply
    Seeking an experienced AWS Data Architect to lead the architecture and evolution of our Enterprise Unified Data Platform (UDP). This platform is a core enabler of healthcare data modernization, focu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Solution Architect

    Senior Solution Architect

    Molina HealthcareAtlanta, GA, United States
    Full-time
    Leads in the creation and solution design of architectures for delivery, development, and support of projects.Must have experience integrating multiple applications and varied Databases (such as SQ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Cloud Architect GCP

    Lead Cloud Architect GCP

    HumanaAtlanta, GA, United States
    Full-time
    Become a part of our caring community and help us put health first.The Lead Cloud Architect leads the planning, design, and engineering of enterprise-level infrastructure and platforms related to c...Show moreLast updated: 3 days ago
    • Promoted
    DataBricks Architect

    DataBricks Architect

    ZipRecruiterAtlanta, GA, United States
    Full-time
    Job DescriptionJob DescriptionSalary : .Seeking aDatabricks Architectto lead the design and delivery of large-scale data platforms using Databricks. Architect and implementDatabricks lakehouse solutio...Show moreLast updated: 3 days ago
    • Promoted
    Solution Architect - Argentic AI Data

    Solution Architect - Argentic AI Data

    TEPHRAAtlanta, GA, United States
    Full-time
    Role : Solution Architect - Agentic AI Data Architect.The Agentic AI Data Architect is a specialized role within TCS's AI & Data Business Unit (Americas), focused on designing intelligent data ecosy...Show moreLast updated: 30+ days ago