Talent.com
AWS Databricks Architect

AWS Databricks Architect

Mega Cloud LabSanta Clara, CA, US
Hace más de 30 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Job Description

Job Description

We9re seeking a visionary Data Architect & with deep expertise in Databricks & to lead the design, implementation, and optimization of our enterprise data architecture. You9ll be instrumental in shaping scalable data solutions that empower analytics, AI, and business intelligence across the organization.

If you thrive in a fast-paced environment, love solving complex data challenges, and have a passion for cloud-native platforms like AWS Databricks , we want to hear from you.

Responsibilities

  • Design Architecture : Architect scalable, secure Lakehouse and data platform solutions using Databricks , Spark , Delta Lake , and cloud storage.
  • Implementation Development : Lead implementation of ETL / ELT pipelines (batch real-time), Databricks notebooks, jobs, Structured Streaming, and PySpark / Scala code for production workloads.
  • Data Modeling Pipelines : Define canonical data models, schema evolution strategies, and optimized ingestion patterns to support analytics, BI, and ML use cases.
  • Performance Cost Optimization : Tune Spark jobs, Delta tables, cluster sizing, and storage to balance performance, latency, and cost-efficiency.
  • Governance Compliance : Implement data quality, lineage, access controls, and compliance measures (Unity Catalog, RBAC) to meet internal and regulatory standards.
  • Migration Modernization : Lead migration from legacy warehouses to cloud platforms and modern data architectures (Databricks, Snowflake), ensuring minimal disruption.
  • DevOps Automation : Define CI / CD and Infrastructure as Code best practices for data platform deployments (Terraform, CI pipelines, Databricks Jobs API).
  • Leadership Mentorship : Mentor engineers, drive architecture reviews, and collaborate with stakeholders to translate business needs into technical solutions.

Required Skills Qualifications

  • 12+ years in data architecture with 5+ years hands-on experience in Databricks or equivalent Lakehouse platforms.
  • Strong experience with Snowflake and modern data warehousing patterns.
  • Cloud Platform : Proven experience on AWS (preferably with AWS Databricks) — familiarity with S3, IAM, Glue, and networking for secure deployments.
  • Core Technologies : Deep proficiency in Apache Spark , Delta Lake , PySpark / Scala, SQL, and performance tuning.
  • Data Engineering : Experience designing ETL / ELT pipelines, data modeling, partitioning strategies, and data quality frameworks.
  • Automation DevOps : Familiarity with CI / CD, Terraform (or other IaC), Databricks Jobs API, and pipeline orchestration tools (Airflow, Prefect, dbt).
  • Governance Security : Knowledge of data governance, metadata management, lineage, RBAC, and regulatory compliance best practices.
  • Communication : Excellent stakeholder management, documentation, and cross-functional collaboration skills.
  • Preferred Qualifications

  • Databricks Certified Data Engineer or Architect.
  • Experience with MLflow, Unity Catalog, and Lakehouse architecture.
  • Background in machine learning, AI, or advanced analytics.
  • Experience with tools like Apache Airflow, dbt, or Power BI / Tableau
  • Crear una alerta de empleo para esta búsqueda

    Aws Architect • Santa Clara, CA, US

    Ofertas relacionadas
    • Oferta promocionada
    Sr. Solution Architect

    Sr. Solution Architect

    SupermicroSan Jose, CA, United States
    A tiempo completo
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Senior AWS DevOps Engineer

    Senior AWS DevOps Engineer

    VirtualVocationsSan Jose, California, United States
    A tiempo completo
    A company is looking for a Senior AWS DevOps Engineer.Key Responsibilities Collaborate with development teams to design, implement, and optimize cloud solutions on AWS Automate infrastructure pr...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    • Nueva oferta
    Cloud Architect (AWS / Azure)

    Cloud Architect (AWS / Azure)

    VirtualVocationsSan Francisco, California, United States
    A tiempo completo
    A company is looking for a Cloud Architect (AWS / Azure) to design and implement cloud solutions and provide migration strategies. Key Responsibilities Translate customer and business processes into...Mostrar másÚltima actualización: hace 19 horas
    • Oferta promocionada
    Cloud Application Architect

    Cloud Application Architect

    VirtualVocationsSan Jose, California, United States
    A tiempo completo
    A company is looking for a Cloud Application Architect to shape the design and evolution of cloud-native software platforms on Microsoft Azure. Key Responsibilities Drive the architecture vision f...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Lead Data Architect

    Lead Data Architect

    RingCentral, IncBelmont, CA, United States
    A tiempo completo
    It's not every day that you consider starting a new career.We're RingCentral, and we're happy that someone as talented as you is considering this role. First, a little about us, we're a $2 Billion a...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Solution Manager

    Solution Manager

    SupermicroSan Jose, CA, United States
    A tiempo completo
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    • Nueva oferta
    DevSecOps Engineer (AWS)

    DevSecOps Engineer (AWS)

    VirtualVocationsFremont, California, United States
    A tiempo completo
    A company is looking for a DevSecOps Engineer (AWS) to design and develop solutions for complex application and integration challenges in a cloud environment. Key Responsibilities Design and devel...Mostrar másÚltima actualización: hace 19 horas
    • Oferta promocionada
    Senior Enterprise Datawarehouse Developer

    Senior Enterprise Datawarehouse Developer

    FortinetSunnyvale, CA, United States
    A tiempo completo
    We are seeking an experienced Senior Enterprise Datawarehouse Developer to join our team.As a Senior Datawarehouse Engineer, you will provide advanced data warehousing design solutions , support, m...Mostrar másÚltima actualización: hace 6 días
    • Oferta promocionada
    Principal Solution Architect

    Principal Solution Architect

    VirtualVocationsHayward, California, United States
    A tiempo completo
    A company is looking for a Principal Solution Architect, Managed Services.Key Responsibilities : Propose, design, and provision cloud-native data solutions on AWS / Azure Lead a technical team mana...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Principal Data Architect

    Principal Data Architect

    QualysFoster City, CA, United States
    A tiempo completo
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Define standards and best practices for data modeling, governance, integrations ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Cloud Architect

    Cloud Architect

    VirtualVocationsHayward, California, United States
    A tiempo completo
    Cloud Architect with expertise in Microsoft Dynamics.Key Responsibilities Design and implement cloud architecture solutions using Dynamics 365 to optimize supply chain processes Collaborate with...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Data Center Architect

    Data Center Architect

    VirtualVocationsHayward, California, United States
    A tiempo completo
    A company is looking for a Data Center Architect - Remote.Key Responsibilities Provide leadership in the development and strategic direction of new products, processes, and techniques Act as pri...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Sr. Solution Architect - Enterprise

    Sr. Solution Architect - Enterprise

    SupermicroSan Jose, CA, United States
    A tiempo completo
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    • Nueva oferta
    Cloud Data Architect (AI / ML)

    Cloud Data Architect (AI / ML)

    TEKsystemsSan Jose, CA, United States
    A tiempo completo
    We are seeking a •Cloud Data Architect • to design and implement scalable, secure, and high-performance cloud-based systems for analytics, reporting, and machine learning at petabyte scale.This is a...Mostrar másÚltima actualización: hace 16 horas
    • Oferta promocionada
    IT Data Platform Architect

    IT Data Platform Architect

    VirtualVocationsSan Jose, California, United States
    A tiempo completo
    A company is looking for an IT Data Platform Architect to design and implement a state-of-the-art data platform with advanced AI / ML capabilities. Key Responsibilities Develop a high-performance da...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Principal Solutions Architect

    Principal Solutions Architect

    VirtualVocationsSanta Clara, California, United States
    A tiempo completo
    A company is looking for a Principal Solutions Architect (Data).Key Responsibilities Designs and builds relational databases for data storage and processing Develops and enforces data architectu...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Solution Engineer

    Solution Engineer

    SupermicroSan Jose, CA, United States
    A tiempo completo
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Data Warehouse Architect

    Data Warehouse Architect

    VirtualVocationsOakland, California, United States
    A tiempo completo
    A company is looking for a Data Warehouse Architect & AI Analytics Lead to evolve their data infrastructure and enable predictive analytics. Key Responsibilities Lead the design and implementation...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    AWS Cloud Engineer

    AWS Cloud Engineer

    VirtualVocationsSan Francisco, California, United States
    A tiempo completo
    A company is looking for an AWS Cloud Engineer.Key Responsibilities Innovate, develop, maintain, and optimize infrastructure within the AWS Cloud ecosystem Provision and manage infrastructure us...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Consulting Cloud Architect (Remote, US)

    Consulting Cloud Architect (Remote, US)

    FortinetSunnyvale, CA, United States
    Teletrabajo
    A tiempo completo
    Fortinet is seeking a Cloud Architect supporting Public Cloud with a focus on AWS.As a part of the Public Cloud team, this role will support the technical alliance relationship with AWS to develop ...Mostrar másÚltima actualización: hace 6 días