Talent.com
No longer accepting applications
Databricks Engineer

Databricks Engineer

Inherent TechnologiesSan Francisco, CA, United States
5 days ago
Job type
  • Full-time
  • Quick Apply
Job description

Position : Databricks Engineer

Location : San Francisco, CA

  • Day 1 Onsite

Duration : 1 Years

As a Databricks Engineer at HCLTech, you will play a pivotal role in crafting and optimizing Microsoft Azure solutions to meet dynamic client needs. This position offers the opportunity to leverage your expertise in Azure technologies to drive impactful projects that align with the company's strategic objectives. Your work will significantly contribute to enhancing data-driven decision-making and operational efficiency across diverse business units.

DETAILED RESPONSIBILITIES :

  • Design and develop software solutions to implement innovative features and support existing applications.
  • Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory.
  • Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes.
  • Collaborate with the technical team to provide design and coding support, ensuring project deliverables are met.
  • Engage with clients to gather and interpret business requirements, translating them into actionable solutions.
  • SKILL REQUIREMENTS :

  • Demonstrated technical proficiency with the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS).
  • Expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage / Data Lake.
  • Experience with ETL processes and strong analytical skills for report development.
  • Proficiency in relational databases and SQL language.
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • OTHER REQUIREMENTS (OPTIONAL) :

  • Experience with Python scripting and Spark APIs is highly desirable.
  • Previous experience in a client-facing role will be advantageous.
  • Familiarity with agile development methodologies and practices.
  • Skill or Category

    Mandatory / Non-Mandatory

    Evaluation Focus

    Minimum Rating Scale (0-5)

    Microsoft Azure Stack

    Mandatory

    Evaluate technical proficiency in T-SQL, SSIS, SSAS, and SSRS

    Azure Data Factory

    Mandatory

    Assess ability to construct robust ADF pipelines for data ingestion and transformation

    Azure Databricks

    Mandatory

    Experience in ingesting and integrating data into the Azure Analytics Platform

    Azure Synapse Analytics

    Mandatory

    Capability to optimize Azure solutions for enhanced decision-making

    Azure DevOps

    Mandatory

    Evaluate experience in using Azure DevOps for project deliverables

    Azure Storage / Data Lake

    Mandatory

    Proficiency in managing data storage solutions

    ETL Processes

    Mandatory

    Experience with ETL processes and report development

    Relational Databases and SQL

    Mandatory

    Proficiency in relational databases and SQL language

    Python Scripting and Spark APIs

    Non-Mandatory

    Assess experience with Python scripting and Spark APIs

    Client-Facing Experience

    Non-Mandatory

    Evaluate previous client engagement experience

    Agile Development Methodologies

    Non-Mandatory

    Familiarity with agile development practices

    Bachelor's Degree

    Mandatory

    Possession of a degree in Computer Science, Information Technology, or related field

    Create a job alert for this search

    Engineer • San Francisco, CA, United States

    Related jobs
    • Promoted
    Staff Field Applications Engineer

    Staff Field Applications Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Data Architect (Modeler).Key Responsibilities Design, develop, and implement conceptual, logical, and physical data models, including support for ElasticSearch and data...Show moreLast updated: 30+ days ago
    • Promoted
    Data Governance Engineer

    Data Governance Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Governance Customer Engineer to assist enterprise customers in implementing Microsoft Purview across complex data environments. Key Responsibilities Guide customers...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago
    • Promoted
    Segment Data Engineer

    Segment Data Engineer

    VirtualVocationsSan Francisco, California, United States
    Full-time
    A company is looking for a Segment Data Engineer to support their Marketing team's data initiatives.Key Responsibilities Work with Twilio Segment to capture, store, and structure product event da...Show moreLast updated: 6 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an EA-Data Pipeline.Key Responsibilities Process datasets from various data vendors and clients Identify and implement automation improvements for data processing Maint...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer for AI

    Data Engineer for AI

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
    • Promoted
    Data Warehouse Engineer

    Data Warehouse Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Warehouse Engineer III.Key Responsibilities Design, develop, and maintain scalable ELT workflows using Azure Data Factory, Fivetran, and dbt Partner with data ana...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sinclair Broadcast GroupSan Francisco, CA, US
    Full-time
    Digital Remedy is looking for a skilled Data Engineer to join our growing team of analytics experts.As a Data Engineer, you will help design, build, maintain, and troubleshoot data processing syste...Show moreLast updated: 20 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Blockchain Data Engineer

    Blockchain Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Blockchain Data Solutions Engineer.Key Responsibilities Design and implement blockchain data solutions Collaborate with cross-functional teams to integrate data system...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Data Engineer to work remotely in support of a government contract.Key Responsibilities Develop and design data pipelines to support end-to-end solutions Build systems...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Platform Engineer

    Lead Data Platform Engineer

    VirtualVocationsSan Jose, California, United States
    Full-time
    A company is looking for a Lead Data Platform Engineer responsible for designing, building, and operating an enterprise data platform focused on healthcare data. Key Responsibilities Administer an...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Senior Data Engineer to enhance its data infrastructure and strategy.Key Responsibilities Design and build data architecture while playing a central role in data strate...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 3 days ago
    • Promoted
    Staff Solution Engineer

    Staff Solution Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Analysis Engineer (Python / Tableau)

    Data Analysis Engineer (Python / Tableau)

    OSI EngineeringSanta Clara, CA, US
    Full-time
    Overview : Seeking a Data Analysis Engineer.The role involves building Tableau dashboards, Python scripting, and working with hardware-generated data. This role will focus on building interactive Tab...Show moreLast updated: 30+ days ago