Talent.com
Databricks Data Engineer
Databricks Data EngineerMomento USA • Austin, TX, United States
Databricks Data Engineer

Databricks Data Engineer

Momento USA • Austin, TX, United States
2 days ago
Job type
  • Temporary
  • Quick Apply
Job description

Position : Databricks Data Engineer

Duration : 9+ Months Contracts

Location : Austin Texas

A public sector client of ours in Austin, Texas is looking for a Databricks Data Engineer for a 9-month contract that is likely to extend.

The Databricks Data Engineer is responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platform . This role supports key data engineering, machine learning, and analytics initiatives within an organization that relies heavily on large-scale data processing.

The worker will design and implement scalable data pipelines, build efficient ETL / ELT workflows, optimize Apache Spark jobs, and ensure seamless integration with Azure Data Factory . Additional responsibilities include automating deployments, maintaining strong data governance and security standards, and collaborating with cross-functional teams across the organization.

Key Responsibilities

  • Design and develop scalable data pipelines using Apache Spark on Databricks .
  • Implement and maintain ETL / ELT workflows for structured and unstructured data.
  • Optimize Spark jobs for performance and cost-efficiency .
  • Integrate Databricks solutions with Azure Data Factory and other cloud services.
  • Design and maintain data models , schemas, and database structures to support both analytical and operational workloads.
  • Implement data validation , quality checks, and contribute to data governance initiatives including metadata management, data lineage, and cataloging.
  • Apply data security best practices-encryption, access control, auditing-and ensure compliance with relevant regulations.
  • Automate deployments using CI / CD tools and collaborate with DevOps and development teams.
  • Work in agile, cross-functional teams and coordinate with data scientists, analysts, and stakeholders to align on business and technical requirements.
  • Troubleshoot and debug performance and data issues to maintain data pipeline reliability and efficiency.

Note : Candidates who do not meet the minimum requirements will not be considered for this opportunity.

Required Experience :

  • 8 years of experience implementing ETL / ELT workflows for structured and unstructured data.
  • 8 years of experience automating deployments using CI / CD tools.
  • 8 years of experience collaborating with cross-functional teams, including data scientists, analysts, and stakeholders.
  • 8 years of experience designing and maintaining data models, schemas, and database structures for analytical and operational use cases.
  • 8 years of experience evaluating and implementing data storage solutions including Azure Data Lake Storage and data warehouses.
  • 8 years of experience implementing data validation and quality assurance processes.
  • 8 years of experience contributing to data governance efforts such as metadata management, data lineage, and cataloging.
  • 8 years of experience implementing data security measures, including encryption, access controls, and auditing.
  • 8 years of experience programming in Python and R.
  • 8 years of experience using SQL for querying and data manipulation.
  • 8 years of experience with the Azure cloud platform.
  • 8 years of experience working with DevOps, CI / CD pipelines, and version control systems.
  • 8 years of experience in agile and multicultural environments.
  • 8 years of experience troubleshooting and debugging complex systems.
  • 5 years of experience designing and developing scalable data pipelines using Apache Spark on Databricks.
  • 5 years of experience optimizing Spark jobs for performance and cost efficiency.
  • 5 years of experience integrating Databricks with Azure Data Factory.
  • 5 years of experience ensuring data quality, governance, and security using Unity Catalog or Delta Lake.
  • 5 years of experience with Apache Spark architecture, including RDDs, DataFrames, and Spark SQL.
  • 5 years of experience working with Databricks notebooks, clusters, jobs, and Delta Lake.
  • Preferred Qualifications :

  • 1 year of experience with machine learning libraries such as MLflow, Scikit-learn, or TensorFlow.
  • 1 year of experience holding a Databricks Certified Associate Developer for Apache Spark certification.
  • 1 year of experience holding an Azure Data Engineer Associate certification.
  • Thanks,

    Majid M.

    Momento USA | Exceeding Customer Expectations

    440 Benigno Blvd, Unit#A 2nd Floor. Bellmawr, NJ 08031

    Interstate Business Park

    Direct : 856-432-2053 / Desk : 856-456-1805 X 1008 / Fax : (866) 605-1171

    Email : majid@MomentoUsa.com Web : www.MomentoUSA.com

    Minority Certified by SWAM

    One of the fastest growing company in NJ

    Awarded fastest growing Asian American business by Diversitybusiness.com

    E-verified Company

    Note : Momento USA is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

    Create a job alert for this search

    Data Engineer • Austin, TX, United States

    Related jobs
    Databricks Data Engineer

    Databricks Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...Show more
    Last updated: 30+ days ago • Promoted
    Staff Data Engineer

    Staff Data Engineer

    CertifID • Austin, TX, US
    Full-time
    Cybercrime is rising, reaching record highs in 2024.According to the FBI's IC3 report total losses exceeded $16 billion.With investment fraud and BEC scams at the forefront, the message is clea...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Contact Government Services, LLC • Austin, TX, US
    Full-time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    SADA • Austin, TX, US
    Full-time
    You will engage with fellow engineers to develop and optimize data platforms, focusing on business intelligence and data engineering to ensure seamless data flows and insightful reporting.You will ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Senior Data Engineer with Snowflake Expertise.Key Responsibilities : Collaborate with cross-functional teams to ensure data integrity and usability Document data workfl...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Nomi Health • Austin, TX, US
    Full-time
    We were tired of hearing that healthcare is broken, so we decided to do something about it.At Nomi Health, we believe the care itself isn’t broken — it’s the business of healthcar...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    MRINetwork Jobs • Austin, TX, US
    Full-time
    We are looking for a motivated Data Engineer to join our team at a leading real estate investment trust.The successful candidate will be responsible for designing and implementing data pipelines, m...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Data Engineer I to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management procedu...Show more
    Last updated: 30+ days ago • Promoted
    EA-Database Engineer

    EA-Database Engineer

    Social Solutions Global • Austin, TX, United States
    Full-time
    We help power the trailblazers, campaigners, and advocates fighting up and down the ticket for equality, racial justice, reproductive freedom, democracy, climate reform, and more- including the nat...Show more
    Last updated: 30+ days ago • Promoted
    EA-Data Engineer I, Services

    EA-Data Engineer I, Services

    Social Solutions Global • Austin, TX, United States
    Full-time
    Bonterra exists to propel every doer of good to their peak impact.We measure that impact against our vision to increase the giving rate as a percentage of GDP from 2% to 3% by 2033.We know that thi...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...Show more
    Last updated: 30+ days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Software Engineer, Data.Key Responsibilities Design, implement, and maintain scalable data ingestion pipelines Design, implement, and maintain scalable APIs for extern...Show more
    Last updated: 30+ days ago • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Staff Data Engineer to design and maintain data systems that drive analytics and product innovation. Key Responsibilities Lead the design, development, and maintenance o...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Loxo • Austin, TX, US
    Full-time
    As an early hire to our engineering team, you will be responsible for managing Loxo’s data integration function.You will be primarily responsible for migrating new clients’ legacy data ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer III

    Data Engineer III

    VirtualVocations • Austin, Texas, United States
    Full-time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Remedy Technological Services L P • Austin, TX, US
    Full-time
    Centex Technologies is seeking a highly skilled.You will collaborate with cross-functional teams to ensure secure, high-performance data systems meet mission-critical needs.Build and maintain solut...Show more
    Last updated: 16 days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    AlphaPoint • Austin, TX, US
    Full-time
    AlphaPoint’s AI Labs’ team of engineers and AI scientists is solving complex business problems by bridging the gap between transformative breakthroughs in AI technology and increasingly...Show more
    Last updated: 10 days ago • Promoted