Talent.com
No longer accepting applications
Azure Databricks Administrator (New York)

Azure Databricks Administrator (New York)

NYU Langone HealthNew York, NY, United States
3 days ago
Job type
  • Full-time
Job description

NYU Langone Health is a fully integrated health system that consistently achieves the best patient outcomes through a rigorous focus on quality that has resulted in some of the lowest mortality rates in the nation. Vizient Inc. has ranked NYU Langone the No. 1 comprehensive academic medical center in the country for three years in a row, and U.S. News & World Report recently placed nine of its clinical specialties among the top five in the nation. NYU Langone offers a comprehensive range of medical services with one high standard of care across 6 inpatient locations, its Perlmutter Cancer Center, and over 320 outpatient locations in the New York area and Florida. With $14.2 billion in revenue this year, the system also includes two tuition-free medical schools, in Manhattan and on Long Island, and a vast research enterprise with over $1 billion in active awards from the National Institutes of Health.

For more information, go to NYU Langone Health , and interact with us on LinkedIn , Glassdoor , Indeed , Facebook , Twitter , YouTube and Instagram .

Position Summary :

We have an exciting opportunity to join our team as a Azure Databricks Administrator.

As the Azure Databricks Administrator within this department, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security across workspaces, clusters, and jobs. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI / CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations. Strong communication skills and a commitment to high-quality support will enable effective collaboration with cross-functional teams, directly contributing to the department's mission of delivering robust data solutions and insights.

Job Responsibilities :

  • Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
  • Oversee user administration including access controls and permissions
  • Handle library installations, runtime management, and policy enforcement
  • Implement / analyze cost control measures and monitor platform usage and performance
  • Administer Unity Catalog for data governance and security
  • Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
  • Manage Azure storage solutions, including Blob Storage and Data Lake Storage
  • Administer Azure Key Vault for secure storage of secrets and keys
  • Configure and manage Azure Data Factory for data integration and ETL processes
  • Implement and manage VNETs, firewalls, Azure policies and security best practices
  • Implement and manage Azure DevOps for CI / CD pipelines and version control
  • Implement best practices for automated deployment and continuous integration
  • Set up budgets and alerts to monitor and control Azure costs and spend
  • Implement monitoring solutions for platform health and performance
  • Configure alerts for proactive issue detection and resolution
  • Databricks Lakehouse Monitoringdevelop and execute ad hoc operational reports not already implemented within the EDC (e.g., nonstandard query reports).

Minimum Qualifications :

To qualify you must have a Minimum of Bachelor's degree in Computer science, Information systems, or Engineering

7+ years of related professional experience administering data platforms

3+ years experience with Azure Databricks Lakehouse Platform

Proficiency in scripting languages such as Python / PySpark, PowerShell, or Bash

Experience in automating administrative tasks and workflows

Knowledge of security best practices and compliance requirements

Experience with ETL processes, data pipelines, and big data technologies

Experience with backup and restore procedures for Databricks and Azure services

Ability to troubleshoot and resolve issues in a timely and efficient manner

Strong verbal and written communication skills

Ability to document processes, procedures, and configurations clearly

Commitment to providing high-quality support to internal / external users and stakeholders

Ability to understand and address the needs of internal and external customers

Team player with the ability to work collaboratively with cross-functional teams

Flexibility to adapt to changing requirements and priorities

Willingness to learn new technologies and continuously improve skills

Preferred Qualifications :

Deep understanding of Databricks architecture, features, and best practices

Experience with Delta Lake and Databricks SQL for advanced data management

Experience in performance tuning and optimization for both Databricks and Azure environments

Experience supporting / administering data science and ML workloads in Databricks

Knowledge of disaster recovery planning and implementation

Experience integrating Databricks with other data platforms and tools

Understanding of hybrid and multi-cloud environments

Experience implementing data protection measures and ensuring regulatory compliance

Qualified candidates must be able to effectively communicate with all levels of the organization.

NYU Langone Health provides its staff with far more than just a place to work. Rather, we are an institution you can be proud of, an institution where you'll feel good about devoting your time and your talents.

At NYU Langone Health, we are committed to supporting our workforce and their loved ones with a comprehensive benefits and wellness package. Our offerings provide a robust support system for any stage of life, whether it's developing your career, starting a family, or saving for retirement. The support employees receive goes beyond a standard benefit offering, where employees have access to financial security benefits, a generous time-off program and employee resources groups for peer support. Additionally, all employees have access to our holistic employee wellness program, which focuses on seven key areas of well-being : physical, mental, nutritional, sleep, social, financial, and preventive care. The benefits and wellness package is designed to allow you to focus on what truly matters. Join us and experience the extensive resources and services designed to enhance your overall quality of life for you and your family.

NYU Langone Health is an equal opportunity employer and committed to inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration. We require applications to be completed online.

View NYU Langone Health's Equal Employment Opportunity (EEO) policy, Know Your Rights : Workplace discrimination is illegal.

NYU Langone Health provides a salary range to comply with the New York state Law on Salary Transparency in Job Advertisements. The salary range for the role is $97,589.96 - $162,649.75 Annually. Actual salaries depend on a variety of factors, including experience, specialty, education, and hospital need. The salary range or contractual rate listed does not include bonuses / incentive, differential pay or other forms of compensation or benefits.

To view the Pay Transparency Notice, please click here

Create a job alert for this search

Azure Administrator • New York, NY, United States

Related jobs
  • Promoted
  • New!
OnBase Administrator III

OnBase Administrator III

VirtualVocationsPaterson, New Jersey, United States
Full-time
A company is looking for an OnBase Administrator / Developer III.Key Responsibilities Plan, design, develop, test, implement, and modify Electronic Content Management (ECM) solutions Provide advan...Show moreLast updated: 12 hours ago
  • Promoted
Application Database Administrator

Application Database Administrator

VirtualVocationsFlushing, New York, United States
Full-time
A company is looking for an Application Database Administrator to manage and optimize Oracle databases and applications remotely. Key Responsibilities : Administer and optimize Oracle databases and...Show moreLast updated: 1 day ago
  • Promoted
Azure Cloud Architect

Azure Cloud Architect

Neotecra, Inc.New York, NY, US
Full-time
We’re currently seeking an experienced.Cloud Architecture & Strategy team.This role is ideal for someone who excels in designing. The Cloud Architect will be responsible for developing.You’ll collab...Show moreLast updated: 5 days ago
  • Promoted
Cloud Database Administrator

Cloud Database Administrator

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Cloud Database Administrator to manage and optimize their cloud-based data platform.Key Responsibilities Administer and maintain Azure SQL Databases and related PaaS da...Show moreLast updated: 30+ days ago
  • Promoted
DevSecOps Engineer

DevSecOps Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a DevSecOps Engineer to design, implement, and maintain CI / CD pipelines and integrate security tools into the development lifecycle. Key Responsibilities Design, implement...Show moreLast updated: 30+ days ago
  • Promoted
Cloud Operations Engineer

Cloud Operations Engineer

VirtualVocationsJamaica, New York, United States
Full-time
A company is looking for a Cloud Operations Engineer to optimize and manage its cloud infrastructure.Key Responsibilities Design, deploy, and manage cloud infrastructure using Terraform and AWS b...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
DevSecOps Engineer (AWS)

DevSecOps Engineer (AWS)

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for a DevSecOps Engineer (AWS) to design and develop solutions for complex application and integration challenges in a cloud environment. Key Responsibilities Design and devel...Show moreLast updated: 20 hours ago
  • Promoted
Senior Cloud DevOps Engineer

Senior Cloud DevOps Engineer

VirtualVocationsJamaica, New York, United States
Full-time
A company is looking for a Senior Cloud DevOps Engineer to design, implement, and maintain cloud infrastructure.Key Responsibilities Design and maintain cloud infrastructure in Azure and AWS usin...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer Contractor

Data Engineer Contractor

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Data Engineer (Python / Databricks) Contractor.Key Responsibilities Design, develop, and deploy enhancements to existing Python-based batch ETL scripts Utilize Databrick...Show moreLast updated: 7 days ago
  • Promoted
Oracle Database Administrator

Oracle Database Administrator

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for a Senior Oracle Database Administrator.Key Responsibilities Administer, monitor, and maintain Oracle databases (11g / 12c / 19c) Plan and execute end-to-end migration of Ora...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer - Databricks

Data Engineer - Databricks

Open Systems TechnologiesNew York, NY, US
Full-time
A financial firm is looking for a.US Citizens or GC Holders Only.A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field7+ years of experienc...Show moreLast updated: 11 days ago
  • Promoted
Azure DevSecOps Engineer

Azure DevSecOps Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for an Azure Cloud Infrastructure and DevSecOps Engineer.Key Responsibilities Develop and implement Azure infrastructure solutions while incorporating DevSecOps principles C...Show moreLast updated: 17 days ago
  • Promoted
Fulltime BI Data Engineer in NYC

Fulltime BI Data Engineer in NYC

Nuware TechnologiesFloral Park, NY, US
Full-time
What we're seeking Bachelor’s degree in Engineering or Computer Science 6+ years of experience in Microsoft SQL Server 6+ years of experience in ETL tools like Microsoft SSIS 3 years software devel...Show moreLast updated: 2 days ago
  • Promoted
Senior Azure Cloud Engineer

Senior Azure Cloud Engineer

VirtualVocationsBrooklyn, New York, United States
Full-time
A company is looking for a Hybrid Cloud Engineer Senior.Key Responsibilities Design, implement, and maintain Azure infrastructure using Infrastructure as Code (IaC) Architect and configure virtu...Show moreLast updated: 30+ days ago
  • Promoted
Data Warehouse Architect

Data Warehouse Architect

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Data Warehouse Architect & AI Analytics Lead to evolve their data infrastructure and enable predictive analytics. Key Responsibilities Lead the design and implementation...Show moreLast updated: 30+ days ago
  • Promoted
Senior Google Cloud Platform Data Engineers

Senior Google Cloud Platform Data Engineers

ePATHUSA IncNew York, NY, US
Full-time
Seeking Senior Google Cloud Platform Data Engineers to design, develop, and maintain robust data pipelines that transform raw data into valuable insights, as well as : . Design, develop, and maintain ...Show moreLast updated: 14 days ago
  • Promoted
AWS Cloud Engineer

AWS Cloud Engineer

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for an AWS Cloud Engineer.Key Responsibilities Innovate, develop, maintain, and optimize infrastructure within the AWS Cloud ecosystem Provision and manage infrastructure us...Show moreLast updated: 30+ days ago
  • Promoted
Java Big Data Engineer

Java Big Data Engineer

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...Show moreLast updated: 1 day ago
  • Promoted
  • New!
Cloud Architect (AWS / Azure)

Cloud Architect (AWS / Azure)

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Cloud Architect (AWS / Azure) to design and implement cloud solutions and provide migration strategies. Key Responsibilities Translate customer and business processes into...Show moreLast updated: 20 hours ago
  • Promoted
Cloud Data Engineer

Cloud Data Engineer

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...Show moreLast updated: 30+ days ago