Azure Databricks Architect

Ampcus Incorporated
Cheektowaga, NY, United States
Full-time

Bravens Inc., a part of the Ampcus Group of Companies, is an information technology consulting and services company. With extensive staffing experience in IT and non-IT industries, we welcome you to join our team.

If you've got the expertise, we've got the job!"

Role : Azure Databricks Architect

Location : Cheektowaga, NY 14225 ( Onsite)

An Azure Databricks Architect is a specialized role focusing on designing, implementing, and optimizing data solutions using the Azure Databricks platform.

Here's a typical job description for this role :

Total Experience : 12+ years

Job Summary :

We are seeking an experienced Azure Databricks Architect to join our team. The ideal candidate will have a deep understanding of the Azure Databricks platform, Big Data technologies, and the broader Azure ecosystem.

You will be responsible for designing and implementing scalable, high-performance data architectures and providing strategic technical direction to ensure successful delivery of complex data projects.

Key Responsibilities :

Architectural Design :

Design and architect end-to-end data solutions using Azure Databricks, ensuring alignment with business requirements and technical constraints.

Develop scalable and optimized architectures for data processing, storage, and retrieval.

Integrate Azure Databricks with other Azure services such as Azure Data Lake, Azure Synapse Analytics, and Azure Machine Learning.

Technical Leadership :

Provide technical leadership and guidance to development teams on best practices for using Azure Databricks.

Mentor and train team members on Azure Databricks and related technologies.

Conduct code reviews and ensure adherence to established architectural standards and guidelines.

Solution Implementation :

Lead the implementation of data pipelines, ETL processes, and data transformation tasks on Azure Databricks.

Collaborate with data engineers, data scientists, and other stakeholders to build and deploy data solutions.

Ensure the reliability, scalability, and performance of data platforms.

Optimization and Troubleshooting :

Optimize data workflows and performance tuning within Azure Databricks.

Troubleshoot and resolve complex technical issues related to data processing and integration.

Monitor system performance and implement improvements as needed.

Stakeholder Management :

Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.

Communicate complex technical concepts clearly to non-technical stakeholders.

Work closely with project managers to ensure timely delivery of projects.

Qualifications : Technical Skills :

Technical Skills :

Extensive experience with Azure Databricks, Apache Spark, and Big Data technologies.

Strong proficiency in Azure services, including Azure Data Lake, Azure Synapse Analytics, and Azure Data Factory.

Solid understanding of data warehousing, ETL / ELT processes, and data architecture principles.

Experience with programming languages such as Python, Scala, or Java.

Knowledge of SQL and NoSQL databases.

Experience :

5+ years of experience in data architecture, data engineering, or related roles.

Proven track record of designing and implementing large-scale data solutions in the cloud, specifically on Azure.

Experience with machine learning and AI integration in data pipelines is a plus.

Soft Skills :

Strong analytical and problem-solving skills.

Excellent communication and interpersonal skills.

Ability to work in a fast-paced, collaborative environment.

Strong leadership abilities and experience leading technical teams.

Preferred Certifications :

Microsoft Certified : Azure Solutions Architect Expert

Microsoft Certified : Azure Data Engineer Associate

Databricks Certified Associate Developer for Apache Spark

Educational Background : Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.

Bravens Inc. is an Equal Opportunity Employer. We provide consideration for employment to all qualified applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, or disability.

2 days ago
Related jobs
Ampcus Incorporated
Cheektowaga, New York

Integrate Azure Databricks with other Azure services such as Azure Data Lake, Azure Synapse Analytics, and Azure Machine Learning. An Azure Databricks Architect is a specialized role focusing on designing, implementing, and optimizing data solutions using the Azure Databricks platform. Strong profic...

Promoted
VirtualVocations
Buffalo, New York

A company is looking for a Senior SQL Developer to support a Federal Government customer in the DC metro area. ...

Net2Source
Buffalo, New York

Lead the design and implementation of robust data architectures to support business needs and data strategy. Utilize extensive experience in Azure Synapse, Python, PySpark, and ADF to architect scalable and efficient data solutions. Collaborate with senior management to align data architecture goals...

Han IT Staffing
Buffalo, New York

Lead the design and implementation of robust data architectures to support business needs and data strategy. Utilize extensive experience in Azure Synapse, Python, PySpark, and ADF to architect scalable and efficient data solutions. Collaborate with senior management to align data architecture goals...

Independent Health
Buffalo, New York

Experience integrating data into reports with at least one of the less-common data sources, unstructured or cloud-based data, which are inclusive of but not limited to ADT data, SNOWMED data, HL7 resources, LOINC coded base data, immunization data, JSON files, etc. The Data Innovation Analyst-Interm...

00002 Citibank, N.A.
Getzville, New York

Independently conducts analysis and executes tasks that contribute to work streams focusing on broad range of data initiatives including data requirements, issues management, Data Quality rules, lineage, Data Governance and taxonomy. The Data Integration Sr Analyst is responsible for facilitating / ...

Noom
New York, US

We are seeking a Senior Data Scientist to join our dynamic team. Learn from & influence a diverse team of data scientists working on problems across Noom. Data Scientist in a similarly-sized organization, with a proven record of analysis & research that positively impacts your team. Partner with sta...

Digitas
New York, US

Senior Analyst, Data & Analysis. The Data & Analysis team uses data-driven insights to fuel strategic growth for clients. To help with this, we’re looking for an outstanding Senior Analyst– someone who can analyze massive data sets, make insightful cross-channel recommendations, and communicate stra...

PwC US Group LLP
Buffalo, New York
Remote

A Data Scientist collects domain context from stakeholders, defines hypothesis and prediction tasks, identifies and creates supporting data sources, conducts experiments with various algorithms to model prediction tasks, undertakes validation and tests of models to improve performance, produces pipe...

Computer Task Group, Inc
Buffalo, New York

CTG is seeking to fill a Senior DevOps Engineer opening for our client in Buffalo, NY. Our client is seeking a DevOps engineer with very strong skills in Terraform, Ansible, Git and Azure with heavy focus on automation. Mentor and coach less experienced engineers, technicians, and integrators. Bache...