Databricks Architect
Inizio PartnersJersey City, NJ, United States3 days ago
Job type
- Full-time
Job descriptionDevelop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI / CD, Terraform for infrastructure as code, and Splunk for monitoring Continuously improve systems through performance enhancements and cost reductions in compute and storage Data Processing and API Integration : Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs Lead Data Engineering Projects to manage and implement data-driven communication systems Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations Integrate data across different systems and platforms Strong verbal and written communication skills to manage client discussions 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud Experience in insurance domain / data is must Programming Languages SQL, Python Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL). Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps Project Management using Agile, Scrum B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering. Excellent communication & leadership skills, with the ability to lead and motivate team members Ability to work independently with some level of ambiguity and juggle multiple demands
About the job Databricks Architect
- Title : Databricks Architect
- Key Requirements : Hands on experience in Databricks, SQL, PySpark. Must have Insurance domain experience.
- Location : Jersey City, NJ
- Job Type : Hybrid (2 days work from office)
- Duration : 12+ Months
- Start Date : Immediate
- Number of roles : 1
Role & Responsibilities Overview :
Candidate Profile :
Create a job alert for this search
Architect • Jersey City, NJ, United States
Related jobs
Key member of the Enterprise Data Governance function at Northwell, including facilitating the operationalization of governance priorities.
Northwell's enterprise data governance platform, & acting ...Show moreLast updated: 24 days ago
The Databricks Architect - Lead is a critical role within our Data and Analytics practice, tasked with designing, implementing, and optimizing advanced data architectures using Databricks.This role...Show moreLast updated: 3 days ago
Synapse to Databricks implement.Databricks Hand's on Experience.Data modeling, designing strategy & data architecture concepts.
More than 10+ years of relevant experience in data engineering tools l...Show moreLast updated: 30+ days ago
Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Apptad.Job Location : New York City, NY (Hybrid 3 Days from Office).
We are seeking an experienced Azu...Show moreLast updated: less than 1 hour ago
Key Responsibilities : Lead the definition and execution of the Information Management roadmap Manage architectural runway for enterprise data models and advanced data analytics capabilities Pro...Show moreLast updated: 30+ days ago
United States and supports its co-operative members' retail operations, trading under the ShopRite®, Price Rite®, The Fresh Grocer®, Dearborn Markets®, and Gourmet Garage® b...Show moreLast updated: 1 day ago
Azure Databricks Architect Job Description Job Summary : We are looking for an experienced Databricks Architect with deep expertise in Lakehouse and Medallion Architecture (Bronze, Silver, Gold layer...Show moreLast updated: 3 days ago
Enjoy problem-solving, need a venue to display your creativity, and emerging technologies pique your interest; if so, Barrow Wise Consulting, LLC is for you.
As a multi-disciplined leader, you under...Show moreLast updated: 30+ days ago
We are looking for a highly skilled and technical Data Architect to lead the design and implementation of our data ecosystem.
In this role, you will be responsible for the end-to-end architecture of...Show moreLast updated: 24 days ago
With 7,000+ experts in 20 countries, Talan is a global consulting and tech group helping businesses innovate and grow through AI, Data, and Blockchain.
Certified Great Place To Work, we’r...Show moreLast updated: 2 days ago Designs and implements scalable data mesh architectures on Azure.Defines data domains, schemas, and integration patterns, leveraging Azure services like Azure Data Factory and Databricks.Advanced k...Show moreLast updated: 3 days ago 
CCC Data Engineer & Solutions Architect.Existing Warehouse is SQL Server and considering switch to Snowflake.Show moreLast updated: less than 1 hour ago
PLEASE READ : these jobs are testing jobs of Lever's testing environment - please do not apply for this job.Lever was founded ten years ago to tackle the most strategic challenge that companies face...Show moreLast updated: 30+ days ago A company is looking for a Distinguished DevOps & Enterprise Data Architect.Key Responsibilities Set and champion the enterprise architecture vision, aligning technology domains with business str...Show moreLast updated: 3 days ago A company is looking for a Principal Data Architect responsible for shaping enterprise data strategy, architecture, and governance.
Key Responsibilities Define and maintain enterprise data archite...Show moreLast updated: 30+ days ago 
Job Title : Azure Data Architect.Design and develop end-to-end data architecture on Azure Cloud, including data ingestion, storage, processing, and analytics solutions.
Lead the deployment of Databri...Show moreLast updated: 3 days ago
Please see the CCC - Data Engineer & Solutions Architect.Data Architect or Solutions Architect).Existing Warehouse is SQL Server and considering switch to SnowFlake.Show moreLast updated: 30+ days ago A company is looking for a Solutions Architect with Data Architect experience.Key Responsibilities Lead full lifecycle project management including planning, monitoring, quality assurance, and re...Show moreLast updated: 1 day ago
- Promoted
Senior Data Architect - Data Governance
Northwell HealthNew Hyde Park, NY, United StatesFull-time
- Promoted
Databricks Architect
ApolisJersey City, NJ, United StatesFull-time
- Promoted
Azure Databricks Architect
NR ConsultingJersey City, NJ, United StatesFull-time
- Promoted
- New!
Azure Data Architect
ApptadNew York, NY, United StatesFull-time
- Promoted
Senior Data Architect
VirtualVocationsAstoria, New York, United StatesFull-time
- Promoted
Cloud Data Warehouse Architect
Wakefern Food Corp.Edison, NJ, USFull-time
- Promoted
Azure Databricks Architect
Diverse LynxNew York, NY, United StatesFull-time
Data Architect
Barrow Wise ConsultingNew York, NY, USAFull-time
Quick Apply
- Promoted
Data Architect
Macmillan LearningNew York, NY, United StatesFull-time
- Promoted
Dataiku architect
TalanNew York, NY, USFull-time
- Promoted
Azure Data Architect
Diverse LynxJersey City, NJ, United StatesFull-time
- Promoted
- New!
Data Engineer & Solutions Architect
RIT SolutionsNew York, NY, United StatesFull-time
Data Architect
Lever Demo - IS OpportunitiesNew York, New York, United States, 10001Full-time
- Promoted
Distinguished DevOps Architect
VirtualVocationsNewark, New Jersey, United StatesFull-time
- Promoted
Principal Data Architect
VirtualVocationsPaterson, New Jersey, United StatesFull-time
- Promoted
Azure Data Architect
ApTaskIselin, NJ, United StatesFull-time
- Promoted
Data Engineer & Solutions Architect
RIT Solutions, Inc.New York, NY, United StatesFull-time
- Promoted
Solutions Architect with Data Focus
VirtualVocationsStaten Island, New York, United StatesFull-time