Lead Azure Data Engineer
Diligent Tec IncAtlanta, GA, Georgia, USA1 day ago
Job type
- Full-time
Job descriptionAct as subject matter expert providing best-practice guidance on data lake and ETL architecture frameworks suitable for handling big data for unstructured and structured information. Drive business and Service Layer development with the customer by finding new opportunities based on expanding existing solutions and creating new ones. Provide hands-on subject matter expertise to build and implement Azure-based Big Data solutions. Research, evaluate, architect, and deploy new tools, frameworks, and patterns to build sustainable Big Data platforms for our clients. Facilitate and / or conduct requirements workshops. Responsible for collaborating on the prioritization of technical requirements. Collaborates with peer teams and vendors on the solution and delivery. Has overall accountability for project delivery. Works collaboratively with the Product Management, Data Management, and other Architects to deliver for the cloud data platform and Data as a Service. Consults with clients to assess current problem states, define desired future states, define solution architecture, and make solutions recommendations. Design and implement scalable and reusable data models to support analytical and operational use cases, ensuring compatibility with various business applications. Optimize data models for performance and scalability, addressing key challenges in data latency, volume, and complexity in a big data environment. Ensure data quality and consistency by establishing robust data validation and governance mechanisms during the modeling process. Collaborate with data scientists, engineers, and business stakeholders to translate business requirements into effective and efficient data models. Degree in computer science or equivalent preferred Demonstrable experience in architecture, design, implementation, and / or support of highly distributed applications with Azure cloud and Databricks. 8+ Years of Hands-on experience with data modelling, database design, data mining, and segmentation techniques. Working knowledge and experience with "Cloud Architectures" (e.g., SaaS, PaaS, IaaS) and the ability to address the unique security considerations of secure Cloud computing Should have architected solutions for Cloud environments such as Microsoft Azure and / or GCP Experience with debugging and performance tuning in distributed environments Strong analytical skills with the ability to collect, organize, analyse, and broadcast significant amounts of information with attention to detail and accuracy Experience dealing with structured, unstructured data. Must have Python, PySpark experience. Experience in ML or / and graph analysis is a plus
Title : Lead Data Engineer
Location : Atlanta, GA (Onsite)
Duration : Long Term Contract
Description :
An Lead Azure Data Engineer is responsible for designing, implementing, and maintaining the data infrastructure within an organization. They collaborate with both business and IT teams to understand stakeholders’ needs and unlock the full potential of data. They create conceptual and logical data models, analyze structural requirements, and ensure efficient database solutions.
Must Have Skills :
- SAP Data Experience
- Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles, Hoslistic vision on the Data Strategy.
- Proficiency in Data Streaming and Data Modeling
- Experience in architecting at least two large-scale big data projects
- Strong understanding of data scaling and its complexities
- Data Archiving and Purging mechanisms.
Job Responsibilities :
Job Requirements :
Create a job alert for this search
Azure Data Engineer • Atlanta, GA, Georgia, USA
Related jobs
Location : Atlanta, GA (Onsite).Overview : We are seeking an experienced Azure Data Architect to desi...Show moreLast updated: 4 days ago
Agency Interview Type : Either Web Cam or In Person.Applications with resumes in PDF Format will be automatically rejected.
Only Word format resumes will be considered.Under general supervision, comb...Show moreLast updated: 12 days ago
The Lead Application Security Engineer will partner with Security Engineering Enablement and Security Architecture to design and ship secure software : secure code reviews and help define requiremen...Show moreLast updated: 30+ days ago
AI / Data Engineer – Core Role at WickedFile.Automotive SaaS, AI-Driven Analytics.WickedFile is on a mission to redefine how automotive repair shops understand and act on their financial and operatio...Show moreLast updated: 30+ days ago
Party Candidates will not be considered.Must live within 30 minutes of Duluth.We are looking for a Player Manager.Someone who is looking to move into Management or someone with a couple of years of...Show moreLast updated: 1 day ago
Top Skills' Details 1- Databricks data modeling w / Python 2- Azure ETL / Data analysis 3- Spark / Hive / Airflow ...Show moreLast updated: 7 days ago
Job Title : Senior Data Engineer Location : Atlanta, GA [ONSITE] Job Descript...Show moreLast updated: 4 days ago Job Title : Lead GCP Data Engineer / Analyst (Retail & CDP Focus) Experience : Min.Hybrid - 3 days onsite) Any Visa is fine Show moreLast updated: 21 days ago 
At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 10 days ago
Job Title : Data Tech Lead – 12+ Years.Location : Alpharetta, Georgia .Skill 4 – Yrs of Exp - Cloud (AWS / Azure / GCP).We are seeking an experienced Data Tech Lead with strong hands-on expertise in...Show moreLast updated: 23 days ago
Will work 100% onsite in Fayetteville GA •.Seeking Level 2, Level 3, Level 4, and Level 5 / Lead Data Center Technicians •.
Team will be handling troubleshooting of large GPU deployments inside of a h...Show moreLast updated: 30+ days ago
Tempur Sealy is committed to improving the sleep of more people, every night, all around the world.As a leading designer, manufacturer, distributor, and retailer of bedding products worldwide, we k...Show moreLast updated: 30+ days ago At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 30+ days ago 
We are hiring an experienced Data Engineer to architect, build, and optimize scalable data pipelines and analytics solutions.
The ideal candidate must have hands-on experience with data integration ...Show moreLast updated: 30+ days ago
DEPLOY's client is building a next-generation business management platform from the ground up and were looking for a hands-on Senior Data Engineer to deliver and scale our data strategy.As we grow ...Show moreLast updated: 30+ days ago The Senior Lead Cybersecurity Architect is responsible for defining the principles, standards, and design patterns to build secure products and enterprise tools for all of Cox Automotive's multi-cl...Show moreLast updated: 30+ days ago At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 30+ days ago 
Creating A Healthier Way of Living.Rinnai America Corporation is the leader in tankless water heating, a technology that is growing rapidly as businesses and homes “yank the tank” and convert to an...Show moreLast updated: 15 days ago
Azure Data Architect
VDart IncAtlanta, GA, United StatesTemporary
Quick Apply
Data Engineer
Padmore Global Connections LLCAtlanta, Georgia, United StatesFull-time
Quick Apply
- Promoted
Lead Application Security Engineer - 19562
Cox AutomotiveAustell, GA, United StatesFull-time
AI / Data Engineer
WickedFileAlpharetta, Georgia, United StatesFull-time
Quick Apply
- Promoted
Lead Software Engineer
SOLTECHDuluth, GA, United StatesFull-time
Data Engineer
SmartIPlaceAtlanta, GA, United StatesFull-time
Quick Apply
Senior Data Engineer
Noblesoft TechnologiesAtlanta, GA, United StatesFull-time
Quick Apply
Lead GCP Data Engineer / Analyst
Diligent Tec IncAtlanta, GA, Georgia, USAFull-time
- Promoted
Offensive Cybersecurity Engineer (Web and Cloud)
ViasatDuluth, GA, United StatesFull-time
Data Tech Lead
GovServicesHubAlpharetta, GA, usFull-time
Quick Apply
- Promoted
Data Center Technician
TEKsystemsFayetteville, GA, United StatesFull-time
- Promoted
Team Lead
Tempur SealyMarietta, GA, United StatesFull-time
- Promoted
Cybersecurity Engineer - Viasat Government
ViasatDuluth, GA, United StatesFull-time
Data Engineer
Wisemen Multimedia, LLCChamblee, Georgia, United StatesFull-time
Quick Apply
Senior Data Engineer
DeployAtlanta, Georgia, United StatesFull-time
Quick Apply
- Promoted
Senior Lead Cloud Security Architect
Cox AutomotiveUnion City, GA, United StatesFull-time
- Promoted
Cloud Engineer
ViasatDuluth, GA, United StatesFull-time
- Promoted
Pricing & Market Intelligence Manager
Rinnai America CorporationPeachtree City, GA, United StatesFull-time