Senior Data EngineerUnited Software Group • Pittsburgh, PA, United States

Senior Data Engineer

United Software Group • Pittsburgh, PA, United States

16 hours ago

Job type

Full-time

Job description

Databricks Senior Data Engineer

Work location : Pittsburgh, PA - onsite.

JOB DESCRIPTION

10+years of expereince as Datawarehouse Data Engineer.

Data Architecture Design : Develop / Modify the architecture for the EDW, including data models, data quality standards, data integration strategies, data migration and data warehousing technologies to effectively store and access data from various sources as per the requirments.
Business Requirements Gathering : Collaborate with business stakeholders to understand their data needs, identify key performance indicators (KPIs), and translate them into data warehouse requirements.
Data Integration and ETL Development : Design and implementation of ETL processes to extract data from various source systems,

transform it into a consistent format, and load it into the EDW through Databricks. Proven track record in implementing databricks for modernization projects.

Performance Optimization : Monitor and optimize the performance of the EDW to ensure efficient data access and query response times.

Overall Technical Leader : Provide technical guidance on data warehouse technologies, tools, and best practices to the relevant stakeholders.

Collaboration with Stakeholders : Work closely with business users, data analysts, and application developers to understand their data needs and deliver data-driven insights.

Required Skills and Experience :

Data Warehousing Expertise : Deep understanding of data warehousing concepts, architectures, and technologies like dimensional modeling, star schema, Databricks schema, and ETL processes.

Database Management Systems (DBMS) : Proficient in SQL's and Databricks.

Data Integration Tools : Familiarity with data integration tools for ETL development and data cleansing.

Communication Skills : Excellent communication skills to effectively collaborate with stakeholders from various departments

Create a job alert for this search

Senior Data Engineer • Pittsburgh, PA, United States

Related jobs

Lead Data Engineer

V2soft • Pittsburgh, PA, United States

Full-time

V2Soft is a global leader in IT services and business solutions, delivering innovative and cost-effective technology solutions worldwide since 1998. We have headquarteerd in Bloomfiled Hills, MI and...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Diverse Lynx • Pittsburgh, PA, United States

Full-time

Developer Well versed with Hadoop, Spark, Cloud, PythonScala and Java, Streaming, Kafka, Backend, J2EE.You evangelize an extremely high standard of code quality, system reliability, and performance...Show more

Last updated: 30+ days ago • Promoted

Data Engineer Senior (Hadoop / Big Data)

PNC Financial Services Group • Pittsburgh, PA, United States

Full-time +1

At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve.We are all united in delivering the best experience for our customers.We work together each day ...Show more

Last updated: 15 hours ago • Promoted • New!

Data Engineer

Qode • Pittsburgh, PA, United States

Full-time

We are seeking a skilled and motivated.Data Engineer with strong expertise in PySpark, SQL.You will be responsible for designing, building, and maintaining scalable data pipelines and processing sy...Show more

Last updated: 30+ days ago • Promoted

Sr Staff Data Engineer

GE Aerospace • Imperial, PA, United States

Permanent

Responsible for leading the requirements, design, development, and implementation of data engineering and analytics solutions to support cybersecurity initiatives. Will be supporting data analysts, ...Show more

Last updated: 16 hours ago • Promoted • New!

Data Engineer

Govini • Pittsburgh, PA, United States

Full-time

Govini transforms Defense Acquisition from an outdated manual process to a software-driven strategic advantage for the United States. Our flagship product, Ark, supports Supply Chain, Science and Te...Show more

Last updated: 30+ days ago • Promoted

Sr Data Engineer

Techstra Solutions • Pittsburgh, PA, United States

Full-time

The main function of a data engineer is to develop and implement data solutions for data platforms.Coordinate the collection, normalization and analysis of datasets across multiple data platforms.A...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Data Engineer

Bny • Pittsburgh, Pennsylvania, United States

Full-time

Senior Data Engineer At BNY, our culture empowers you to grow and succeed.As a leading global financial services company at the center of the world's financial system we touch nearly 20% of the wor...Show more

Last updated: 30+ days ago • Promoted

Databricks Senior Data Engineer

eTeam • Pittsburgh, PA, United States

Full-time

Role name : Databricks Senior Data Engineer.Work site : Pittsburgh, PA (Onsite).Data Architecture Design : Develop / Modify the architecture for the EDW, including data models, data quality standards, d...Show more

Last updated: 16 hours ago • Promoted • New!

Databricks Data Engineer - Senior - Consulting - Location Open

EY • Pittsburgh, PA, United States

Full-time

At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show more

Last updated: 30+ days ago • Promoted

Data Engineer Senior (Hadoop / Big Data)

PNC • Pittsburgh, PA, United States

Full-time +1

Last updated: 16 hours ago • Promoted • New!

Senior Software Engineer, AI Data Infrastructure

Stack AV • Pittsburgh, PA, United States

Full-time

Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Stack's autonomous technology incorporates cutting-...Show more

Last updated: 15 hours ago • Promoted • New!

Sr Engineer Data Engineering - US Based Remote

Anywhere Real Estate • Pittsburgh, PA, United States

Remote

Full-time

At Anywhere, we work to build and improve a platform that helps real estate professionals work effectively and helps delight home buyers and sellers with an excellent experience.We do that by combi...Show more

Last updated: 15 hours ago • Promoted • New!

Data Engineer - Databricks, Pyspark

Diverse Lynx • Pittsburgh, PA, United States

Full-time

Databricks, Pyspark,python,sql.Diverse Lynx LLC is an Equal Employment Opportunity employer.All qualified applicants will receive due consideration for employment without any discrimination.All app...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Diverse Lynx • Pittsburgh, PA, United States

Full-time

Strong hands-on with Hadoop ecosystem including -.PySpark for scalable data processing.Hive and Impala for data warehousing and query based analysis. Linux / Unix - Scripting and operational troublesh...Show more

Last updated: 30+ days ago • Promoted

Senior Data Platform Engineer

Govini • Pittsburgh, PA, United States

Full-time

Last updated: 30+ days ago • Promoted

Data Engineer

TWO95 International • Pittsburgh, PA, United States

Full-time

Type : 6 months (contract to hire).Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop / HDFS, Hive, Drill, Pig, etc. Big Data technology stacks (Hortonworks, Cloudera, etc.Agile devel...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Azure Databricks

Pittsburgh Paints • Cranberry Twp, PA, United States

Full-time

Data & Analytics team in the US or Canada.The ideal candidate will have extensive experience in data engineering, working with Databricks and Azure cloud services, designing and implementing scalab...Show more

Last updated: 15 hours ago • Promoted • New!