Senior Big Data Engineer (Python / PySpark)
System OneStrongsville, OH, US1 day ago
Job type
- Full-time
Job descriptionDeep understanding of multi-process architecture and the threading limitations of Python. PySpark data engineering skills. Experience using libraries like Pandas, NumPy and MatPlotLib; experience with file-based systems (CSV / Parquet). Extensive knowledge in understanding data and creating data pipelines. Hands-on experience designing and implementing APIs. Hands-on experience building microservices using FastAPI or related technologies. Experience writing unit tests and ensuring code coverage. Experience with Agile methodology / JIRA / Confluence. Experience in version control using Git. Added advantage if you have worked on Big Data, PySpark libraries. Deep understanding of multi-process architecture and Python threading limitations. Experience in version control using Git. Experience with Pandas, NumPy and MatPlotLib; file-based systems (CSV / Parquet). Experience with Agile methodology / JIRA / Confluence. Experience writing unit tests and ensuring code coverage. Understanding data and creating data pipelines. Hands-on experience building microservices using FastAPI or related technologies. PySpark data engineering skills.
Overview
Position Title : Senior Big Data Engineer (Python / PySpark)
Locations / Flex : Pittsburgh PA - Two PNC Plaza or Cleveland OH - Strongsville Technology Center. The hiring team is not sourcing outside these hubs at this time. Working arrangement is Hybrid : 3 days in office, 2 remote. Acceptable time zones : EST. Working days : Mon–Fri, 40 hours. Working hours (flexible) : 8 : 00 a.m. – 5 : 00 p.m. EST.
Responsibilities
- Interact with the business to understand evolving requirements and adapt accordingly.
- Understand business requirements and tech stack involved; guide the team toward an integral solution approach.
- Demonstrate dedication and strong communication skills; participate in Agile ceremonies.
- Hands-on experience with object-oriented programming, including its limitations.
- Familiarity with cross-platform development.
- Manage database storage and retrieval on data lake platforms; extensive experience in handling.
- Extensive Unix / FTP / file handling.
- Strong hands-on experience with SQL databases.
Must Have Technical Skills
Flex Skills / Nice to Have
Education / Certifications
Bachelors Preferred
Python or Spark certifications are a plus
Role Differentiator
Conversion possibility and growth opportunities are strong, with ongoing work and energizing new opportunities. The role supports the bank in a critical area and contributes to overall success.
Skills
How to Apply
Share your resume with Ariz Khan at ariz.khan@systemone.com. Also connect on LinkedIn : Ariz J. Khan.
Ref : #404-IT Pittsburgh
J-18808-Ljbffr
Create a job alert for this search
Senior Data Engineer • Strongsville, OH, US
Related jobs
The Senior Software Engineer is responsible for ensuring the successful operation of project development and deployment of enterprise level products.
This includes planning, organizing, and ensuring...Show moreLast updated: 9 days ago
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago
The Data Engineer I will play a vital role in our Data transformation journey - helping move the organization toward a future state where decision-makers have the right data, in real time, when the...Show moreLast updated: 30+ days ago
As a Senior Software Engineer, you will play a crucial role in developing both front-end and back-end components of our applications.
You will collaborate with cross-functional teams to design, deve...Show moreLast updated: 30+ days ago Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago 
F;tax, accounting, and business consulting.F; We have a ‘People First’ culture and we focus on our employees’ well-being and professional development.
With over 400 professionals a...Show moreLast updated: 3 days ago
The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show moreLast updated: 2 days ago Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago 
You will be an owner of the EDI platform, responsible for improving system reliability, creating redundancy, and modernizing EDI processes that have remained unchanged for decades.Youll partner wit...Show moreLast updated: 5 days ago
We are seeking an experienced and skilled Data Architect to join our team! Our ideal candidate thrives in a collaborative environment, is a self-starter, and is passionate about data architecture i...Show moreLast updated: 30+ days ago
At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve.We are all united in delivering the best experience for our customers.We work together each day ...Show moreLast updated: 16 days ago
The Senior Software Engineer is responsible for ensuring the successful operation of project development and deployment of enterprise level products.
This includes planning, organizing, and ensuring...Show moreLast updated: 5 days ago
Genesis10 is seeking a Senior UI Engineer for a contract position with our healthcare services client.This will be a remote opportunity.
W2, depending on skill and experience level.Will join an exis...Show moreLast updated: 2 days ago
We are looking for an experienced AWS Engineer to join our team.This long-term contract position offers an exciting opportunity to work on innovative AI initiatives, leveraging cutting-edge tools l...Show moreLast updated: 11 hours ago
Our mission is to build a connected society, rooted in trust, with identity-first security for every machine and human.Keyfactor helps organizations move fast to establish digital trust at scale - ...Show moreLast updated: 30+ days ago Business Intelligence Data Engineer.As a Data Engineer (Analytics Specialist), you will build robust data warehouse / marts / sets which will enable business users to make informed decisions.You will u...Show moreLast updated: 30+ days ago The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show moreLast updated: 2 days ago 
Director, Community and Reentry Programs.Founded in 1976, Towards Employment (TE) is a non-profit leader in providing innovative solutions to move people out of poverty, into quality jobs and along...Show moreLast updated: 1 day ago
- Promoted
Senior Software Engineer
The Provato GroupWestlake, OH, USFull-time
- Promoted
Remote Senior Financial Analyst - AI Trainer
Data AnnotationEuclid, OhioRemote
Full-time +1
- Promoted
Need a gig? Deliver with Uber Eats!
Uber eatsChippewa Lake, OH, United StatesFull-time +1
- Promoted
Data Engineer I
First Mutual Holding CompanyLakewood, OH, United StatesFull-time
- Promoted
Senior Software Engineer
AmTrust FinancialCleveland, OH, United StatesFull-time
- Promoted
Deliver with Uber Eats
Uber eatsSpencer, OH, United StatesFull-time +1
- Promoted
Data Engineer
ReaIndependence, OH, USFull-time
- Promoted
Tech Lead, Web Core Product & Chrome Extension - Akron, USA
SpeechifyAkron, OH, USFull-time
- Promoted
Make money your way. Deliver with Uber!
Uber eatsAvon Lake, OH, United StatesFull-time +1
- Promoted
Food Delivery Driver
Uber eatsBerlin Heights, OH, United StatesFull-time +1
- Promoted
EDI Platform Owner (Akron)
Proven Process GroupAkron, OH, USPart-time
Data Architect III
Rust-Oleum CorporationUSA, Ohio, BeachwoodFull-time
- Promoted
Portfolio Analytics and Strategy Analyst - Monitoring (SQL, Python, R)
PNCCleveland, OH, USFull-time +1
- Promoted
Senior Software Engineer (Westlake)
The Provato GroupWestlake, OH, USPart-time
Genesis10 is hiring : Senior UI Engineer in Cleveland
MediabistroCleveland, OH, United StatesPermanent
- Promoted
- New!
AWS Engineer
Robert HalfCleveland, OH, USFull-time
- Promoted
Senior Software Engineer
KeyfactorIndependence, OH, United StatesFull-time
- Promoted
Business Intelligence Data Engineer
AmTrust FinancialCleveland, OH, United StatesFull-time
- Promoted
Software Engineer, Platform - Akron, USA
SpeechifyAkron, OH, USFull-time
- Promoted
Program Associate, Data Analytics
Towards Employment IncorporatedCleveland, OH, USFull-time