){kind=logo}
Big Data DeveloperPSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
Big Data Developer
PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
2 hours ago
Job type
- Permanent
Job descriptionData Pipeline Design & Development Design, build, and deploy scalable data pipelines for ingesting, processing, transforming, and storing high-volume datasets. Implement streaming and batch-processing solutions using Hadoop, Spark, and cloud-based tools. Data Architecture & Engineering Develop and maintain data architecture and data flow models. Ensure data reliability, accuracy, and integrity across all environments. Support data warehousing strategies and best practices. Data Quality, Security & Compliance Implement automated data validation, error handling, and monitoring. Ensure compliance with internal security controls and regulatory standards. Partner with governance teams to enforce data quality and security guidelines. Cross-Functional Collaboration Work closely with data scientists, analysts, product teams, and application developers. Translate business requirements into robust technical solutions. Participate in Agile ceremonies and contribute to technical design discussions. Performance Optimization Tune Spark applications, Hadoop jobs, and distributed data systems for performance and cost efficiency. Troubleshoot bottlenecks and implement improvements to system performance. Technical Leadership Provide mentorship to junior developers and contribute to coding standards, best practices, and technical documentation. 4+ years of Big Data Development experience in Hadoop ecosystems 2+ years of hands-on development with Apache Spark Proficiency in Java, Scala, or Python Strong understanding of distributed systems , ETL , data warehousing , and data modeling concepts Experience with large-scale datasets , performance tuning, and troubleshooting Strong problem-solving, communication, and collaboration skills Bachelor’s degree in Computer Science, Engineering, or related discipline Experience working with AWS cloud services (EMR, S3, Lambda, Glue, etc.) Experience with Spark 3.x or 4.x Exposure to Kubernetes, Airflow, or similar orchestration tools Familiarity with CI / CD and DevOps automation for data engineering Long-term project stability (12+ months, likely extension) Ability to work on high-impact scientific and research-driven datasets Hands-on cloud modernization (AWS) and next-generation big data tooling Collaborative and innovative engineering culture
The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation. The ideal candidate has hands-on experience building enterprise-grade data pipelines, working with distributed systems, and optimizing data processing workflows.
This is a long-term project (12+ months) with high visibility, cutting-edge tools, and opportunities to influence technical direction.
- U.S. CITIZENSHIP OR PERMANENT RESIDENCY REQUIRED. VISA OR EAD STATUS NOT ACCEPTABLE FOR THIS POSITION. NO EXCEPTIONS
What You’ll Do
Required Skills & Qualifications
Preferred Skills
Why This Opportunity Stands Out
Create a job alert for this search
Big Data Developer • Columbus, Ohio Metropolitan Area, United States
Related jobs
The ideal candidate will have hands-on experience with.Design, implement, and optimize.Partner with cross-functional teams to define data requirements and deliver business-ready solutions.Strong, p...Show more
Job Title : Databricks Developer.Location : Columbus OH (Onsite).Must Have Functional Skills 5 years of experience in Databricks.
At least 2-3 years of experience in Working with Informatica.Good unde...Show more)
Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation.
The ideal candidate has hands-on experience building enterpri...Show more
MessageBody"> About the Role The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementi...Show more
Columbus, OH (Onsite – 5 Days a Week).W2 Only (Local Candidates Preferred).PAM (Privileged Access Management).Privileged Access Management (PAM) group in Columbus, OH.
This role requires a highly mo...Show more
The Senior Data Engineer is responsible for modeling complex problems, building pipelines, maintaining ETL processes and troubleshooting issues within a cloud environment.They utilize cloud databas...Show more
Job Title : Big Data / Spark Developer.Location : Columbus, OH (Hybrid).Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and inno...Show more
Oracle's Cloud Infrastructure team is building new Infrastructure-as-a-Service technologies that operate at high scale in a broadly distributed multi-tenant cloud environment.Our customers run thei...Show more
Brooksource is looking for an entry-level Data Engineer to join our Banking Client in January 2026.This role will be part of a professional development program where you will receive technical and ...Show more
Data & AI Integration Developer (Onsite).Onsite with potential hybrid / remote based on business needs.Job Title : Data & AI Integration Developer.
The State of Ohio is seeking a highly skilled.Data & ...Show more
Heitmeyer Consulting is currently seeking a DataStage Developer for a contract-to-hire opportunity with one of our financial services clients in Columbus, OH.
The candidate will design, develop, int...Show more
The Senior Data Engineer is responsible for modeling complex problems, building pipelines, maintaining ETL processes and troubleshooting issues within a cloud environment.They utilize cloud databas...Show more
The Data Engineer is a technical leader and hands-on developer responsible for designing, building, and optimizing data pipelines and infrastructure to support analytics and reporting.This role wil...Show more
Job Title : DataStage Developer.Duration : 3-month contract to hire.The client is currently seeking a DataStage Developer for a contract-to-hire opportunity with one of our financial services clients...Show more
DataStage ETL Developer - Local to Columbus, Ohio.Category : Software Development / Engineering.Main location : United States, Ohio, Columbus.
Are you passionate about transforming raw data into action...Show more
Job Title : DataStage Developer.Job Location : Columbus, OH (Hybrid).Contract Length : 3-Months (Contract to Hire).Lead the design and development of ETL processes using IBM DataStage.Manage and mento...Show more
Required Skills & Qualifications.Applicants must be able to work directly for Artech on W2.Proficiency in IBM InfoSphere DataStage.
Basic knowledge of Unix / Linux commands.Preferred Skills & Qualific...Show more
Data Engineer (Columbus)
Agility Partners • Columbus, Ohio Metropolitan Area, US
Part-time
Last updated: 3 hours ago • Promoted • New!
Datastage Developer - Columbus, OH - ONSITE FROM DAY 1
Qualis1 Inc • OH, United States
Databricks Developer
Diverse Lynx • Columbus, OH, United States
Full-time
Last updated: 30+ days ago • Promoted
Big Data Developer (Columbus)
PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, US
Part-time +1
Last updated: 3 hours ago • Promoted • New!
Big Data Developer
TRIMAH TECHNOLOGIES LLC • Columbus, OH, United States
Full-time
Quick Apply
Last updated: 2 days ago
Data Engineer Location : OH (Onsite – 5 Days a Week)
Career Mentors, LLC • Columbus, OH, US
Full-time
Last updated: 30+ days ago
Senior Data Engineer
Outcomes • Dublin, OH, US
Full-time
Last updated: 4 days ago • Promoted
W2 Contract Req : Big Data / Spark Developer (Hybrid / Columbus, OH)
TRIMAH TECHNOLOGIES LLC • Columbus, Ohio Metropolitan Area, United States
Full-time
Last updated: 2 hours ago • Promoted • New!
Senior Software Engineer - Big Data
Oracle • Columbus, OH, United States
Full-time
Last updated: 30+ days ago • Promoted
Junior Data Engineer (Columbus)
Brooksource • Columbus, Ohio Metropolitan Area, US
Part-time
Last updated: 3 hours ago • Promoted • New!
Data & AI Integration Developer (Onsite)
SR International • Columbus, OH, United States
Full-time
Last updated: 4 days ago • Promoted
DataStage Developer / Lead
United Software Group • Columbus, OH, United States
Full-time
Last updated: 4 days ago • Promoted
Senior Data Engineer
Outcomes® • Dublin, OH, US
Full-time
Last updated: 1 day ago • Promoted
Data Engineer (Dublin)
IQVentures • Dublin, OH, US
Part-time
Last updated: 3 hours ago • Promoted • New!
DataStage Developer
InstantServe LLC • Columbus, OH, United States
Temporary
Last updated: 4 days ago • Promoted
DataStage ETL Developer - Local to Columbus, Ohio
CGI • Columbus, OH, United States
Full-time
Last updated: 4 days ago • Promoted
DataStage Developer
My3Tech Inc • Columbus, OH, United States
Full-time
Last updated: 4 days ago • Promoted
Datastage Developer
Artech • Columbus, OH, United States
Full-time
Last updated: 2 days ago • Promoted