Talent.com
Senior Big Data & DevOps Engineer

Senior Big Data & DevOps Engineer

VDart IncPittsburgh, PA, United States
3 days ago
Job type
  • Temporary
  • Quick Apply
Job description

Role : Senior Big Data & DevOps Engineer.

Location : Pittsburgh, PA (Remote).

Duration : Long Term Contract.

Position Summary :

  • Seeking a Senior Big Data & DevOps Engineer with 8+ years of expertise in HDFS, Hive, Impala, PySpark, Python, and DevOps automation (uDeploy, Jenkins). Responsible for end-to-end management of enterprise data platforms, including HDFS table governance, scalable ETL pipeline development, CI / CD automation, platform upgrades, incident / change management, and production support.

Key Responsibilities :

  • Design, manage, and optimize HDFS directories, tables, and data partitioning strategies across large distributed clusters.
  • Enforce data retention, lifecycle policies, and security compliance in high-volume Hadoop environments.
  • Administer Hive and Impala platforms, focusing on performance tuning, capacity planning, and troubleshooting.
  • Develop scalable ETL pipelines and reusable data frameworks using PySpark, Hive, and Python.
  • Implement and support CI / CD pipelines via Jenkins and uDeploy, ensuring automated, reliable, multi-environment deployments.
  • Manage platform upgrades, patching, and code promotion across DEV, QA, UAT, and PROD stages.
  • Perform advanced Linux administration, including scripting, system tuning, disk management, and disaster recovery.
  • Drive incident and change management using ServiceNow, including RCA investigation, issue resolution, and preventive actions.
  • Mentor junior engineers, foster technical leadership, and document operational knowledge for internal sharing.

    • Required Qualifications :

  • Bachelor's degree in Computer Science or related field.
  • 8+ years in Big Data engineering and DevOps.
  • Advanced proficiency in HDFS, Hive, Impala, PySpark, Python, and Linux.
  • Proven CI / CD experience with Jenkins and uDeploy.
  • Strong ETL development, orchestration, and optimization skills.
  • Experience with ServiceNow for incident / change / problem management.

    • Nice to Have :

  • Experience with cloud-based data platforms (AWS EMR).
  • Knowledge of Docker, Kubernetes, and infrastructure automation (Ansible, Terraform).
    • Create a job alert for this search

    Senior Data Engineer • Pittsburgh, PA, United States

    Related jobs
    • Promoted
    Senior Manager, Business Development, Cell & Gene Therapies

    Senior Manager, Business Development, Cell & Gene Therapies

    Fresenius Kabi USA, LLCWarrendale, PA, United States
    Full-time
    The Senior Manager, Business Development, will play a critical role in driving global sales and business development strategy for our cutting-edge Cell and Gene Therapies (CGT) Technologies divisio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Roadway Engineer

    Senior Roadway Engineer

    System OneCranberry Township, PA, US
    Full-time
    Job Title : Roadway Engineer (Licensed PE) Location : Pittsburgh, PA (On-site with flexible hybrid options) Job Type : Full-Time About the Role : We’re seeking an experienced Roadway Engineer with 15 y...Show moreLast updated: 30+ days ago
    • Promoted
    GIS Solutions Architect Senior

    GIS Solutions Architect Senior

    Adex CorporationCanonsburg, PA, US
    Full-time
    System Analyst III Location : 100% Remote Expense : Internet Demonstrate an overall understanding of GIS based application use patterns in order to define, develop, document, support and implement te...Show moreLast updated: 2 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    System OnePittsburgh, PA, US
    Full-time
    Position Title : Senior Big Data Engineer Position Location : Pittsburgh Provide locations / flexible work by preference : Most preferred - Pittsburgh PA - Two PNC Plaza, 620 Liberty Ave, Pittsburgh, PA...Show moreLast updated: 30+ days ago
    • Promoted
    Uber - Sign Up to Drive and Earn

    Uber - Sign Up to Drive and Earn

    UberWind Ridge, PA, US
    Full-time +1
    Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Want to earn extra money? Drive with Uber

    Want to earn extra money? Drive with Uber

    UberWind Ridge, PA, US
    Full-time +1
    Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Project Engineer - Roadway

    Senior Project Engineer - Roadway

    System OneCranberry Township, PA, US
    Full-time
    Job Title : Licensed PE Roadway Engineer Location : Pittsburg, PA (Hybrid / Remote options available) Job Type : Full-Time Job Description : We are seeking an experienced Licensed PE Roadway Engineer wit...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    System OnePittsburgh, PA, US
    Full-time
    Additional Skills and Notes : Position Title : Senior Devops Engineer Position Location : PNC Tech Hub Provide locations / flexible work by preference : 1. Pittsburgh PA OR Cleveland OH - Strongsville Tec...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data & DevOps Engineer

    Senior Big Data & DevOps Engineer

    VDart IncPittsburgh, Pennsylvania, USA
    Full-time
    Role : Senior Big Data & DevOps Engineer.Location : Pittsburgh PA (Remote).Seeking a Senior Big Data & DevOps Engineer with 8 years of expertise in HDFS Hive Impala PySpark Python and DevOps automati...Show moreLast updated: 1 day ago
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    GoviniPittsburgh, Pennsylvania, United States, 15201
    Full-time
    Govini transforms Defense Acquisition from an outdated manual process to a software-driven strategic advantage for the United States. Our flagship product, Ark, supports Supply Chain, Science and Te...Show moreLast updated: 30+ days ago
    Sr Data Engineer

    Sr Data Engineer

    Techstra SolutionsPittsburgh, PA, US
    Full-time
    Quick Apply
    The main function of a data engineer is to develop and implement data solutions for data platforms.Coordinate the collection, normalization and analysis of datasets across multiple data platforms.A...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Earn extra cash - Sign up and drive with Uber

    Earn extra cash - Sign up and drive with Uber

    UberWind Ridge, PA, US
    Full-time +1
    Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Maven MachinesPittsburgh, Pennsylvania, United States
    Remote
    Full-time
    Maven is on a mission to automate trucking operations and transform how the world moves freight.Since 2014, Maven has empowered many of the nation’s top trucking and transportation fleets with crit...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Warehouse Worker - $500 Sign-On Bonus

    Warehouse Worker - $500 Sign-On Bonus

    United Parcel ServiceConnellsville, PA, US
    Full-time +2
    Applying for this role online is quick and easy and you could even schedule your first day of work within 10 minutes!.Provide some basic information to start the application process.Watch a short ...Show moreLast updated: 1 hour ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BnyPittsburgh, Pennsylvania, United States
    Full-time
    Senior Data Engineer At BNY, our culture empowers you to grow and succeed.As a leading global financial services company at the center of the world's financial system we touch nearly 20% of the wor...Show moreLast updated: 30+ days ago
    DevOps Engineer

    DevOps Engineer

    Prequel SolutionsPittsburgh, Pennsylvania, United States
    Full-time
    Quick Apply
    Pittsburgh, PA (Hybrid mostly remote with occasional onsite collaboration).Contract To Hire, Seeking PGH based Candidates. We're partnering with a growing SaaS company that's modernizing its platfor...Show moreLast updated: 12 days ago
    • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    CieApollo, Pennsylvania, United States
    Full-time
    We're passionate about leveraging the power of data to drive better educational outcomes for students.Our team is dedicated to innovating and implementing cutting-edge technology that enhances the ...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Lever Demo - IS OpportunitiesCalifornia, Pennsylvania, United States, 15419
    Full-time
    PLEASE READ : these jobs are testing jobs of Lever's testing environment - please do not apply for this job.Lever was founded ten years ago to tackle the most strategic challenge that companies face...Show moreLast updated: 30+ days ago