Talent.com
Cloudera Data Engineer

Cloudera Data Engineer

INFT Solutions IncLincoln, NE, Nebraska, USA
2 days ago
Job type
  • Full-time
Job description

Job Title : Cloudera Data Engineer - 65050

Duration : 12+ Months

Location : Lincoln, Nebraska

Cloudera Data Engineer (Cloud DevOps Administrator Expert)

Job Summary

We are seeking a Cloudera Data Engineer to support the migration of a

Medicaid Data Warehouse Implementation in AWS environment. The resource will

support the migration and continued operations of an existing

Cloudera / Hive / Scala-based data pipeline environment from one AWS account to

another.

This position is responsible for ensuring a seamless transition, validating

data integrity and job performance, and maintaining reliable daily

operations post-migration.

The role will work closely with the existing project team for the

underlying AWS infrastructure (VPC, IAM, S3, EC2, networking). The resource

will focus on Cloudera cluster migration, data pipeline reconfiguration, and

operational stability.

Key Responsibilities

  • Replicate and configure existing Cloudera cluster (HDFS, YARN, Hive,

Spark) in the new AWS account.

  • Coordinate with project team to ensure proper infrastructure
  • provisioning (EC2, security groups, IAM roles, and networking).

  • Reconfigure cluster connectivity and job dependencies for the new
  • environment.

  • Migrate and validate metadata stores (Hive Metastore, job configs,
  • dependencies).

  • Validate job execution and data outputs for parity with existing
  • environment.

  • Deploy, test, and operate existing Hive, Spark (Scala) jobs
  • post-migration.

  • Maintain job schedules, dependencies, and runtime configurations.
  • Monitor job performance, identify bottlenecks, and apply tuning or
  • code-level optimizations.

  • Troubleshoot failures and implement automated recovery or alerting
  • where applicable.

  • Monitor Cloudera Manager dashboards, cluster health, and resource
  • utilization.

  • Manage user roles and access within Cloudera environment.
  • Implement periodic data cleanup, archiving, and housekeeping
  • processes.

  • Document configurations, migration steps, and operational runbooks.
  • Required Skills and Experience :

  • Bachelor’s degree in computer science, Information Systems, or a
  • related field.

  • 7+ years of experience in data engineering or big data
  • development

  • 4+ years’ experience with Cloudera platform (HDFS, YARN, Hive,
  • Spark, Oozie)

  • Experience deploying and operating Cloudera workloads on AWS
  • (EC2, S3, IAM, CloudWatch)

  • Strong proficiency in Scala, Java and HiveQL; Python or Bash
  • scripting experience preferred

  • Strong proficiency in Apache Spark & Scala programming for data
  • processing and transformation.

  • Hands on experience with Cloudera distribution of Hadoop.
  • Hands-on experience implementing business-rules processing using
  • Drools.

  • Able to work with infrastructure, DevOps, and data governance
  • teams in a multi-disciplinary environment.

    Preferred Qualifications :

  • Candidates with Cloudera certification (e.g., CDP Data Engineer
  • or Cloudera Administrator)

  • Experience with Cloudera version upgrades or AWS-to-AWS
  • environment migrations.

  • Experience in public-sector or large enterprise data
  • environments.

    Create a job alert for this search

    Data Engineer • Lincoln, NE, Nebraska, USA

    Related jobs
    • Promoted
    ObGyn

    ObGyn

    CompHealthBeatrice, Nebraska, US
    Full-time
    ObGyn physician employment in Nebraska : Interested in this assignment? Or maybe you still have not found what you are looking for? Contact one of our specialty-specific recruiters to get access to...Show moreLast updated: 29 days ago
    • Promoted
    Delivery Driver - Start Earning Quickly

    Delivery Driver - Start Earning Quickly

    DoorDashSeward, NE, United States
    Full-time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Freelance Data Collector

    Freelance Data Collector

    Prime InsightsBeatrice, NE, US
    Full-time
    Join thousands of members already earning with top-paying surveys and offers.Get started today and enjoy competitive rewards, fast payouts with no waiting periods, and the flexibility to participat...Show moreLast updated: 22 hours ago
    • Promoted
    Planning Administrator - 2nd shift - Waverly, NE

    Planning Administrator - 2nd shift - Waverly, NE

    Tyson FoodsWaverly, NE, US
    Full-time
    Certain roles at Tyson require background checks.If you are offered a position that requires a background check you will be provided additional documentation to complete once an offer has been exte...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer Intern - Lincoln, NE

    Data Engineer Intern - Lincoln, NE

    AmeritasLincoln, NE, United States
    Full-time +1
    Lincoln, Nebraska, United States.Ameritas Investment Partners (AIP) is seeking a.Investment Data and Analytics ecosystem. This position will be responsible for contributing to the design, maintenanc...Show moreLast updated: 12 days ago
    • Promoted
    Telemedicine Physician

    Telemedicine Physician

    QuickMDAshland, NE, US
    Full-time
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Market Research Contributor

    Market Research Contributor

    Prime InsightsBeatrice, NE, US
    Full-time
    Join thousands of members already earning with top-paying surveys and offers.Get started today and enjoy competitive rewards, fast payouts with no waiting periods, and the flexibility to participat...Show moreLast updated: 21 hours ago
    • Promoted
    Home Provider - Nebraska / Platte County

    Home Provider - Nebraska / Platte County

    MosaicSwanton, NE, US
    Full-time
    We are currently seeking home providers in : Columbus / Platte County, NE.Are you looking for a meaningful work opportunity in your home? Become a Host Home / Shared Living provider with Mosaic at H...Show moreLast updated: 2 days ago
    • Promoted
    Home Provider - Nebraska

    Home Provider - Nebraska

    MosaicSwanton, NE, US
    Full-time
    Are you looking for a meaningful work opportunity in your home? Become a Host Home / Shared Living provider with Mosaic at Home®! Average annual income of $76,800 (federally tax-free) plus room & b...Show moreLast updated: 2 days ago
    • Promoted
    Home Provider - Nebraska / Buffalo County

    Home Provider - Nebraska / Buffalo County

    MosaicVirginia, NE, US
    Full-time
    We are currently seeking home providers in : Kearney / Buffalo County, NE.Are you looking for a meaningful work opportunity in your home? Become a Host Home / Shared Living provider with Mosaic at H...Show moreLast updated: 2 days ago
    • Promoted
    Complete Online Surveys For Cash (Up to $25 / per)

    Complete Online Surveys For Cash (Up to $25 / per)

    Earn HausGretna, NE, US
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 3 days ago
    • Promoted
    Looking for the ultimate side hustle?

    Looking for the ultimate side hustle?

    Survey AuthorityBeatrice, NE, US
    Full-time
    Earn cash by matching with real companies that pay you for your opinions.Show moreLast updated: 28 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Highmark HealthLincoln, NE, United States
    Full-time
    This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenanc...Show moreLast updated: 3 days ago
    Traveling Superintendent

    Traveling Superintendent

    GpacAshland, Nebraska, United States
    Full-time
    Quick Apply
    Field Engineer – Commercial Construction | Ashland, NE 68003.A respected general contractor known for public, educational, and institutional builds seeks a. This position supports the field te...Show moreLast updated: 5 days ago
    • Promoted
    Restaurant Delivery - Onboarding / Onboard

    Restaurant Delivery - Onboarding / Onboard

    DoorDashSeward, NE, United States
    Full-time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show moreLast updated: 3 days ago
    • Promoted
    Sofware Engineer

    Sofware Engineer

    TradeJobsWorkForce68310 Beatrice, NE, US
    Full-time
    Analyze, design and develop tests and test-automation suites.Design, create and develop a processing platform using various configuration management technologies. Test software development methodolo...Show moreLast updated: 30+ days ago
    • Promoted
    Home Provider - Nebraska / Adams County

    Home Provider - Nebraska / Adams County

    MosaicSeward, NE, US
    Full-time
    We are currently seeking home providers in : Hastings / Adams County, NE.Are you looking for a meaningful work opportunity in your home? Become a Host Home / Shared Living provider with Mosaic at Ho...Show moreLast updated: 2 days ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausBeatrice, NE, US
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 3 days ago