Talent.com
Sr Developer - Data Engineering - Irving

Sr Developer - Data Engineering - Irving

PhotonJersey City, NJ, United States
3 days ago
Job type
  • Full-time
Job description

Job Description

Key Responsibilities :

  • Develop, test, and deploy data processing applications using Apache Spark and Scala.
  • Optimize and tune Spark applications for better performance on large-scale data sets.
  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
  • Design and implement high-performance data processing and analytics solutions.
  • Ensure data integrity, accuracy, and security across all processing tasks.
  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
  • Implement version control and CI / CD pipelines for Spark applications.

Required Skills & Experience :

  • Minimum 8 years of experience in application development.
  • Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.
  • Familiarity with version control tools like Git and CI / CD tools (e.g., Jenkins, GitLab).
  • Compensation, Benefits and Duration

    Minimum Compensation : USD 46,000

    Maximum Compensation : USD 161,000

    Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.

    Medical, vision, and dental benefits, 401k retirement plan, variable pay / incentives, paid time off, and paid holidays are available for full time employees.

    This position is not available for independent contractors

    No applications will be considered if received more than 120 days after the date of this post

    Create a job alert for this search

    Sr Data Developer • Jersey City, NJ, United States

    Related jobs
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, IncNew York, NY, United States
    Full-time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    VimeoNew York, NY, United States
    Full-time
    Vimeo's mission is to help every business and video professional grow their brand with video.Through our ever expanding suite of tools that allows everyone to create, manage, share, and sell video,...Show moreLast updated: 3 days ago
    • Promoted
    Engineering Manager, Data Infrastructure

    Engineering Manager, Data Infrastructure

    VirtualVocationsFlushing, New York, United States
    Full-time
    A company is looking for an Engineering Manager, Data Infrastructure & Serving Layer.Key Responsibilities Lead and manage a high-performing engineering team focused on the serving layer Design a...Show moreLast updated: 3 days ago
    • Promoted
    Senior Director of Data

    Senior Director of Data

    VirtualVocationsNewark, New Jersey, United States
    Full-time
    A company is looking for a Senior Director of Data.Key Responsibilities Establish a vision for a unified data organization that promotes collaboration and innovation Lead modernization efforts o...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineering Manager - Data and AI / ML PlatformsNew York, New York, United States

    Senior Engineering Manager - Data and AI / ML PlatformsNew York, New York, United States

    Lane (Acquired by VTS)New York, NY, US
    Full-time
    Senior Engineering Manager - Data and AI / ML Platforms.We're seeking a Senior Engineering Manager to own the engineering for AI / ML and Core data platforms for VTS products.This role will drive new A...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    A.M. BestJersey City, NJ, United States
    Full-time
    Flexible and hybrid work arrangements.Paid time off / Paid company holidays.Medical plan options / prescription drug plan. Dental plan / vision plan options.Flexible spending and health savings accounts.R...Show moreLast updated: 3 days ago
    • Promoted
    Product Manager - Data Analytics

    Product Manager - Data Analytics

    CentralReachHolmdel, NJ, US
    Full-time
    CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users, we enabl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineering

    Senior Data Engineering

    MphasisNew York, NY, United States
    Full-time
    Mph- Client Site, New York, US.We are seeking a highly motivated.The ideal candidate will possess strong expertise in.This role requires a technically skilled individual who is curious, self-driven...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsYonkers, New York, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 1 day ago
    • Promoted
    Director of Data

    Director of Data

    VirtualVocationsFlushing, New York, United States
    Full-time
    A company is looking for a Director of Data to lead their Data Architecture, Engineering, and Science teams.Key Responsibilities Develop and execute a comprehensive Data strategy aligned with bus...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Manager Lab Data Engineering

    Manager Lab Data Engineering

    VirtualVocationsBronx, New York, United States
    Full-time
    A company is looking for a Manager of Lab Data Engineering - Business Intelligence.Key Responsibilities Build and lead a high-performing Lab Data Engineering team Drive the development and execu...Show moreLast updated: 12 hours ago
    • Promoted
    Sr Decision Support Analyst

    Sr Decision Support Analyst

    RWJBarnabas Health Corporate ServicesOceanport, NJ, United States
    Full-time
    Job Title : Sr Decision Support Analyst.Location : Barnabas Health Corp.Department : Financial Data and Reporting.The above reflects the anticipated annual wage range for this position if hired to wor...Show moreLast updated: 3 days ago
    • Promoted
    Director, Data Engineering

    Director, Data Engineering

    VimeoNew York, NY, United States
    Full-time
    Vimeo is seeking a Director of Data Engineering to lead our data strategy, architecture, and automation efforts.This role will drive the development of a modern, scalable lakehouse architecture wit...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Omni InclusiveNew York, NY, United States
    Full-time
    Desired Skill : Bloomberg data acquisition and transformation.Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources int...Show moreLast updated: 3 days ago
    • Promoted
    Senior EDI Developer

    Senior EDI Developer

    VirtualVocationsFlushing, New York, United States
    Full-time
    A company is looking for a Senior IBM Sterling Integrator Developer.Key Responsibilities Design, develop, support, and monitor IBM Sterling Integrator solutions Implement EDI / B2B integration acr...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    VirtualVocationsFlushing, New York, United States
    Full-time
    Key Responsibilities : Lead the definition and execution of the Information Management roadmap Manage architectural runway for enterprise data models and advanced data analytics capabilities Pro...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Lead

    Engineering Lead

    VirtualVocationsYonkers, New York, United States
    Full-time
    A company is looking for an Engineering Lead to guide a team in building and evolving a safety-focused technology platform. Key Responsibilities Architect and scale systems for reliability and mai...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsFlushing, New York, United States
    Full-time
    A company is looking for a Senior Data Engineer to lead the data engineering function and enhance data capabilities.Key Responsibilities Design, build, and optimize data architecture, pipelines, ...Show moreLast updated: 30+ days ago