Talent.com
Data Engineer lead
Data Engineer leadArgyllinfotech • CA, United States
Data Engineer lead

Data Engineer lead

Argyllinfotech • CA, United States
1 day ago
Job type
  • Full-time
  • Quick Apply
Job description

Senior Lead Data Engineer

Location : San Jose, CA 95125 Hybrid(local)

No GC

Key : Hadoop, Spark SQL strong

Key Responsibilities :

Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL

  • Manage and optimize the infrastructure ensuring reliability and performance
  • Design and implement data models and schemas for enterprise data warehouse and data marts
  • Write and maintain scripts in Python for various applications
  • Develop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databases
  • Work closely with analysts and product managers to understand data requirements and deliver high-quality data
  • Provide technical guidance and mentorship to other team members fostering best practices in data engineering
  • Monitor system performance, identify bottlenecks, implement solutions to ensure high data availability

Required Skills :

  • High proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processing
  • Good knowledge in Python for data manipulation and scripting
  • Mastery of advanced SQL and deep experience working with relational databases and datawarehouses
  • Hands-on experience with workflow management tools like Apache Airflow
  • Familiarity with Unix shell scripting for automation and system management
  • Please share profile kirankumar@argyllinfotech.com

    Create a job alert for this search

    Lead Data Engineer • CA, United States

    Related jobs
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    Openkyber • CA, United States
    Temporary
    Quick Apply
    Senior Data / AI Engineer Location : Irvine, CA ( Remote) Duration : 6+ months contract to hire Online testing is need.Note : At least 3 years of experience working with AWS service...Show more
    Last updated: 15 hours ago • New!
    Senior AWS Serverless Engineer

    Senior AWS Serverless Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    Role : Gen AI Architect Location : Pleasanton , California We are seeking an experienced Generative AI Architect to lead the design, development, and deployment of cutting-edge generative AI systems....Show more
    Last updated: 15 hours ago • New!
    Data Architect

    Data Architect

    Axiom Technology Group • CA, United States
    Full-time +2
    Quick Apply
    Role : Data Architect Location : San Jose, CA ( Onsite ) Experience : 15+ years requ...Show more
    Last updated: 6 days ago
    Data Analyst

    Data Analyst

    United Way Fresno And Madera Counties • Fresno, California, United States
    Full-time
    Organization Wide Data Collection and Analysis.About United Way Fresno and Madera Counties.This mission of United Way Fresno and Madera Counties is to create paths to prosperity.We achieve this thr...Show more
    Last updated: 4 hours ago • Promoted • New!
    AWS Database Engineer / Cloud DBA

    AWS Database Engineer / Cloud DBA

    Openkyber • CA, United States
    Full-time
    Quick Apply
    Backend Software Engineer - Scala, Kubernetes W2 Contract Salary Range : $114,400 - $135,200 per year Location : Cupertino, CA - Remote Role Job Summary : We are looking for highly skilled Software En...Show more
    Last updated: 15 hours ago • New!
    AWS Data Engineer

    AWS Data Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    SRS Consulting Inc is seeking an experienced consultant for a focused engagement to migrate data transformation logic from AWS Glue to DBT. The role involves validating outputs, refining edge cases,...Show more
    Last updated: 15 hours ago • New!
    Data Analytics Engineer / Data Analyst III

    Data Analytics Engineer / Data Analyst III

    Alpha Net • CA, United States
    Full-time
    Quick Apply
    Job Title : Data Analyst III / Data Analytics Engineer (Contract) Location : Remote (United States)Show more
    Last updated: 8 days ago
    Staff Data Scientist

    Staff Data Scientist

    Take-two Interactive Software • California, United States, California, United States
    Full-time
    Headquartered in New York City, Take-Two Interactive Software, Inc.We develop and publish products principally through Rockstar Games, 2K, and Zynga. Our strategy is to create hit entertainment expe...Show more
    Last updated: 30+ days ago • Promoted
    GCP Engineer

    GCP Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    We have 2 openings for Couple of locations : - San Jose / Santa Clara, CA and Plano, TX Design and Optimization : Design, implement, and optimize clean, well-stru...Show more
    Last updated: 6 days ago
    SAP Data Architect

    SAP Data Architect

    Bausch-White Masonry, LLC • Fresno, California, USA
    Full-time
    We are seeking a highly skilled and experienced SAP Data Architect to join our dynamic IT team.The SAP Data Architect will be responsible for designing developing and implementing robust SAP data a...Show more
    Last updated: 4 days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Openkyber • CA, United States
    Temporary
    Quick Apply
    Job Title : Cloud Engineer Location : South Denver, CO (Onsite Interview Required)Show more
    Last updated: 6 days ago
    GCP AI Platform Engineer

    GCP AI Platform Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    We are looking for a AI Engineer for our client in S anta Clara , C A Job Title : AI Engineer Job Location : S anta Clara , C A Job Type : Cont...Show more
    Last updated: 1 day ago
    AI Systems Engineer

    AI Systems Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    Staff Machine Learning Engineer, LLM Fine Tuning (Verilog / RTL Applications) : HIGHLIGHTS : Location : San Jose, CA (Onsite / H...Show more
    Last updated: 1 day ago
    Axway B2Bi Engineer / Developer / Only W2

    Axway B2Bi Engineer / Developer / Only W2

    EITACIES Inc • California, USA
    Full-time
    Seeking an experienced Axway B2Bi & MFT Engineer to implement, configure, and support Axway B2Bi / MFT systems, ensuring secure and efficient data exchanges while man...Show more
    Last updated: 30+ days ago
    GCP ETL Engineer

    GCP ETL Engineer

    Openkyber • CA, United States
    Temporary
    Quick Apply
    Senior Data / AI Engineer Location : Irvine, CA ( Remote) Duration : 6+ months contract to hire On...Show more
    Last updated: 1 day ago
    Senior AI / ML Data Engineer

    Senior AI / ML Data Engineer

    Simarn Solutions • California, California, United States
    Full-time
    Job Title : Senior AI / ML Data Engineer .We are seeking a highly skilled Senior AI / ML Data Engineer with expertise in multimodal AI models, vector databases, and Azure-based data engineerin...Show more
    Last updated: 30+ days ago
    AWS Systems Engineer

    AWS Systems Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    The quickest way to be considered for this role is to CALL US directly! Click "Apply On Web" or "Apply Now" to access our Recruiter s contact details and give us a cal...Show more
    Last updated: 15 hours ago • New!
    Data Engineering & Analytics Consultant

    Data Engineering & Analytics Consultant

    Vkore Solutions • CA, United States
    Full-time +2
    Quick Apply
    Hlk209081781"> Job Description : Show more
    Last updated: 7 days ago