Lead Data EngineerArgyllinfotech • San Jose, CA, United States
Lead Data Engineer
Argyllinfotech • San Jose, CA, United States
11 hours ago
Job type
- Full-time
- Quick Apply
Job descriptionHigh proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processing Good knowledge in Python for data manipulation and scripting Mastery of advanced SQL and deep experience working with relational databases and data warehouses Hands-on experience with workflow management tools like Apache Airflow Familiarity with Unix shell scripting for automation and system management
Hello Everyone,
No GC,
Role : Senior Lead Data Engineer
Location : San Jose, CA 95125 Hybrid(Locals)
Key : Hadoop, Spark SQL strong
Key Responsibilities :
Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL
- Manage and optimize the infrastructure ensuring reliability and performance
- Design and implement data models and schemas for enterprise data warehouse and data marts
- Write and maintain scripts in Python for various applications
- Develop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databases
- Work closely with analysts and product managers to understand data requirements and deliver high-quality data
- Provide technical guidance and mentorship to other team members fostering best practices in data engineering
- Monitor system performance, identify bottlenecks, implement solutions to ensure high data availability
Required Skills :
Create a job alert for this search
Lead Data Engineer • San Jose, CA, United States
Related jobs
We are looking for a Data Engineer or Analytics Engineer to join our Data team.You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foun...Show more
Engineer data systems that change how people live and work.As a senior data engineer at Gallup, you’ll play a key role in designing, developing and optimizing the data systems that underpin our fla...Show more
Alembic is where top engineers are solving marketing's hardest problem : proving what actually works.If you're looking for frontier technical challenges at an applied science company, this is the pl...Show more
We are seeking a highly skilled and motivated Senior Data Engineer to join our team at Shopmonkey.This role is critical to building, maintaining and improving our data infrastructure, ensuring that...Show more
We are looking for experienced contract data / software engineer contractors to support the Multi-Cloud Efficiency (MCE) team in scaling cost attribution infrastructure and improving financial visibi...Show more
The Balbix Security Cloud uses AI and automation to reinvent how the World's leading organizations reduce their cyber risk.
With Balbix, security teams can accurately inventory their cloud and on-pr...Show more
Data Engineer (GCP Cloud) – 100% Onsite.We are seeking a highly skilled.This role requires designing and building scalable data solutions that support business intelligence, analytics, and machine ...Show more
We are redefining how knowledge is shared.We are enabling anyone to transform their unique expertise into an interactive experience, a digital version of their mind : a dynamic reflection of their k...Show more
As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show more
As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers.
We hire the best and brightest, who are driven to create lasting valu...Show more
You’re a hands on Senior Data Engineer with strong Python skills and experience building robust data pipelines in cloud environments.
You enjoy solving complex data problems, working cross-functiona...Show more
We're looking for a Lead Data Engineer to spearhead design, implementation, and iteration of a world-class, modern data infrastructure that will power all of analytics, data science, and ML / AI syst...Show more As a Senior Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related da...Show more The Balbix Security Cloud uses AI and automation to reinvent how the World's leading organizations reduce their cyber risk.
With Balbix, security teams can accurately inventory their cloud and on-pr...Show more 
Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems.A...Show more
We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most.
Rokt’s AI Brain and ecommerce Network powers billi...Show more
Are you ready to make an impact?.West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team.
In this role, you will collaborate with our clients to address their m...Show more
We’re a small, cross-functional team focused on building AI systems that reason and code.We care deeply about understanding how people interact with these systems and how we can use data to make th...Show more
Data Engineer
Kikoff • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Gallup • San Francisco, California, United States
Full-time
Last updated: 4 days ago • Promoted
Senior Data Engineer
Alembic • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Shopmonkey • Morgan Hill, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer | 2025PX05009 | 477|DB-26453
Mindverse Consulting Services • Mountain View, California, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Senior / Staff Data Engineer
Balbix • San Jose, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer (GCP Cloud)
Appworkshub • Santa Clara, California, United States
Full-time
Last updated: 3 days ago • Promoted
Data Engineer
Delphi • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Principal Data Engineer
Tendo • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Xscion • San Francisco, California, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Polly • San Francisco, California, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Lead Data Engineer
Midi Health • Palo Alto, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Tendo • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Balbix • San Jose, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Together Ai • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Rokt • San Francisco, California, United States
Full-time
Last updated: 3 days ago • Promoted
Data Engineer
West Monroe • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Imbue • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted