Big data engineer Jobs in Sunnyvale, CA

Create a job alert for this search

Big data engineer • sunnyvale ca

Last updated: 2 days ago

Promoted

BIG DATA PLATFORM STAFF ENGINEER

Integrated Resources Inc.Santa Clara, CA, United States

Full-time

Our mission is to service with Integrity as both an employer of choice to our associates and a strategic partner to our clients. IRI’s vision is to become an industry-leading staffing services organ...Show moreLast updated: 18 days ago

Promoted

Sr. Software Engineer, Big Data

PinterestPalo Alto, CA, United States

Full-time

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to br...Show moreLast updated: 30+ days ago

DE&A - Core - Big Data Engineering - No SQL Data Engineering

Zensar TechnologiesSan Jose, CA, United States

Full-time

We are looking for an experienced.Data Engineering, Analytics, and AI practice.This individual will lead scalable data platform initiatives with a focus on. MongoDB and distributed NoSQL architectur...Show moreLast updated: 2 days ago

Data Engineer

DiamondpickSunnyvale, CA, United States

Full-time

Key Skills : Tableau, Python, Snowflake.The ideal candidate will excel at collaborating with business users, cross-functional teams, and offshore teams to deliver high-quality data solutions.A solid...Show moreLast updated: 25 days ago

Promoted

Data Engineer

HCLTechMenlo Park, CA, United States

Full-time

HCLTech is looking for a highly talented and self- motivated.Partner with leadership, engineers, program managers and data scientists to understand data needs. Design, build and launch extremely eff...Show moreLast updated: 11 days ago

Promoted

Senior Big Data Engineer

VirtualVocationsSanta Clara, California, United States

Full-time

A company is looking for a Senior / Lead Big Data Engineer (Scala / Spark).Key ResponsibilitiesDevelop Spark jobs for data synchronization between different storage systemsBuild and maintain big data p...Show moreLast updated: 2 days ago

Promoted

SENIOR SOFTWARE ENGINEER, BIG DATA

ZipRecruiterPalo Alto, CA, United States

Full-time

We offer a hybrid work environment.Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below. To actively connect people to their next ...Show moreLast updated: 4 days ago

Promoted

LEAD SOFTWARE ENGINEER - BIG DATA IN CUPERTINO, CA

US BankCupertino, CA, United States

Full-time

Bank, we’re on a journey to do our best.Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed.We b...Show moreLast updated: 4 days ago

Promoted

LEAD SOFTWARE ENGINEER - BIG DATA IN CUPERTINO, CA

U.S. BankCupertino, CA, United States

Full-time

Big Data Hadoop Engineer

Harvey NashCA

Remote

Full-time

We're looking for an outstanding Big Data HadoopEngineer to provide vision, gather requirements and translate client userrequirements into technical architecture and design and implement an integra...Show moreLast updated: 30+ days ago

Promoted

Data Engineering & Big Data Architect

InfosysSunnyvale, CA, United States

Full-time

Infosys is seeking a highly experienced.Technical Product management / Data analyst tasks and own the development of a.Tiered data architecture for our data platform. In this role, they would be respo...Show moreLast updated: 13 days ago

Cloudera • Hadoop • Big Data

Gamen GroupSan Jose, CA, US

Full-time

Are you a technology enthusiast that enjoys researching and selecting new technologies? Are you committed to delivering efficient and elegant technology-based solutions? Are you fascinated by BI...Show moreLast updated: 30+ days ago

Promoted

Principal Staff Software Engineer, Big Data Pipelines & Platform Infrastructure

LinkedInMountain View, CA, United States

Full-time

LinkedIn was built to help professionals achieve more in their careers, and every day, millions of people use our products to connect, discover opportunities, and gain insights.Our global reach all...Show moreLast updated: 30+ days ago

Lead Big Data Spark Engineer

Infosys Limited DigitalSunnyvale, CA, United States

Full-time

Technology|Data on Cloud-DataStore|Snowflake.Infosys is seeking a Lead Big Data Spark Engineer.In this role, you will interface with key stakeholders and apply your technical proficiency across dif...Show moreLast updated: 15 days ago

Staff Software Engineer - Big Data

PayPalUSA, California, San Jose, Corp, N First St

Full-time

PayPal is committed to fair and equitable compensation practices.Actual Compensation is based on various factors including but not limited to work location, and relevant skills and experience.The t...Show moreLast updated: 2 days ago

Staff Engineer Software (Java Backend, Distributed Systems - Big Data Cloud Platform)

Palo Alto NetworksSanta Clara, CA, United States

Full-time

At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 7 days ago

Big Data Lead

Hexaware TechnologiesSanta Clara, United States

Full-time

Databricks on Azure or on Big Data, SQL Data, and other sources.In depth understanding of DataBricksArchitecture including Lakehouse, Performance tuning, Compute and Storage.Migration project level...Show moreLast updated: 30+ days ago

BIG DATA PLATFORM STAFF ENGINEER

Integrated Resources Inc.Santa Clara, CA, United States

18 days ago

Job type

Full-time

Job description

Our mission is to service with Integrity as both an employer of choice to our associates and a strategic partner to our clients.

IRI’s vision is to become an industry-leading staffing services organization by maintaining ethical business practices, a passion for customer service, a commitment to quality, and our continued efforts to exceed expectations.

Job Description

Big Data Platform Staff Engineer

6 Months

Santa Clara, CA

As a core developer, you will be part of the team that focuses on the next generation Clients’ Big Data Platform. Your primary responsibility includes developing big data tools that facilitate various consumers (users or programs), in terms of optimizing or automating the system. In particular, you will be developing tools for handling big data metadata, extracting metadata and importing them into Clients’ big data platform, and synchronizing metadata across several metastores. You will also be developing algorithms to analyze query workload and generate recommendations (advisors) on optimizing the various system components and structures. You will also perform testing, analyzing, and optimizing the Big Data Platform performance. The position involves strong problem-solving and analytical nature, and excellent verbal and written communication skills.

BS or higher degree in Computer Science or related field.

5+ years of software development experience, including performance analysis.

Strong SQL knowledge (JDBC) in query processing, optimization and execution, query performance, Explain, database tooling.

Spark / SparkSQL is a big plus.

Excellent coding skills in Scala / Java and scripting languages; UI skill a big plus.

Hands-on experience in Big Data Components / Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL databases etc.

Experience in other distributed system components, such as Solr, Elasticsearch, Logstash, Kibana, Kafka, REST API, etc. is a plus.

Develop tools that extract / import / synchronize metadata.

Develop tools that analyze query workload, derive common workload characteristics, generate recommendations for optimizing the system usage, and measure the benefits (advisors).

Analyze performance and scalability of the system, typically across a variety of software configurations.

Testing (and automated testing) of developed code.

J-18808-Ljbffr