Data Engineer

ForhyreSan Francisco, CA, US

30+ days ago

Job type

Full-time

Job description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

Document component design for developers and for broader communication.

Understand and adopt an Agile (SCRUM like) software development mindset

Follow established processes / standards, business technology architecture for development, release management and deployment process

Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.

Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.

Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.

Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.

Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

Requirements

Proven working experience as a data engineer

Bachelor degree or equivalent in Computer Science

Skilled in Python object-oriented programming

Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS

Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora

Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager

Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms

Skilled in SQL

Skilled in Jenkins

Skilled in JSON

Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica

Skilled in cloud technologies and cloud computing

Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere

Determining causes of operating errors and taking corrective action

Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data

Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB

Programming including coding, debugging, and using relevant programming languages

Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.

Ability to frame ideas as systems and analyzing the inputs, outputs, and process

Experience helping an organization to plan and manage change in effort to meet strategic objectives

Adept at managing project plans, resources, and people to ensure successful project completion

Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Create a job alert for this search

Data Engineer • San Francisco, CA, US

Related jobs

Promoted

Data Engineer

People Data LabsSan Francisco, CA, US

Permanent

Note for all engineering roles : with the rise of fake applicants and AI-enabled candidate fraud, we have built in additional measures throughout the process to identify such candidates and remove t...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

VirtualVocationsFremont, California, United States

Full-time

A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago

Promoted

Principal Data Engineer

VirtualVocationsFremont, California, United States

Full-time

A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago

Promoted

Data Engineer II

VirtualVocationsHayward, California, United States

Full-time

A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago

Promoted

Data Pipeline Engineer

VirtualVocationsConcord, California, United States

Full-time

A company is looking for an EA-Data Pipeline.Key Responsibilities Process datasets from various data vendors and clients Identify and implement automation improvements for data processing Maint...Show moreLast updated: 30+ days ago

Promoted

Data Platform Engineer

VirtualVocationsFremont, California, United States

Full-time

A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Sinclair Broadcast GroupSan Francisco, CA, US

Full-time

Digital Remedy is looking for a skilled Data Engineer to join our growing team of analytics experts.As a Data Engineer, you will help design, build, maintain, and troubleshoot data processing syste...Show moreLast updated: 17 days ago

Promoted

Data Engineer

EVERYDaly City, CA, US

Full-time

EVERY™ is a leading VC-backed food tech ingredient company and market leader using precision fermentation to create animal proteins without the animal for the global food and beverage industr...Show moreLast updated: 1 day ago

Promoted

Data Engineer

ForhyreSunnyvale, CA, US

Full-time

We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsib...Show moreLast updated: 30+ days ago

Promoted

Data Engineer 4

Cypress HCMSan Jose, CA, US

Full-time

Location : San Jose CA 95110 (Hybrid).Duration : 10 / 01 / 2025 to 2 / 27 / 2026.Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing.Build and optimize d...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

The Rockridge GroupEmeryville, CA, US

Full-time

Google Search console experience required.Google Tag Manager, merchant account or data studio experience preferred.Facebook knowledge will be big plus. Very proficient with installation, data interr...Show moreLast updated: 30+ days ago

Promoted

Staff Data Engineer

VirtualVocationsConcord, California, United States

Full-time

A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago

Promoted

Data Analytics Engineer

ParafinSan Francisco, CA, US

Full-time

At Parafin, we’re on a mission to grow small businesses.Small businesses are the backbone of our economy, but traditional banks often don’t have their backs. We build tech that makes it ...Show moreLast updated: 30+ days ago

Promoted

Lead AI Data Engineer

VirtualVocationsConcord, California, United States

Full-time

A company is looking for a Lead AI and Data Solution Engineer (LLMs, MCP).Key Responsibilities Lead the design, development, and deployment of enterprise-scale data and AI solutions Architect an...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VirtualVocationsConcord, California, United States

Full-time

A company is looking for a Data Engineer to build, maintain, and optimize data pipelines for genealogy data products.Key Responsibilities Build and maintain scalable data pipelines for large gene...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

VirtualVocationsConcord, California, United States

Full-time

A company is looking for a Senior Data Engineer to lead the data engineering function and enhance data capabilities.Key Responsibilities Design, build, and optimize data architecture, pipelines, ...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer II

VirtualVocationsFremont, California, United States

Full-time

A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 14 hours ago

Promoted

Data Engineer 4

NextDeavor Inc.San Jose, CA, US

Temporary

Here's how you'll become a key player with this opportunity : .We are looking for a Splunk expert to join on a short-term contract and help stabilize, optimize, and improve our Splunk environ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - Product

xAIPalo Alto, CA, US

Full-time

AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer for AI

VirtualVocationsFremont, California, United States

Full-time

A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 18 hours ago