Talent.com
Data Engineer
Data EngineerKrea • San Francisco, CA, United States
Data Engineer

Data Engineer

Krea • San Francisco, CA, United States
4 days ago
Job type
  • Full-time
Job description

About Krea

At Krea, we are building next-generation AI creative tools.

We are dedicated to making AI intuitive and controllable for creatives. Our mission is to build tools that empower human creativity, not replace it.

We believe AI is a new medium that allows us to express ourselves through various formatstext, images, video, sound, and even 3D. We're building better, smarter, and more controllable tools to harness this medium.

This job

Data is one of the fundamental pieces of Krea. Huge amounts of data power our AI training pipelines, our analytics and observability, and many of the core systems that make Krea tick.

As a data engineer, you will

build distributed systems to process gigantic (petabytes) amounts of files of all kinds (images, video, and even 3D data). You should feel comfortable solving scaling problems as you go.

work closely with our research team to build ML pipelines and deploy models to make sense of raw data.

play with massive amounts of compute on huge kubernetes GPU clusters - our main GPU cluster takes up an entire datacenter from our provider.

learn machine learning engineering (ML experience is a bonus, but you can also learn it on the job) from world-class researchers on a small yet highly effective tight-knit team.

Example projects

Find clean scenes in millions of videos, running distributed data pipelines that detect shot boundaries and saving timestamps of clips.

Solve orchestration and scaling issues with a large-scale distributed GPU job processing system on kubernetess.

Build systems to deploy and combine different LLMs to caption massive amounts of multimedia data in a variety of different ways.

Design multi-stage pipelines to turn petabytes of raw data into clean downstream datasets, with metadata, annotations, and filters.

Strong candidates may have experience with

Python, PyArrow, DuckDB, SQL, massive relational databases, PyTorch, Pandas, NumPy

Kubernetes

Designing and implementing large-scale ETL systems

Fundamental knowledge of containerization, operating systems, file-systems, and networking.

Distributed systems design

About us

Were building AI creative tooling.

Weve raised over $83M from the best investors in Silicon Valley.

Were a team of 12 with millions of active users scaling aggressively.

Create a job alert for this search

Data Engineer • San Francisco, CA, United States

Similar jobs
Data Engineer

Data Engineer

Kikoff • San Francisco, California, United States
Full-time
We are looking for a Data Engineer or Analytics Engineer to join our Data team.You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foun...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Swish Analytics • San Francisco, California, United States
Full-time
Swish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engi...Show more
Last updated: 2 days ago • Promoted
Data Engineer

Data Engineer

VirtualVocations • Oakland, California, United States
Full-time
A company is looking for a Data Engineer to support its data team by building and maintaining modern data infrastructure. Key Responsibilities Design, build, and maintain scalable data pipelines u...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Duckbill • San Francisco, California, United States
Full-time
We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements. We're looking for a data engine...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Drata • San Francisco, California, United States
Full-time
At Drata, we help companies earn and keep the trust of their users, customers, partners, and prospects.We’re the proof layer that shows great companies deserve the trust they aim to build.Built on ...Show more
Last updated: 6 hours ago • Promoted • New!
Data Engineer

Data Engineer

Neon Redwood • San Francisco, California, United States
Full-time
Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions.We are a team of passionate engineers and data experts, and we are currently looking for a D...Show more
Last updated: 6 hours ago • Promoted • New!
Senior Data Engineer

Senior Data Engineer

Vumedi • Oakland, California, United States
Full-time
Vumedi is the largest video education platform for doctors worldwide, dedicated to advancing medical education through innovative video-based learning. Our mission is to empower healthcare professio...Show more
Last updated: 25 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Foxglove • San Francisco, California, United States
Full-time
Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show more
Last updated: 6 hours ago • Promoted • New!
Senior Data Engineer

Senior Data Engineer

Xscion • San Francisco, California, United States
Remote
Full-time
As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting valu...Show more
Last updated: 30+ days ago • Promoted
Senior / Lead Data Solution Engineer

Senior / Lead Data Solution Engineer

Meltwater • Redwood City, CA, United States
Full-time
We're thrilled to embark on the search for a seasoned Senior / Lead Data Solution Engineer to join our vibrant team.This pivotal role offers an exciting opportunity to shape the future of technology ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Fluency • San Francisco, California, United States
Full-time
Fluency is enabling the autonomous Enterprise.You're needed to help pioneer a new software category that will change how enterprises work. Welcome to the data layer of the future.Fluency is looking ...Show more
Last updated: 6 hours ago • Promoted • New!
Senior Data Engineer

Senior Data Engineer

Together Ai • San Francisco, California, United States
Full-time
Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems.A...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Masterclass • San Francisco, California, United States
Full-time
We put you in the room with the creators, thinkers, makers and leaders who have changed the world, so that you can change yours. Members get unprecedented access to 150+ instructors and classes acro...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

West Monroe • San Francisco, California, United States
Full-time
Are you ready to make an impact?.West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their m...Show more
Last updated: 30+ days ago • Promoted
Data Engineer II

Data Engineer II

Axon • San Francisco, California, United States
Full-time
Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life.We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud sof...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Gofundme • San Francisco, California, United States
Full-time
Want to help us help others? We’re hiring! .GoFundMe is the world’s most powerful community for good, dedicated to helping people help each other. By uniting individuals and nonprofits in one place,...Show more
Last updated: 21 days ago • Promoted
Data Engineer

Data Engineer

Zoox • Foster City, California, United States
Full-time
The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness.We provide the foundation for strategic decision-making at Zoox.You will develop...Show more
Last updated: 29 days ago • Promoted
Lead Data Engineer

Lead Data Engineer

Nuna • San Francisco, California, United States
Full-time
At Nuna, our mission is to make high-quality healthcare affordable for everyone.We are dedicated to tackling one of our nation’s biggest problems with ingenuity, creativity, and a keen moral compas...Show more
Last updated: 26 days ago • Promoted