Talent.com
Senior Software Engineer - Database Engine Internals
Senior Software Engineer - Database Engine InternalsDatabricks • San Francisco, California
Senior Software Engineer - Database Engine Internals

Senior Software Engineer - Database Engine Internals

Databricks • San Francisco, California
30+ days ago
Job type
  • Full-time
Job description

P-97

Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (), open platforms that unify data warehousing and advanced analytics. The new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support.

A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Spark™ to support diverse workloads ranging from ETL to data science.

As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art:

  • Query compilation and optimization
  • Distributed query execution and scheduling
  • Vectorized execution engine
  • Data security
  • Resource management
  • Transaction coordination
  • Efficient storage structures (encodings, indexes)
  • Automatic physical data optimization

What we look for:

  • A passion for database systems, storage systems, distributed systems, language design, or performance optimization
  • Experience working towards a multi-year vision with incremental deliverables
  • Motivated by delivering customer value and impact
  • 5+ years of experience working in a related system (preferred)
  • Optional: PhD in databases or distributed systems

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page .

Local Pay Range$166,000—$225,000 USD
Create a job alert for this search

Senior Software Engineer - Database Engine Internals • San Francisco, California

Similar jobs

Staff Software Engineer, Database Infrastructure

JoinhorizonSan Francisco, California, United States
Full-time

Staff Software Engineer, Database Infrastructure.At Gusto, we’re on a mission to grow the small business economy.We handle the hard stuff—like payroll, health insurance, 401(k)s, and HR—so owners c...Show more

 • Promoted • New!

Senior Software Engineer (Forward Deployed)

Invisible TechnologiesSan Francisco, CA, United States
Full-time

Senior Software Engineer, Forward Deployed.Invisible Technologies makes AI work.Our end-to-end AI platform structures messy data, automates digital workflows, deploys agentic solutions, measures ou...Show more

 • Promoted

Senior Solutions Engineer

LanceDBSan Francisco, CA, United States
Full-time

LanceDB is a developer-friendly, open-source data lake for multimodal AI.From hyper‑scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of ...Show more

 • Promoted

Senior Software Engineer

OneSchemaSan Francisco, CA, United States
Full-time

OneSchema is an equal opportunity employer.We encourage applicants from every background and life experience.We celebrate diversity and do not discriminate based on race, religion, color, national ...Show more

 • Promoted

Senior Software Engineer

ComulateSan Francisco, CA, United States
Full-time

Get AI-powered advice on this job and more exclusive features.This range is provided by Comulate.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more...Show more

 • Promoted

Senior Software Engineer, Portal

Hayden AI Technologies, Inc.San Francisco, CA, United States
Full-time

At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real-world challenges.From bus lane and bus stop...Show more

 • Promoted

Senior Software Engineer – Managed Kubernetes & Cloud Infra

Crusoe Energy Systems LLCSan Francisco, CA, United States
Full-time

A leading technology firm in California is seeking a Senior Software Engineer to drive innovation in cloud software solutions.This role involves designing scalable systems, collaborating on develop...Show more

 • Promoted

Senior Software Engineer - Cloud Team 747

TM2 Group, LLCSan Francisco, CA, United States
Full-time

Be among the first 25 applicants.This range is provided by TM2 Group, LLC.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Protegrity, we lead...Show more

 • Promoted

Software Engineer, Database Systems

OpenAISan Francisco, California, United States
Full-time

Software Engineer, Database Systems.Software Engineer, Database Systems.The Database Systems team specializes in high-performance distributed databases.Our team built Rockset, the real-time search,...Show more

 • Promoted • New!

Senior Software Engineer, Platform

ReductoSan Francisco, CA, United States
Full-time

Senior Software Engineer, Platform.Reducto helps AI teams ingest real world enterprise data with state of the art accuracy.The vast majority of enterprise data — from financial statements to health...Show more

 • Promoted

Senior Backend Engineer

FalSan Francisco, CA, United States
Full-time

This role is ideal for engineers who thrive on complex distributed systems and have deep experience with backend APIs, relational databases, and event-driven architectures.You’ll build high-perform...Show more

 • Promoted

Senior Backend Software Engineer, Observability & Evals Platform (LangSmith)

LangChainSan Francisco, CA, United States
Full-time

At LangChain, our mission is to make intelligent agents ubiquitous.We provide the agent engineering platform and open source frameworks developers need to ship reliable agents fast.Our open source ...Show more

 • Promoted

Senior Backend Software Engineer - Space Platform

Astranis Space TechnologiesSan Francisco, CA, United States
Full-time

A leading space technology firm in San Francisco is seeking a Software Engineer to design and build mission-critical services that control satellites and monitor telemetry.The ideal candidate has o...Show more

 • Promoted

Senior Software Engineer

SynackSan Mateo, CA, United States
Full-time

Synack's Penetration Testing as a Service platform manages customers' attack surfaces by discovering new assets, pentesting for critical vulnerabilities and gaining visibility into the root causes ...Show more

 • Promoted

Senior Software Engineer – Backend

VizcomSan Francisco, CA, United States
Full-time

Our mission is to reshape design by streamlining the path from concept to creation, bringing more impactful ideas into the physical world.We’re well-funded (Series B $51m to date), growing double-d...Show more

 • Promoted

Senior Software Engineer

Alluxio, Inc.Foster City, CA, United States
Full-time

Alluxio powers the data layer for modern AI and analytics.Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally, Alluxio’s data or...Show more

 • Promoted

Senior Software Engineer - Backend

FurtherAI IncSan Francisco, CA, United States
Full-time

This role is based out of our San Francisco HQ and is not eligible for full-time remote work.Compensation: The annual salary range for this position is $150,000 - $250,000 based on level in additio...Show more

 • Promoted

Senior Backend Software Engineer (New York City, Los Angeles, or San Francisco)

TenOneTenSan Francisco, CA, United States
Full-time

As a Senior Backend Software Engineer at Regard, you’ll play a leading role in building our products.You’ll be responsible for designing and developing critical backend services and driving them en...Show more