A company is looking for a Senior Open Source Engineer to expand its reach within the data infrastructure ecosystem.
Key Responsibilities
Drive open-source community efforts to integrate the Lance format with various data infrastructure systems
Design and maintain efficient distributed Lance dataset operations
Build efficient indices to enable predicate pushdown and accelerate queries in Spark, Ray, or Trino
Required Qualifications
10+ years of experience building high-performance databases or large-scale data services
Deep understanding of open-source Big Data or AI training systems
Strong experience with high-performance computing in Java or Scala
Experience with Rust or willingness to learn it
Proven ability to work independently and collaborate with a high-caliber team
Senior Engineer • Santa Clara, California, United States