Talent.com
Tech Lead, Data & Inference Engineer
Tech Lead, Data & Inference EngineerCatalyst Labs, LLC • Palo Alto, CA, United States
Tech Lead, Data & Inference Engineer

Tech Lead, Data & Inference Engineer

Catalyst Labs, LLC • Palo Alto, CA, United States
5 days ago
Job type
  • Full-time
Job description

About the job Tech Lead, Data & Inference Engineer

Our Client

A fast moving and venture backed advertising technology startup based in San Francisco. They have raised twelve million dollars in funding and are transforming how business to business marketers reach their ideal customers. Their identity resolution technology blends business and consumer signals to convert static audience lists into high match and cross channel segments without the use of cookies. By transforming first party and third party data into precision targetable audiences across platforms such as Meta, Google and YouTube, they enable marketing teams to reach higher match rates, reduce wasted advertising spend and accelerate pipeline growth. With a strong understanding of how business buyers behave in channels that have traditionally been focused on business to consumer activity, they are redefining how business brands scale demand generation and account based efforts.

About Us

Catalyst Labs is a leading talent agency with a specialized vertical in Applied AI, Machine Learning, and Data Science. We stand out as an agency thats deeply embedded in our clients recruitment operations.

We collaborate directly with Founders, CTOs, and Heads of AI in those themes who are driving the next wave of applied intelligence from model optimization to productized AI workflows. We take pride in facilitating conversations that align with your technical expertise, creative problem-solving mindset, and long-term growth trajectory in the evolving world of intelligent systems.

Location : San Francisco

Work type : Full Time,

Compensation : above market base + bonus + equity

Roles & Responsibilities

  • Lead the design, development and scaling of an end to end data platform from ingestion to insights, ensuring that data is fast, reliable and ready for business use.
  • Build and maintain scalable batch and streaming pipelines, transforming diverse data sources and third party application programming interfaces into trusted and low latency systems.
  • Take full ownership of reliability, cost and service level objectives. This includes achieving ninety nine point nine percent uptime, maintaining minutes level latency and optimizing cost per terabyte. Conduct root cause analysis and provide long lasting solutions.
  • Operate inference pipelines that enhance and enrich data. This includes enrichment, scoring and quality assurance using large language models and retrieval augmented generation. Manage version control, caching and evaluation loops.
  • Work across teams to deliver data as a product through the creation of clear data contracts, ownership models, lifecycle processes and usage based decision making.
  • Guide architectural decisions across the data lake and the entire pipeline stack. Document lineage, trade offs and reversibility while making practical decisions on whether to build internally or buy externally.
  • Scale integration with application programming interfaces and internal services while ensuring data consistency, high data quality and support for both real time and batch oriented use cases.
  • Mentor engineers, review code and raise the overall technical standard across teams. Promote data driven best practices throughout the organization.

Qualifications

  • Bachelors or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, or Mathematics.
  • Excellent written and verbal communication; proactive and collaborative mindset.
  • Comfortable in hybrid or distributed environments with strong ownership and accountability.
  • A founder-level bias for actionable to identify bottlenecks, automate workflows, and iterate rapidly based on measurable outcomes.
  • Demonstrated ability to teach, mentor, and document technical decisions and schemas clearly.
  • Core Experience

  • 6 to 12 years of experience building and scaling production-grade data systems, with deep expertise in data architecture, modeling, and pipeline design.
  • Expert SQL (query optimization on large datasets) and Python skills.
  • Hands-on experience with distributed data technologies (Spark, Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect).
  • Familiarity with dbt, DuckDB, and the modern data stack; experience with IaC, CI / CD, and observability.
  • Exposure to Kubernetes and cloud infrastructure (AWS, GCP, or Azure).
  • Bonus : Strong Node.js skills for faster onboarding and system integration.
  • Previous experience at a high-growth startup (10 to 200 people) or early-stage environment with a strong product mindset.
  • Create a job alert for this search

    Lead Data Engineer • Palo Alto, CA, United States

    Related jobs
    Tech Lead, Data & Inference Engineer

    Tech Lead, Data & Inference Engineer

    Catalyst Labs, LLC • Cupertino, CA, United States
    Full-time
    About the job Tech Lead, Data & Inference Engineer.A fast moving and venture backed advertising technology startup based in San Francisco. They have raised twelve million dollars in funding and are ...Show more
    Last updated: 5 days ago • Promoted
    Tech Lead Software Engineer, Ads CRM Data Application

    Tech Lead Software Engineer, Ads CRM Data Application

    Tik Tok • San Jose, CA, United States
    Full-time
    The CRM Data Application team as a global engineering team sits at the core of TikTok's monetization ecosystem, building data-intensive applications that drive business growth.By integrating large-...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    eTeam • Fremont, CA, United States
    Full-time
    Location : Fremont, CA (Hybrid 3 days a week from office).Min 5 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data ...Show more
    Last updated: 30+ days ago • Promoted
    Deal Data Technology & Analytics, Senior Associate

    Deal Data Technology & Analytics, Senior Associate

    PwC • San Jose, CA, United States
    Full-time
    At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their op...Show more
    Last updated: 17 days ago • Promoted
    Ocean Data Assimilation Postdoctoral Scholar

    Ocean Data Assimilation Postdoctoral Scholar

    University of California - Santa Cruz • Santa Cruz, CA, United States
    Full-time
    Ocean Data Assimilation Postdoctoral Scholar .Commensurate with qualifications and experience.Postdoctoral Scholar-Employee / Postdoctoral Scholar-Fellow / Postdoctoral Scholar-Paid Direct -Fiscal...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Inizio Partners • Fremont, CA, United States
    Full-time
    About the job Lead Data Engineer.Location : Fremont, CA(3 days onsite, 2 days work from home).Candidate should Provide technical expertise in needs identification, data modelling, data movement, tra...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cyber Defense & Data Lake Consultant

    Senior Cyber Defense & Data Lake Consultant

    Deloitte Touche Tohmatsu Ltd • Palo Alto, CA, United States
    Full-time
    A leading professional services firm in California is seeking a Senior Consultant in Cyber Defense & Resilience.The role involves designing cyber data programs and enhancing AI capabilities.Candida...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Argyllinfotech • San Jose, CA, United States
    Full-time
    Quick Apply
    Hello Everyone, No GC, Role : Senior Lead Data Engineer <...Show more
    Last updated: 5 days ago
    Senior GenAI Services Lead - Scalable Inference & APIs

    Senior GenAI Services Lead - Scalable Inference & APIs

    Adobe Inc. • San Jose, CA, United States
    Full-time
    A leading software company in San Jose is looking for a Principal Service Engineer to lead the technical development of generative AI services. You will manage a talented team in building scalable A...Show more
    Last updated: 7 hours ago • Promoted • New!
    GCP Sr. Data Lead

    GCP Sr. Data Lead

    E-Solutions • San Jose, CA, United States
    Full-time
    We are seeking a highly skilled and experienced Data Engineer with a strong background in AI / ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform ...Show more
    Last updated: 5 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Akkodis • Sunnyvale, CA, United States
    Full-time
    This role requires proven experience leading end-to-end data projects and collaborating with business stakeholders and offshore teams. The rate may be negotiable based on experience, education, geog...Show more
    Last updated: 5 days ago • Promoted
    Tech Lead, AI Compute Infrastructure

    Tech Lead, AI Compute Infrastructure

    HeyGen • Palo Alto, CA, United States
    Full-time
    At HeyGen, our mission is to make visual storytelling accessible to all.Over the last decade, visual content has become the preferred method of information creation, consumption, and retention.But ...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Developer

    Lead AI Developer

    Inherent Technologies • Sunnyvale, CA, United States
    Full-time
    Quick Apply
    MsoNoSpacing" style="margin-bottom : 16px"> Lead AI Developer with hands-on expertise in implementing AI workflows using AWS...Show more
    Last updated: 4 days ago
    Lead Data Engineer

    Lead Data Engineer

    CoStar Realty Information, Inc. • Sunnyvale, CA, United States
    Full-time
    NASDAQ : CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group i...Show more
    Last updated: 5 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Artech • Sunnyvale, CA, United States
    Full-time
    Location : Sunnyvale, CA (5x / week onsite).Competitive and commensurate with experience.We are seeking a highly skilled and experienced professional to lead our data engineering efforts.This role re...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Omni Inclusive • Fremont, CA, United States
    Full-time
    Microsoft Azure : Azure Data Factory, Azure Synapse, Azure Databricks, Azure SQL, Event Hub.Design and implementation of enterprise-grade data solutions using Azure and Microsoft Fabric.Design and i...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Adobe • San Jose, CA, United States
    Full-time
    We need a skilled Lead Data Engineer to join our Marketing Operations & Engineering team.This role involves developing and expanding the data infrastructure supporting our B2B marketing analytics f...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer - Financial Data, Compliance & Business Intelligence

    Lead Data Engineer - Financial Data, Compliance & Business Intelligence

    Crowe • San Jose, CA, United States
    Full-time
    Your Journey at Crowe Starts Here : .At Crowe, you can build a meaningful and rewarding career.With real flexibility to balance work with life moments, you're trusted to deliver results and make an i...Show more
    Last updated: 5 days ago • Promoted