Talent.com
Tech Lead, Data & Inference Engineer
Tech Lead, Data & Inference EngineerCatalyst Labs, LLC • Palo Alto, CA, United States
No longer accepting applications
Tech Lead, Data & Inference Engineer

Tech Lead, Data & Inference Engineer

Catalyst Labs, LLC • Palo Alto, CA, United States
12 days ago
Job type
  • Full-time
Job description

About the job Tech Lead, Data & Inference Engineer

Our Client

A fast moving and venture backed advertising technology startup based in San Francisco. They have raised twelve million dollars in funding and are transforming how business to business marketers reach their ideal customers. Their identity resolution technology blends business and consumer signals to convert static audience lists into high match and cross channel segments without the use of cookies. By transforming first party and third party data into precision targetable audiences across platforms such as Meta, Google and YouTube, they enable marketing teams to reach higher match rates, reduce wasted advertising spend and accelerate pipeline growth. With a strong understanding of how business buyers behave in channels that have traditionally been focused on business to consumer activity, they are redefining how business brands scale demand generation and account based efforts.

About Us

Catalyst Labs is a leading talent agency with a specialized vertical in Applied AI, Machine Learning, and Data Science. We stand out as an agency thats deeply embedded in our clients recruitment operations.

We collaborate directly with Founders, CTOs, and Heads of AI in those themes who are driving the next wave of applied intelligence from model optimization to productized AI workflows. We take pride in facilitating conversations that align with your technical expertise, creative problem-solving mindset, and long-term growth trajectory in the evolving world of intelligent systems.

Location : San Francisco

Work type : Full Time,

Compensation : above market base + bonus + equity

Roles & Responsibilities

  • Lead the design, development and scaling of an end to end data platform from ingestion to insights, ensuring that data is fast, reliable and ready for business use.
  • Build and maintain scalable batch and streaming pipelines, transforming diverse data sources and third party application programming interfaces into trusted and low latency systems.
  • Take full ownership of reliability, cost and service level objectives. This includes achieving ninety nine point nine percent uptime, maintaining minutes level latency and optimizing cost per terabyte. Conduct root cause analysis and provide long lasting solutions.
  • Operate inference pipelines that enhance and enrich data. This includes enrichment, scoring and quality assurance using large language models and retrieval augmented generation. Manage version control, caching and evaluation loops.
  • Work across teams to deliver data as a product through the creation of clear data contracts, ownership models, lifecycle processes and usage based decision making.
  • Guide architectural decisions across the data lake and the entire pipeline stack. Document lineage, trade offs and reversibility while making practical decisions on whether to build internally or buy externally.
  • Scale integration with application programming interfaces and internal services while ensuring data consistency, high data quality and support for both real time and batch oriented use cases.
  • Mentor engineers, review code and raise the overall technical standard across teams. Promote data driven best practices throughout the organization.

Qualifications

  • Bachelors or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, or Mathematics.
  • Excellent written and verbal communication; proactive and collaborative mindset.
  • Comfortable in hybrid or distributed environments with strong ownership and accountability.
  • A founder-level bias for actionable to identify bottlenecks, automate workflows, and iterate rapidly based on measurable outcomes.
  • Demonstrated ability to teach, mentor, and document technical decisions and schemas clearly.
  • Core Experience

  • 6 to 12 years of experience building and scaling production-grade data systems, with deep expertise in data architecture, modeling, and pipeline design.
  • Expert SQL (query optimization on large datasets) and Python skills.
  • Hands-on experience with distributed data technologies (Spark, Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect).
  • Familiarity with dbt, DuckDB, and the modern data stack; experience with IaC, CI / CD, and observability.
  • Exposure to Kubernetes and cloud infrastructure (AWS, GCP, or Azure).
  • Bonus : Strong Node.js skills for faster onboarding and system integration.
  • Previous experience at a high-growth startup (10 to 200 people) or early-stage environment with a strong product mindset.
  • Create a job alert for this search

    Lead Data Engineer • Palo Alto, CA, United States

    Related jobs
    Tech Lead Software Engineer, Ads CRM Data Application

    Tech Lead Software Engineer, Ads CRM Data Application

    Tik Tok • San Jose, CA, United States
    Full-time
    The CRM Data Application team as a global engineering team sits at the core of TikTok's monetization ecosystem, building data-intensive applications that drive business growth.By integrating large-...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    eTeam • Fremont, CA, United States
    Full-time
    Location : Fremont, CA (Hybrid 3 days a week from office).Min 5 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data ...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer / Head of R&D

    Lead AI Engineer / Head of R&D

    Thoth AI • Fremont, California, United States
    Full-time
    To engineer the next generation of.AI-Assisted Human Annotation Systems.Our goal is to scale the production of high-quality, personalized, and safety-aligned datasets. Participate in the customer so...Show more
    Last updated: 9 days ago • Promoted
    Lead Machine Learning Engineer, Recommender Systems

    Lead Machine Learning Engineer, Recommender Systems

    HP IQ • Palo Alto, California, United States
    Full-time
    HP IQ is HP’s new AI innovation lab.Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates.We’re asse...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Inizio Partners • Fremont, CA, United States
    Full-time
    About the job Lead Data Engineer.Location : Fremont, CA(3 days onsite, 2 days work from home).Candidate should Provide technical expertise in needs identification, data modelling, data movement, tra...Show more
    Last updated: 30+ days ago • Promoted
    Azure AI Lead Engineer

    Azure AI Lead Engineer

    Tiger Analytics • Hayward, California, United States
    Full-time
    Tiger Analytics is looking for experienced.Gen AI experience to join our fast-growing advanced analytics consulting firm. Our employees bring deep expertise in Machine Learning, Data Science, and AI...Show more
    Last updated: 1 day ago • Promoted
    Senior ML Engineer & Tech Lead — On-Device AI & NLP

    Senior ML Engineer & Tech Lead — On-Device AI & NLP

    Apple Inc. • Cupertino, CA, United States
    Full-time
    A leading technology company in Cupertino is seeking a Senior Machine Learning Engineer to enhance Siri's capabilities.The ideal candidate has a Master's or PhD and 10+ years in machine learning sy...Show more
    Last updated: 7 days ago • Promoted
    Enterprise Data and Analytics Manager

    Enterprise Data and Analytics Manager

    Elastic • Mountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer, Tech Lead

    Machine Learning Engineer, Tech Lead

    Creatify Lab • Mountain View, California, United States
    Full-time
    Creatify is building the world’s first end-to-end AI advertising agent—a platform that automates the entire video ad lifecycle, from scripting and avatar-led generation to testing, optimization, an...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Sanas • Palo Alto, CA, United States
    Full-time
    Founded by a team of Stanford researchers and entrepreneurs with deep industry experience, Sanas has developed the world’s first real-time speech transformation platform capable of accent translati...Show more
    Last updated: 30+ days ago • Promoted
    Pharmacy Tech / Lead Data Tech

    Pharmacy Tech / Lead Data Tech

    BrightSpring Health Services • Union City, CA, United States
    Full-time
    Required : Experience in pharmacy data entry and / or adjudication; experience in LTC setting.Desired : Prior supervisory experience. Required : Knowledge of Medicaid claims regulations and processes.B...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer / Head of R&D (Hayward)

    Lead AI Engineer / Head of R&D (Hayward)

    Thoth AI • Hayward, CA, United States
    Full-time
    To engineer the next generation of.AI-Assisted Human Annotation Systems.Our goal is to scale the production of high-quality, personalized, and safety-aligned datasets. Participate in the customer so...Show more
    Last updated: 1 day ago • Promoted
    Lead Generative AI Engineer

    Lead Generative AI Engineer

    Madison-Davis, LLC • Fremont, CA, United States
    Full-time
    We’re supporting a major global financial technology organization that’s making significant investments in AI innovation. They’re scaling their engineering teams across North America to drive develo...Show more
    Last updated: 1 day ago • Promoted
    Head of Data and AI Platforms

    Head of Data and AI Platforms

    Confidential • San Jose, CA, United States
    Full-time
    Premier technology organization.Information Technology and Services.The Company is in search of a Head of Product for Data and AI Platforms. This senior leadership role is pivotal in driving the str...Show more
    Last updated: 1 day ago • Promoted
    Role : Practice Head - Data Engineering

    Role : Practice Head - Data Engineering

    Sparktek • San Jose, CA, United States
    Full-time
    Requirement Summary / Job Brief.The Data Engineering Competency Lead is a senior leadership role responsible for driving excellence across the data engineering discipline.This individual will lead ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Mentor Talent Acquisition • Hayward, CA, United States
    Full-time
    We’re looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You...Show more
    Last updated: 22 hours ago • Promoted • New!
    Principal Data Engineer I - QuantumBlack

    Principal Data Engineer I - QuantumBlack

    McKinsey & Company • Palo Alto, CA, United States
    Full-time
    As a Principal Data Engineer I, you will lead technical teams, architect data platforms, and build scalable pipelines while mentoring colleagues and collaborating with clients at all levels.You’ll ...Show more
    Last updated: 19 days ago • Promoted
    Senior ML Data Engineer

    Senior ML Data Engineer

    Midjourney • San Jose, CA, United States
    Full-time
    We're the data team behind Midjourney's image generation models.We handle the dataset side : processing, filtering, scoring, captioning, and all the distributed compute that makes high-quality train...Show more
    Last updated: 1 day ago • Promoted