Talent.com
Lead Data Platform Engineer
Lead Data Platform EngineerAlpaca • New York, NY, US
Lead Data Platform Engineer

Lead Data Platform Engineer

Alpaca • New York, NY, US
Hace 3 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Job Description

Job Description

Who We Are :

Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24 / 5 trading, and more. Our recent Series C funding round brought our total investment to over $170 million, fueling our ambitious vision.

Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 6 million brokerage accounts.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet . We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.

Alpaca is proudly backed by top-tier global investors, including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Unbound, SBI Group, Derayah Financial, Elefund, and Y Combinator.

Our Team Members :

We're a dynamic team of 230+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!

We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

Your Role :

We are seeking a Lead Data Engineer to design and develop the data management layer for our platform to ensure its scalability as we expand to larger customers and new jurisdictions. At Alpaca, data engineering encompasses financial transactions, customer data, API logs, system metrics, augmented data, and third-party systems that impact decision-making for both internal and external users. We process hundreds of millions of events daily, with this number growing as we onboard new customers.

We prioritize open-source solutions in our data management approach, leveraging a Google Cloud Platform (GCP) foundation for our data infrastructure. This includes batch / stream ingestion, transformation, and consumption layers for BI, internal use, and external third-party sinks. Additionally, we oversee data experimentation, cataloging, and monitoring and alerting systems.

Our team is 100% distributed and remote.

Things You Get To Do :

  • Design and oversee key forward and reverse ETL patterns to deliver data to relevant stakeholders.
  • Develop scalable patterns in the transformation layer to ensure repeatable integrations with BI tools across various business verticals.
  • Expand and maintain the constantly evolving elements of the Alpaca Data Lakehouse architecture.
  • Collaborate closely with sales, marketing, product, and operations teams to address key data flow needs.
  • Operate the system and manage production issues in a timely manner.

Who You Are (Must-Haves) :

  • 7+ years of experience in data engineering, including 2+ years of building scalable, low-latency data platforms capable of handling >
  • 100M events / day.

  • Proficiency in at least one programming language, with strong working knowledge of Python and SQL.
  • Experience with cloud-native technologies like Docker, Kubernetes, and Helm.
  • Strong hands-on experience with relational database systems.
  • Experience in building scalable transformation layers, preferably through formalized SQL models (e.g., dbt).
  • Ability to work in a fast-paced environment and adapt solutions to changing business needs.
  • Experience with ETL technologies like Airflow and Airbyte.
  • Production experience with streaming systems like Kafka.
  • Exposure to infrastructure, DevOps, and Infrastructure as Code (IaaC).
  • Deep knowledge of distributed systems, storage, transactions, and query processing.
  • How We Take Care of You :

  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup : One-time USD $500
  • Monthly Stipend : USD $150 per month via a Brex Card
  • Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

    Recruitment Privacy Policy

    Crear una alerta de empleo para esta búsqueda

    Data Platform Engineer • New York, NY, US

    Ofertas relacionadas
    Senior Software Engineer (Data Platform)

    Senior Software Engineer (Data Platform)

    Rokt • New York, NY, US
    A tiempo completo
    We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most. Rokt’s AI Brain and ecommerce Network powers...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data and Analytics Engineer

    Data and Analytics Engineer

    Resonance • New York, NY, US
    A tiempo completo
    Quick Apply
    Resonance is transforming the fashion industry by building a more sustainable and valuable ecosystem for designers, brands, manufacturers, consumers, and the planet. Our AI-powered operating system,...Mostrar más
    Última actualización: hace más de 30 días
    Shift Lead

    Shift Lead

    New Jersey Staffing • Hazlet, NJ, US
    A tiempo completo
    Opens and closes the store in the absence of store management, including all required systems start-ups, required cash handling, and ensuring the floor and stock room are ready for the business day...Mostrar más
    Última actualización: hace 1 día • Oferta promocionada
    People Data, Reporting & Analytics Manager

    People Data, Reporting & Analytics Manager

    Legend Biotech • Somerset, NJ, US
    A tiempo completo
    People Data, Reporting & Analytics Manager.Legend Biotech is a global biotechnology company dedicated to treating, and one day curing, life-threatening diseases. Headquartered in Somerset, New Jerse...Mostrar más
    Última actualización: hace 12 días • Oferta promocionada
    Platform Engineer

    Platform Engineer

    Vortexa • New York, NY, US
    A tiempo completo
    Vortexa was founded to solve the immense information gap that exists in the energy industry.By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa cr...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Platform Engineer

    Platform Engineer

    Five Rivers IT, Inc. • Fair Lawn, NJ, US
    A tiempo completo
    Five Rivers IT is a rapidly growing Managed IT support firm headquartered in the Northern New Jersey, serving clients both locally and beyond. We are dedicated to delivering valued leadership and co...Mostrar más
    Última actualización: hace 6 horas • Oferta promocionada • Nueva oferta
    Data Engineer

    Data Engineer

    SynapOne • Bronx, NY, United States
    A tiempo completo
    Job Title : Data Engineering Contractor.Join our dynamic team of talented engineers with a proven track record in constructing data. We are on a mission to fuel Unite Us' ongoing expansion and.This p...Mostrar más
    Última actualización: hace 16 días • Oferta promocionada
    Data Platform Engineer (USA)

    Data Platform Engineer (USA)

    Trexquant Investment • Stamford, CT, US
    A tiempo completo
    Quick Apply
    Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading ope...Mostrar más
    Última actualización: hace más de 30 días
    Lead Data Engineer / Data Architect

    Lead Data Engineer / Data Architect

    Sumeru Solutions • New York, NY, United States
    A tiempo completo
    Quick Apply
    Lead Data Engineer / Data Architect New York City, NY; (Onsite 5 days / week) Tech skill set< / ...Mostrar más
    Última actualización: hace 3 días
    Platform Engineer

    Platform Engineer

    PermitFlow • New York, NY, US
    A tiempo completo
    PermitFlow is building AI agents for the $1.We’re creating the leading pre-construction platform, starting with the $12B permitting market. Our platform automates the slow, manual permitting p...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Lead Data Engineer - New York City, NY(Hybrid)

    Lead Data Engineer - New York City, NY(Hybrid)

    Lorven technologies • New York City, NY, United States
    A tiempo completo
    Quick Apply
    Lead Data Engineer Position : Contract Location : New York City, NY(Hybrid) ...Mostrar más
    Última actualización: hace 20 horas • Nueva oferta
    Senior Delivery Lead for AI and Data Solutions

    Senior Delivery Lead for AI and Data Solutions

    IBM • Armonk, NY, United States
    A tiempo completo
    Senior Delivery Lead for AI and Data Solutions, IBM Corporation, Armonk, NY and various unanticipated client sites throughout the US (Up to 100% telecommuting permitted) : Maintain deep expertise an...Mostrar más
    Última actualización: hace 6 días • Oferta promocionada
    Platform Engineer

    Platform Engineer

    Virco Talent • New York, New York, United States
    A tiempo completo
    Quick Apply
    Visa sponsorship not available (U.You will work at the intersection of.AI, infrastructure, and enterprise systems.AI teams to deliver cutting-edge AI-native applications. This position offers an opp...Mostrar más
    Última actualización: hace 13 días
    Read allabout it

    Read allabout it

    Staples • Oakhurst, NJ, US
    A tiempo completo
    Focus on the core content of the job post, removing any extra metadata, navigation mentions, and redundant headers.Keep the content beautiful and high signal to noise ratio.Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Databricks & Azure Data Platform Principal Engineer

    Databricks & Azure Data Platform Principal Engineer

    Axiom Software Solutions Limited • Jersey City, NJ, US
    A tiempo completo
    Quick Apply
    A senior technical expert responsible for designing, building, and optimizing data solutions using Databricks and Azure Data technologies. This principal engineer oversees the architecture, integrat...Mostrar más
    Última actualización: hace más de 30 días
    Lead Data Engineer

    Lead Data Engineer

    Interon IT Solutions • NY, United States
    A tiempo completo
    Quick Apply
    Our Client is seeking a Lead Data Engineer with SQL, Python and Capital banking to join our team in New York City, NY (Need Onsite day 1, hybrid 3 days from office).Our challenge ...Mostrar más
    Última actualización: hace 1 día
    Sr. Manager, Digital & Data Analytics

    Sr. Manager, Digital & Data Analytics

    J&J Family of Companies • New Brunswick, NJ, US
    A tiempo completo
    Manager, Digital & Data Analytics.Johnson and Johnson is recruiting for a Sr.Manager, Digital & Data Analytics, located in either Raritan, NJ or New Brunswick, NJ. Fueled by innovation at the inters...Mostrar más
    Última actualización: hace 1 día • Oferta promocionada
    Blue Yonder WMS Architect - Manager (00065327081)

    Blue Yonder WMS Architect - Manager (00065327081)

    Cognizant • Mountainside, NJ, United States
    A tiempo completo
    As a Blue Yonder (BY) Technology Architect you will make an impact by providing technical expertise and ensuring quality. You will be a valued member of the Enterprise Platform Services | Supply Cha...Mostrar más
    Última actualización: hace 2 días • Oferta promocionada