Talent.com
Senior Data Platform Engineer
Senior Data Platform EngineerAlpaca • New York, NY, US
Senior Data Platform Engineer

Senior Data Platform Engineer

Alpaca • New York, NY, US
2 days ago
Job type
  • Full-time
Job description

Job Description

Job Description

Who We Are :

Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24 / 5 trading, and more. Our recent Series C funding round brought our total investment to over $170 million, fueling our ambitious vision.

Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 6 million brokerage accounts.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet . We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.

Alpaca is proudly backed by top-tier global investors, including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Unbound, SBI Group, Derayah Financial, Elefund, and Y Combinator.

Our Team Members :

We're a dynamic team of 230+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!

We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

Your Role :

We are seeking a Senior Data Engineer to design and develop the data management layer for our platform to ensure its scalability as we expand to larger customers and new jurisdictions. At Alpaca, data engineering encompasses financial transactions, customer data, API logs, system metrics, augmented data, and third-party systems that impact decision-making for both internal and external users. We process hundreds of millions of events daily, with this number growing as we onboard new customers.

We prioritize open-source solutions in our data management approach, leveraging a Google Cloud Platform (GCP) foundation for our data infrastructure. This includes batch / stream ingestion, transformation, and consumption layers for BI, internal use, and external third-party sinks. Additionally, we oversee data experimentation, cataloging, and monitoring and alerting systems.

Our team is 100% distributed and remote.

Things You Get To Do :

  • Design and oversee key forward and reverse ETL patterns to deliver data to relevant stakeholders.
  • Develop scalable patterns in the transformation layer to ensure repeatable integrations with BI tools across various business verticals.
  • Expand and maintain the constantly evolving elements of the Alpaca Data Lakehouse architecture.
  • Collaborate closely with sales, marketing, product, and operations teams to address key data flow needs.
  • Operate the system and manage production issues in a timely manner.

Who You Are (Must-Haves) :

  • 7+ years of experience in data engineering, including 2+ years of building scalable, low-latency data platforms capable of handling >
  • 100M events / day.

  • Proficiency in at least one programming language, with strong working knowledge of Python and SQL.
  • Experience with cloud-native technologies like Docker, Kubernetes, and Helm.
  • Strong hands-on experience with relational database systems.
  • Experience in building scalable transformation layers, preferably through formalized SQL models (e.g., dbt).
  • Ability to work in a fast-paced environment and adapt solutions to changing business needs.
  • Experience with ETL technologies like Airflow and Airbyte.
  • Production experience with streaming systems like Kafka.
  • Exposure to infrastructure, DevOps, and Infrastructure as Code (IaaC).
  • Deep knowledge of distributed systems, storage, transactions, and query processing.
  • How We Take Care of You :

  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup : One-time USD $500
  • Monthly Stipend : USD $150 per month via a Brex Card
  • Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

    Recruitment Privacy Policy

    Create a job alert for this search

    Senior Engineer Data • New York, NY, US

    Related jobs
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    Relativity • Newark, NJ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Newark, New Jersey, United States
    Full-time
    A company is looking for a Cloud Data Engineer to join the Data Office Team in modernizing enterprise analytics.Key Responsibilities Design and develop data pipelines and ELT processes to integra...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Bronx, New York, United States
    Full-time
    A company is looking for a Senior Data Engineer to architect and manage data solutions for improved healthcare delivery.Key Responsibilities : Design, build, and maintain data pipelines for proces...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer

    Platform Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Platform Engineer to design, build, and maintain their platform while addressing insider risk challenges. Key Responsibilities : Develop and optimize microservices for sp...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Principal Data Engineer to lead data architecture and platform initiatives.Key Responsibilities Define and implement end-to-end data architecture and establish standard...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    Full-time
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Fabric • , New York, United States,
    Full-time
    Quick Apply
    About Fabric HealthAt Fabric Health, we're not just building technology; we're fixing healthcare's capacity problem.Our mission is to power healthcare to move faster, work smarter, and deliver bett...Show more
    Last updated: 17 days ago
    Senior Data Partner

    Senior Data Partner

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Senior Data Partner who will play a crucial role in enhancing the data culture and assisting business users in maximizing the value of data. Key Responsibilities : Develo...Show more
    Last updated: 1 day ago • Promoted
    Senior Platform Engineer

    Senior Platform Engineer

    VirtualVocations • Astoria, New York, United States
    Full-time
    A company is looking for a Senior Platform Engineer.Key Responsibilities Leading by example and taking ownership for the delivery of complex features Designing scalable systems and collaborating...Show more
    Last updated: 30+ days ago • Promoted
    Lead Platform Engineer

    Lead Platform Engineer

    VirtualVocations • Flushing, New York, United States
    Full-time
    A company is looking for a Lead DevOps / Platform Engineer to design, build, and evolve its core AI platform infrastructure. Key Responsibilities Design and maintain core platform services and int...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    SynapOne • Bronx, NY, United States
    Full-time
    Job Title : Data Engineering Contractor.Join our dynamic team of talented engineers with a proven track record in constructing data. We are on a mission to fuel Unite Us' ongoing expansion and.This p...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Platform Engineer

    Lead Data Platform Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Lead Data Platform Engineer to architect and build scalable distributed data systems for cloud-based video surveillance and IoT control systems.Key Responsibilities Col...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data and AI Engineer

    Senior Data and AI Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Senior Engineer specializing in Data and AI to transform business operations through advanced AI applications. Key Responsibilities Lead the design, development, and dep...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    The Computer Merchant, LTD. • Newark, New Jersey, US
    Permanent
    JOB TITLE : DATA ENGINEER JOB LOCATION : NEWARK, NJ (HYBRID) WAGE RANGE.Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below.PER HOUR ...Show more
    Last updated: 1 day ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for an AWS Data Engineer to support cloud migration and optimize data queries.Key Responsibilities Review and rewrite existing SQL / Power BI queries for Amazon Redshift Optim...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    Relativity • Newark, NJ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Jamaica, New York, United States
    Full-time
    A company is looking for a Senior Data Engineer to oversee data integration and migration, develop data warehouses, and mentor junior engineers. Key Responsibilities Developing solutions to improv...Show more
    Last updated: 30+ days ago • Promoted
    Data Solutions Engineer

    Data Solutions Engineer

    VirtualVocations • Yonkers, New York, United States
    Full-time
    A company is looking for a Data Solutions Engineer to support strategic data initiatives by designing and developing data pipelines and models. Key Responsibilities Architect and build new data pi...Show more
    Last updated: 30+ days ago • Promoted