Talent.com
Senior Software Engineer - Data Lakehouse Infrastructure
Senior Software Engineer - Data Lakehouse InfrastructureTRM Labs • Augusta, GA, United States
Senior Software Engineer - Data Lakehouse Infrastructure

Senior Software Engineer - Data Lakehouse Infrastructure

TRM Labs • Augusta, GA, United States
1 day ago
Job type
  • Full-time
Job description

Software Engineer

TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business and our profit as a way to move towards our mission sustainably and at scale.

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.

The impact you'll have here :

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
  • Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
  • Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
  • Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM's products.

What we're looking for :

  • Bachelor's degree (or equivalent) in Computer Science or a related field.
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
  • Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
  • Versatility that spans the entire spectrum of data engineering in one or more of the following areas :
  • In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
  • Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
  • Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
  • Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
  • Proven ability in loading, querying, and transforming extensive datasets
  • About the Team :

  • The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
  • We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
  • We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
  • We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
  • Team members are based in the US across almost all timezones! Our on-call tends to be in EST / PST shift, whatever suits you best.
  • We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours / week in meetings.
  • Learn about TRM Speed in this position :

  • Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling / updating of clusters, etc.
  • Enable tasks to be faster next time and reducing dependency on a single person.
  • Identify ways to compress timelines using 80 / 20 principle. For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
  • Identify first version, a.k.a., skateboards for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  • About TRM's Engineering Levels :

    Engineer : Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

    Senior Engineer : Successfully designs and documents system improvements and features for an OKR / project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

    Staff Engineer : Drives scoping and execution of one or more OKRs / projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

    Life at TRM Labs

    Leadership Principles :

    Our Leadership Principles are foundational element of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

  • Impact-Oriented Trailblazer : We put customers first, driving for speed, focus, and adaptability.
  • Master Craftsperson : We prioritize speed, high standards, and distributed ownership.
  • Inspiring Colleague : We value humility, candor, and a one-team mindset.
  • Build a Career :

    Joining TRM means being part of a mission-driven team comprised of industry leaders. At TRM, you'll experience :

  • Purpose and Mission : Have a real-world impact, from disrupting terrorist networks to returning stolen funds.
  • Inspiring Colleagues : Collaborate with industry leaders and learn something new daily.
  • Personal Growth : We're not just using technology; we're inventing it and taking category-defining products to market.
  • Work Environment :

  • Remote First : Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding. Clear communication is key in our decentralized setup. With tools like Slack, Loom, and voice notes, we document meetings and decisions, promoting transparency and efficiency.
  • Ownership & TRM Speed : Small teams drive big goals at TRM. Every team member has significant ownership and responsibility, fostering an environment of initiative and direct impact. While there's no strict clocking in or out, we expect team members to balance personal schedules and team needs. We move "surprisingly fast" while maintaining a high bar in service of our customers and mission. This can feel both intense and rewarding. Our unique approach to projects emphasizes quick wins, rapid iterations, and constant feedback.
  • Diversity and Inclusion : Diversity at TRM encompasses backgrounds, experiences, and perspectives. Every day is an opportunity to learn from a colleague, whether they're a law enforcement expert or a tech pioneer.
  • Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers.
  • Join Us :

    We're looking for team members who love building from the ground up and want to work hard in a fast-paced and ambitious environment. We are remote-first, with exceptionally talented team members located around the world. If you like solving tough

    Create a job alert for this search

    Senior Software Engineer Infrastructure • Augusta, GA, United States

    Related jobs
    Senior Software Engineer - Infrastructure

    Senior Software Engineer - Infrastructure

    Epirus • Augusta, GA, United States
    Permanent
    Senior Software Engineer - Infrastructure.Epirus is a high-growth technology company dedicated to overcoming the asymmetric challenges inherent to the future of national security.Epirus' flagship p...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, Big DataPalo Alto, CA

    Senior Software Engineer, Big DataPalo Alto, CA

    ZipRecruiter • Augusta, GA, United States
    Full-time
    We offer a hybrid work environment.Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below. To actively connect people to their next ...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior Software Engineer, Release Engineering

    Senior Software Engineer, Release Engineering

    dbt Labs • Augusta, GA, United States
    Full-time
    Senior Software Engineer, Release Engineering.Labs is the pioneer of analytics engineering, helping data teams transform raw data into reliable, actionable insights. Since 2016, we've grown from an ...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer -.NET

    Senior Software Engineer -.NET

    Creative Chaos • Augusta, GA, United States
    Full-time
    A Senior Software Engineer for.Net is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing ...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, Cloud Engineering

    Senior Software Engineer, Cloud Engineering

    StarTree • Augusta, GA, United States
    Full-time
    Senior Software Engineer, Cloud Engineering.At StarTree we're a group of passionate individuals that desire to improve the lives of many by developing tools and technologies that support availabili...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, Backend (Powered by Affirm)

    Senior Software Engineer, Backend (Powered by Affirm)

    Affirm • Augusta, GA, United States
    Full-time
    Senior Software Engineer, Backend.Affirm is reinventing credit to make it more honest and friendly, giving consumers the flexibility to buy now and pay later without any hidden fees or compounding ...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer with Security Clearance

    Senior Software Engineer with Security Clearance

    ClearanceJobs • Augusta, GA, United States
    Full-time
    Summary : ClearanceJobs, on behalf of one of our customers, is currently seeking a full-time Senior Software Engineer to work on-site in Augusta, GA. This position requires active TS / SCI clearance wi...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer Advisory Suite

    Senior Software Engineer Advisory Suite

    Alpaca • Augusta, GA, United States
    Full-time
    Senior Software Engineer Advisory Suite.Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24 / 5 trading, and more...Show more
    Last updated: 2 days ago • Promoted
    Travel Mammography Tech - $1,976 to $2,190 per week in Atlanta, GA

    Travel Mammography Tech - $1,976 to $2,190 per week in Atlanta, GA

    AlliedTravelNetwork • Augusta, Georgia, US
    Full-time
    AlliedTravelNetwork is working with LRS Healthcare to find a qualified Mammography Tech in Atlanta, Georgia, 30342!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits ...Show more
    Last updated: 19 days ago • Promoted
    Software Engineer

    Software Engineer

    The Swift Group • Augusta, GA, United States
    Full-time
    Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training. Founded in 2019, Swift supports Civilian, Defense, and Intelligence Communit...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer - Data Solutions

    Senior Software Engineer - Data Solutions

    Credit Acceptance • Augusta, GA, United States
    Full-time
    Join Credit Acceptance, an award-winning company recognized both locally and nationally for our outstanding workplace culture! We pride ourselves on our dedicated Team Members who drive success as ...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, Core Experiences - Augusta, USA

    Senior Software Engineer, Core Experiences - Augusta, USA

    Speechify • Augusta, GA, United States
    Full-time
    Senior Software Engineer, Core Experiences.Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone.We absorb it all and le...Show more
    Last updated: 2 days ago • Promoted
    Staff / Senior Software Engineer

    Staff / Senior Software Engineer

    Ledgy • Augusta, GA, United States
    Full-time
    At Ledgy, we value the contribution of skilled professionals in our dynamic team.As a Staff / Senior Software Engineer, you will play a critical role in shaping our software solutions and driving inn...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer - Firefox Enterprise

    Senior Software Engineer - Firefox Enterprise

    Mozilla • Augusta, GA, United States
    Full-time
    Senior Software Engineer - Firefox Enterprise.Mozilla Corporation is the non-profit-backed technology company that has shaped the internet for the better over the last 25 years.We make pioneering b...Show more
    Last updated: 23 hours ago • Promoted
    Senior Software Engineer - Generalist Developer

    Senior Software Engineer - Generalist Developer

    Bonterra • Augusta, GA, United States
    Full-time
    Join NGP VAN, the leading technology platform championing democratic and progressive causes.We are dedicated to innovating the technologies our clients use to strengthen democracy.Our tools empower...Show more
    Last updated: 2 days ago • Promoted
    Physician (MD / DO) - Emergency Medicine in North Augusta, SC

    Physician (MD / DO) - Emergency Medicine in North Augusta, SC

    LocumJobsOnline • North Augusta, SC, US
    Full-time +1
    LocumJobsOnline is working with AAS Locum Tenens to find a qualified Emergency Medicine MD in North Augusta, South Carolina, 29841!. Join a dynamic team of 16 emergency medicine physicians and 9 adv...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Site Discovery & Localization

    Senior Software Engineer, Site Discovery & Localization

    Webflow • Augusta, GA, United States
    Full-time +1
    Senior Software Engineer, Site Discovery & Localization.At Webflow, our mission is to bring development superpowers to everyone. As the pioneer of the Website Experience Platform (WXP), we're redefi...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer - Platform Team

    Senior Software Engineer - Platform Team

    Brinqa • Augusta, GA, United States
    Full-time
    Senior Software Engineer - Platform Team.Brinqa is the leading provider of unified cyber risk management and security analytics. Our software empowers companies to make cyber risk decisions across a...Show more
    Last updated: 2 days ago • Promoted