Talent.com
Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch)

Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch)

Recorded FutureBoston, MA, United States
4 days ago
Job type
  • Full-time
Job description

Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch)

Get AI-powered advice on this job and more exclusive features.

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

We’re looking for a Principal Data Engineer to help design, build, and scale the systems that power our Attack Surface Intelligence module. You’ll be taking ownership of critical data pipelines responsible for the ingestion and distribution of critical intelligence signals, both internally and directly to customers via the product. The Attack Surface Intelligence Data Engineering team is responsible for two key datasets : our holistic global internet inventory and the technical artifacts of our customers’ attack surface.

This role reports directly to the Engineering Owner for Attack Surface Intelligence Data and is ideal for someone who enjoys writing clean, maintainable code and thrives in distributed systems environments. You'll work closely with product management and other engineering teams to drive technical strategy and ensure our systems are reliable, performant, and insightful.

What You’ll Do

  • Lead the design and implementation of backend services and APIs in Python
  • Architect and evolve microservice‑based systems for scalability and resilience
  • Collaborate with product managers and cross‑functional partners to align technical work with business goals
  • Proactively identify and resolve data and integration issues by diving deep into our pipelines and systems

Drive observability and operational excellence across services

  • Mentor other engineers through code reviews and design discussions
  • Coordinate with internal stakeholders outside of the Attack Surface Intelligence team to inform solutions for data transfers around the greater Recorded Future ecosystem
  • Contribute to technical roadmaps and long‑term platform strategy
  • What You’ll Bring

  • Proven experience designing & maintaining scalable APIs and microservices in Python leveraging tools like Kafka, ClickHouse, and Elasticsearch.
  • Deep understanding of distributed systems and service‑oriented architecture
  • Comfortable exploring data to debug, validate assumptions, and drive better system behavior
  • Excellent communication skills and the ability to work across teams to align on goals and priorities
  • Track record of operating independently and driving complex projects, especially with a geographically distributed team
  • Experience with informing and driving coding and design standards within a team
  • The base salary range for this full‑time position is $152,000-$228,000. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job‑related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

    Why should you join Recorded Future?

    Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

    Accessibility and Inclusion

    We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day. If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e‑mail with your request to our recruiting team at careers@recordedfuture.com.

    Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.

    Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

    Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

    Notice to Agency and Search Firm Representatives

    Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes. Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

    Interview Process

    Our interview process for all final‑round candidates requires a mandatory in‑person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Data Engineer • Boston, MA, United States

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    SunoBoston, Massachusetts, United States
    Full-time
    Suno is a music company for the next generation of creators.Its AI-powered platform makes it easy for anyone to create original music. Built by musicians and engineers, Suno empowers users to turn i...Show moreLast updated: 30+ days ago
    • Promoted
    Lead AI Engineer (GenAI Platform Services, Python)

    Lead AI Engineer (GenAI Platform Services, Python)

    Capital OneCambridge, MA, US
    Full-time +1
    Lead AI Engineer (GenAI Platform Services, Python).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead AI Engineer (Gen AI Platform Services, Python, Kubernetes)

    Lead AI Engineer (Gen AI Platform Services, Python, Kubernetes)

    Capital OneCambridge, MA, US
    Full-time +1
    Lead AI Engineer (Gen AI Platform Services, Python, Kubernetes).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an ind...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Platform Engineer

    Principal Data Platform Engineer

    Southern New Hampshire UniversityBoston, MA, United States
    Full-time
    Southern New Hampshire University is a team of innovators.Individuals who believe in progress with purpose.Since 1932, our people-centered strategy has defined us - and helped us grow a team that n...Show moreLast updated: 3 days ago
    • Promoted
    Principal Data Engineer, Attack Surface Intelligence

    Principal Data Engineer, Attack Surface Intelligence

    Recorded FutureBoston, MA, United States
    Full-time
    With 1,000 intelligence professionals, over $300M in sales, and serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!.Lead the desig...Show moreLast updated: 30+ days ago
    • Promoted
    Lead AI Engineer (AI Foundations, Python)

    Lead AI Engineer (AI Foundations, Python)

    Capital OneCambridge, MA, US
    Full-time +1
    Lead AI Engineer (AI Foundations, Python).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer, Data and Intelligence Product

    Senior Data Engineer, Data and Intelligence Product

    AcuityMDBoston, MA, United States
    Full-time
    Senior Data Engineer, Data and Intelligence Product.Join to apply for the Senior Data Engineer, Data and Intelligence Product role at AcuityMD. AcuityMD is a software and data platform that accelera...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer – Business Intelligence

    Senior Data Engineer – Business Intelligence

    CEI GroupBurlington, MA, US
    Full-time
    Senior Data Engineer – Business Intelligence About the Role We’re seeking a Senior Data Engineer to help design, build, and evolve our Enterprise Data Operating Architecture, the backbone of busine...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Capital OneCambridge, MA, US
    Full-time +1
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...Show moreLast updated: 28 days ago
    • Promoted
    Principal Data Engineer, Business Intelligence

    Principal Data Engineer, Business Intelligence

    CEI GroupBurlington, MA, US
    Full-time
    Principal Data Engineer, Business Intelligence About the Role We’re seeking a Principal Data Engineer to lead the architecture and evolution of our enterprise Business Intelligence data platform — ...Show moreLast updated: 23 days ago
    • Promoted
    Principal Reporting Engineer, Business Intelligence

    Principal Reporting Engineer, Business Intelligence

    CEI GroupBurlington, MA, US
    Full-time
    Principal Reporting Engineer, Business Intelligence About the Role As our Principal Reporting Engineer, you’ll shape how the enterprise sees itself. You’ll lead the design and delivery of trusted, e...Show moreLast updated: 23 days ago
    • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    Autodesk, Inc.Boston, MA, United States
    Full-time
    Work with our smart and dedicated teams • Experiment, learn, and grow • Use the latest cloud technologies • Deliver solutions that millions of customers will use • Mentor teammates • Make key decisions •...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    AutodeskMA, United States
    Full-time
    Senior Principal Software Engineer, AEC Data.Senior Principal Software Engineer, AEC Data.Are you a self-starter and technical catalyst with a proven track record of quickly tackling complex projec...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Brattle GroupBoston, Massachusetts, United States
    Full-time
    The Brattle Group, a privately held, global economics consulting firm, is looking for a.The Senior Data Engineer plays a pivotal role in shaping our data engineering practices, providing expert tec...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Soteria Reinsurance Ltd.Boston, MA, United States
    Full-time
    Job Description : Position Description : Builds solutions using Python.Leverages Snowflake and Amazon S3 as integral components of Cloud data storage to create efficient, scalable, and secure data pipe...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Generative AI)

    Lead Data Engineer (Generative AI)

    Capital OneBoston, MA, US
    Full-time +1
    Lead Data Engineer (Generative AI).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll...Show moreLast updated: 20 days ago
    • Promoted
    Principal Software Engineer

    Principal Software Engineer

    ZoominfoWaltham, Massachusetts, United States
    Full-time
    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results.We value your take charge, take initiative, get stuff done attitude and will help ...Show moreLast updated: 30+ days ago
    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Akraya IncNorth Reading, Massachusetts, United States
    Full-time
    Quick Apply
    Primary Skills : SQL (Expert), Data Modelling (Proficient), ETL (Expert), Python (Intermediate), AWS (Basic).Duration : 6 Months with possible extension. Location : North Reading, MA (Local candidates ...Show moreLast updated: 30+ days ago