Talent.com
Principal Data Engineer
Principal Data EngineerRecorded Future • Boston, MA, United States
Principal Data Engineer

Principal Data Engineer

Recorded Future • Boston, MA, United States
30+ days ago
Job type
  • Full-time
Job description

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world's most advanced, and largest, intelligence company!

We are looking for a Data Engineer to improve the Security Intelligence Graph. As a Data Engineer, you will build production-grade pipelines to drive data convergence from various sources within the graph, ensure that Indicators of Compromise (IOCs) are properly attributed, and improve the quality of the graph at scale.

What You'll Do :

  • Work with the Graph Quality team to align, analyze, and ingest asset maps into the Security Intelligence Graph
  • Develop, productize, monitor, and maintain data pipelines to analyze and ingest data at scale
  • Lead a team of Data Engineers by providing guidance on projects and direction of best practices
  • Build tools and APIs to facilitate access to data and analytics developed from the intelligence graph
  • Analyze and explain patterns in data to drive business‑critical decisions
  • Create technical project plans and drive the successful execution of projects, with input from our Product team and other developers on the team
  • Collaborate with Data Scientists, Data Engineers, and business leaders to develop and refine technical solutions
  • Onboard and guide junior members of the team
  • Assist in setting team goals, planning sprints, and leading Agile scrum meetings

What You'll Bring :

  • 6+ years of Python programming
  • 2+ years of experience with cloud computing tools, e.g. from AWS, Azure, or Google Cloud
  • 1+ years of experience leading and / or mentoring other team members
  • Experience writing scalable, production‑grade applications and ETL / ELT pipelines
  • Efficient & accurate problem solving skills, including the ability to debug both software and data
  • Proven ability to analyze data and apply statistical techniques to draw accurate, impactful conclusions
  • Proven success in delivering projects from design and implementation to release
  • Excellent attention to detail & ability to work independently while delivering high‑quality results
  • Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
  • Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
  • Preferred Qualifications :

  • Familiarity with both batch and streaming pipelines
  • Familiarity with any of the following : message buses (e.g. Kafka, RabbitMQ), NoSQL databases (e.g. MongoDB, AWS Neptune, Neo4j), ElasticSearch
  • Bachelor's / Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
  • Exposure to ML approaches, including experience productizing ML models
  • Experience with developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
  • Leadership experience, with a track record of presenting information to stakeholders with varying levels of technical expertise
  • The base salary range for this full‑time position is $152,000-$228,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job‑related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

    Why should you join Recorded Future?

    Recorded Future employees (or "Futurists"), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6‑star user rating on G2 and more than 50% of Fortune 100 companies as customers.

    Want more info?

    Blog & Podcast : Learn everything you want to know (and maybe some things you'd rather not know) about the world of cyber threat intelligence

    , Instagram & Twitter : What's happening at Recorded Future

    The Record : The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field

    Timeline : History of Recorded Future

    Recognition : Check out our awards and announcements

    We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.

    If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at careers@recordedfuture.com

    Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.

    Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

    Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

    Notice to Agency and Search Firm Representatives : Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

    Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

    Note : Our interview process for all final‑round candidates requires a mandatory in‑person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Data Engineer • Boston, MA, United States

    Related jobs
    Principal Solutions Engineer

    Principal Solutions Engineer

    Freshworks • Boston, MA, United States
    Full-time
    Lead executive alignment workshops across strategic and global accounts.Defines value messaging across C-suite buying committees. Lead discovery workshops, shape customer requirements, and influence...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ness Digital Engineering • Boston, MA, US
    Full-time
    Job Title : Lead Data Engineer / Data Architect.New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week). We are seeking an experienced Lead Data Engineer / Data Architect to spearhe...Show more
    Last updated: 27 days ago
    Civil Engineering Principal

    Civil Engineering Principal

    Civil & Environmental Consultants, Inc. • Raynham, MA, United States
    Full-time
    As a Civil Engineering Principal for Civil & Environmental Consultants, Inc.CEC), you'll collaborate with our senior management and executive teams to grow and develop the Civil / Site Practice.By de...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Platform Engineer

    Principal Data Platform Engineer

    Southern New Hampshire University • Boston, MA, United States
    Full-time
    Southern New Hampshire University is a team of innovators.Individuals who believe in progress with purpose.Since 1932, our people-centered strategy has defined us - and helped us grow a team that n...Show more
    Last updated: 7 days ago • Promoted
    Principal Sales Engineer, Enterprise

    Principal Sales Engineer, Enterprise

    Axon • Boston, MA, US
    Full-time
    Overview Join to apply for the Principal Sales Engineer, Enterprise role at Axon.Join Axon and be a Force for Good.At Axon, we're on a mission to Protect Life. We're explorers, pursuing society's...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Soteria Reinsurance Ltd. • Boston, MA, United States
    Full-time
    Job Description : Position Description : Builds solutions using Python.Leverages Snowflake and Amazon S3 as integral components of Cloud data storage to create efficient, scalable, and secure data pipe...Show more
    Last updated: 10 days ago • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    Autodesk, Inc. • Boston, MA, United States
    Full-time
    Work with our smart and dedicated teams • Experiment, learn, and grow • Use the latest cloud technologies • Deliver solutions that millions of customers will use • Mentor teammates • Make key decisions •...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Engineer - Intelligent Systems

    Principal AI Engineer - Intelligent Systems

    C-4 Analytics • Wakefield, MA, US
    Full-time
    Quick Apply
    Principal AI Engineer - Intelligent Systems : .C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sa...Show more
    Last updated: 30+ days ago
    Principal Engineer

    Principal Engineer

    Armis • Boston, MA, US
    Remote
    Full-time
    Quick Apply
    This high-impact role involves working closely with.AI-driven security alert detection, and driving strategic partnerships with top organizations. As a technical leader, you will shape the future of...Show more
    Last updated: 4 days ago
    Principal Healthcare Cloud Engineer

    Principal Healthcare Cloud Engineer

    InterSystems • Boston, MA, United States
    Full-time
    InterSystems Cloud Development initiatives enable healthcare organizations to revolutionize their operations through innovative, cloud-based technology solutions. Our team thrives on integrating cut...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    JCW Group • Boston, Massachusetts, United States
    Full-time
    Data Engineer (W2 Contract Only).Hybrid – Boston, MA area (local candidates only).IT team responsible for data systems across healthcare departments. The role involves designing, building, and maint...Show more
    Last updated: 22 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Liberty Mutual Insurance • Boston, MA, United States
    Full-time
    Liberty Mutual Insurance provided pay range.This range is provided by Liberty Mutual Insurance.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.A...Show more
    Last updated: 3 days ago • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    Autodesk • Boston, MA, United States
    Full-time
    The French translation can be found below! / La traduction en français se trouve plus bas!.Position Overview : Are you a self-starter and technical catalyst with a proven track record of quickly tackl...Show more
    Last updated: 30+ days ago • Promoted
    Principal Machine Learning Engineer

    Principal Machine Learning Engineer

    Simplisafe • Boston, Massachusetts, United States
    Full-time
    SimpliSafe is a leading innovator in the home security industry, dedicated to making every home a safe home.With a mission to provide accessible and comprehensive security solutions, we design and ...Show more
    Last updated: 19 days ago • Promoted
    Software Engineer

    Software Engineer

    The Weather Company • Andover, Massachusetts, United States
    Full-time
    The Weather Company is the world’s leading weather provider, helping people and businesses make more informed decisions and take action in the face of weather. Together with advanced technology and ...Show more
    Last updated: 12 days ago • Promoted
    Principal Data Engineer - AI Architect

    Principal Data Engineer - AI Architect

    American Family Insurance • Boston, MA, United States
    Full-time
    As the Principal Data Engineer - AI Architect you will lead the architectural design (conceptual, logical and physical) of large-scale AI business solutions. As a technical lead, you will guide and ...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Engineer (Generative AI)

    Lead Data Engineer (Generative AI)

    Capital One • Boston, MA, United States
    Full-time +1
    Lead Data Engineer (Generative AI).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterati...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Akraya Inc • North Reading, Massachusetts, United States
    Full-time
    Quick Apply
    Primary Skills : SQL (Expert), Data Modelling (Proficient), ETL (Expert), Python (Intermediate), AWS (Basic).Duration : 6 Months with possible extension. Location : North Reading, MA (Local candidates ...Show more
    Last updated: 30+ days ago