Talent.com
Principal Data Engineer

Principal Data Engineer

Recorded FutureBoston, MA, United States
30+ days ago
Job type
  • Full-time
Job description

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world's most advanced, and largest, intelligence company!

We are looking for a Data Engineer to improve the Security Intelligence Graph. As a Data Engineer, you will build production-grade pipelines to drive data convergence from various sources within the graph, ensure that Indicators of Compromise (IOCs) are properly attributed, and improve the quality of the graph at scale.

What You'll Do :

  • Work with the Graph Quality team to align, analyze, and ingest asset maps into the Security Intelligence Graph
  • Develop, productize, monitor, and maintain data pipelines to analyze and ingest data at scale
  • Lead a team of Data Engineers by providing guidance on projects and direction of best practices
  • Build tools and APIs to facilitate access to data and analytics developed from the intelligence graph
  • Analyze and explain patterns in data to drive business‑critical decisions
  • Create technical project plans and drive the successful execution of projects, with input from our Product team and other developers on the team
  • Collaborate with Data Scientists, Data Engineers, and business leaders to develop and refine technical solutions
  • Onboard and guide junior members of the team
  • Assist in setting team goals, planning sprints, and leading Agile scrum meetings

What You'll Bring :

  • 6+ years of Python programming
  • 2+ years of experience with cloud computing tools, e.g. from AWS, Azure, or Google Cloud
  • 1+ years of experience leading and / or mentoring other team members
  • Experience writing scalable, production‑grade applications and ETL / ELT pipelines
  • Efficient & accurate problem solving skills, including the ability to debug both software and data
  • Proven ability to analyze data and apply statistical techniques to draw accurate, impactful conclusions
  • Proven success in delivering projects from design and implementation to release
  • Excellent attention to detail & ability to work independently while delivering high‑quality results
  • Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
  • Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
  • Preferred Qualifications :

  • Familiarity with both batch and streaming pipelines
  • Familiarity with any of the following : message buses (e.g. Kafka, RabbitMQ), NoSQL databases (e.g. MongoDB, AWS Neptune, Neo4j), ElasticSearch
  • Bachelor's / Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
  • Exposure to ML approaches, including experience productizing ML models
  • Experience with developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
  • Leadership experience, with a track record of presenting information to stakeholders with varying levels of technical expertise
  • The base salary range for this full‑time position is $152,000-$228,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job‑related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

    Why should you join Recorded Future?

    Recorded Future employees (or "Futurists"), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6‑star user rating on G2 and more than 50% of Fortune 100 companies as customers.

    Want more info?

    Blog & Podcast : Learn everything you want to know (and maybe some things you'd rather not know) about the world of cyber threat intelligence

    , Instagram & Twitter : What's happening at Recorded Future

    The Record : The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field

    Timeline : History of Recorded Future

    Recognition : Check out our awards and announcements

    We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.

    If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at careers@recordedfuture.com

    Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.

    Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

    Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

    Notice to Agency and Search Firm Representatives : Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

    Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

    Note : Our interview process for all final‑round candidates requires a mandatory in‑person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Data Engineer • Boston, MA, United States

    Related jobs
    • Promoted
    Principal Solutions Engineer

    Principal Solutions Engineer

    FreshworksBoston, MA, United States
    Full-time
    Lead executive alignment workshops across strategic and global accounts.Defines value messaging across C-suite buying committees. Lead discovery workshops, shape customer requirements, and influence...Show moreLast updated: 4 days ago
    Lead Data Engineer

    Lead Data Engineer

    Ness Digital EngineeringBoston, MA, US
    Full-time
    Job Title : Lead Data Engineer / Data Architect.New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week). We are seeking an experienced Lead Data Engineer / Data Architect to spearhe...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    The RMR Group LLCNewton, MA, United States
    Full-time
    The Data Engineer will play a pivotal role in operationalizing the most-urgent data, analytics, artificial intelligence and machine learning initiatives for The RMR Group's business initiatives.The...Show moreLast updated: 2 days ago
    • Promoted
    Principal Software Engineer, Performance

    Principal Software Engineer, Performance

    RStudio, Inc.Boston, MA, US
    Full-time
    Posit is seeking a principal software engineer with deep expertise in performance and scalability to lead a strategic function for our professional products. Your primary task will be to help develo...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Scientist

    Principal Data Scientist

    Cambridge Mobile TelematicsMA, United States
    Full-time
    Cambridge Mobile Telematics (CMT) is the world's largest telematics service provider.Its mission is to make the world's roads and drivers safer. The company's AI-driven platform DriveWell Fusion gat...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Principal Data Platform Engineer

    Principal Data Platform Engineer

    Southern New Hampshire UniversityBoston, MA, United States
    Full-time
    Southern New Hampshire University is a team of innovators.Individuals who believe in progress with purpose.Since 1932, our people-centered strategy has defined us - and helped us grow a team that n...Show moreLast updated: 18 hours ago
    • Promoted
    Principal Data Engineer, Attack Surface Intelligence

    Principal Data Engineer, Attack Surface Intelligence

    Recorded FutureBoston, MA, United States
    Full-time
    With 1,000 intelligence professionals, over $300M in sales, and serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!.Lead the desig...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Healthcare Cloud Engineer

    Principal Healthcare Cloud Engineer

    InterSystemsBoston, MA, United States
    Full-time
    InterSystems Cloud Development initiatives enable healthcare organizations to revolutionize their operations through innovative, cloud-based technology solutions. Our team thrives on integrating cut...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Scientist - Consumer Personalization & Generative AI

    Principal Data Scientist - Consumer Personalization & Generative AI

    MediumBoston, MA, United States
    Full-time
    Gopuff’s Data Science team powers the personalized search, browse and recommendation experiences that shape how customers discover daily goods. We are expanding our mission to include cutting‑edge g...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    Autodesk, Inc.Boston, MA, United States
    Full-time
    Work with our smart and dedicated teams • Experiment, learn, and grow • Use the latest cloud technologies • Deliver solutions that millions of customers will use • Mentor teammates • Make key decisions •...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Principal Software Engineer, AEC Data

    Senior Principal Software Engineer, AEC Data

    AutodeskMA, United States
    Full-time
    Senior Principal Software Engineer, AEC Data.Senior Principal Software Engineer, AEC Data.Are you a self-starter and technical catalyst with a proven track record of quickly tackling complex projec...Show moreLast updated: 1 day ago
    • Promoted
    Principal Sales Engineer, Enterprise

    Principal Sales Engineer, Enterprise

    AxonBoston, Massachusetts, United States
    Full-time
    Overview Join to apply for the.Principal Sales Engineer, Enterprise.Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life. We’re explorers, pursuing society’s most critical s...Show moreLast updated: 1 day ago
    Data Engineer

    Data Engineer

    VerndaleBoston, MA, US
    Full-time
    Quick Apply
    About the Data Engineer Position At Verndale, we are building a next-generation Data & Analytics practice designed to help organizations transform their complex data ecosystems into engines of ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Systems Engineer

    Principal Systems Engineer

    RaytheonLawrence, Massachusetts, US
    Permanent
    The full job description covers all associated skills, previous experience, and any qualifications that applicants are expected to have. MA133 : Tewksbury, Ma Bldg 3 Concord 50 Apple Hill Drive Conco...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Soteria Reinsurance Ltd.Boston, MA, United States
    Full-time
    Job Description : Position Description : Builds solutions using Python.Leverages Snowflake and Amazon S3 as integral components of Cloud data storage to create efficient, scalable, and secure data pipe...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch)

    Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch)

    Recorded FutureBoston, MA, United States
    Full-time
    Principal Data Engineer, (APIs / microservices / Python / Kafka / Elasticsearch).Get AI-powered advice on this job and more exclusive features. With 1,000+ intelligence professionals serving over 1,900 clie...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer (Generative AI)

    Lead Data Engineer (Generative AI)

    Capital OneBoston, MA, United States
    Full-time +1
    Lead Data Engineer (Generative AI).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterati...Show moreLast updated: 9 days ago
    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Akraya IncNorth Reading, Massachusetts, United States
    Full-time
    Quick Apply
    Primary Skills : SQL (Expert), Data Modelling (Proficient), ETL (Expert), Python (Intermediate), AWS (Basic).Duration : 6 Months with possible extension. Location : North Reading, MA (Local candidates ...Show moreLast updated: 30+ days ago