Distributed Systems Engineer - Data Platform - Logs and Audit Logs

At Cloudflare, we are on a mission to help build a better Internet. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Our worldwide network powers millions of websites and other Internet properties for customers ranging from individual bloggers to Fortune 500 companies.

We hire the best people based on an evaluation of their potential and support them throughout their time at Cloudflare. Come join us!

Locations Available :

London (UK), Lisbon (Portugal), Austin (US), Denver (US), Atlanta (US)

About Role

We are actively seeking experienced and highly motivated Distributed Systems Engineers to join Cloudflare's dynamic DATA Organisation. This pivotal opportunity will let you contribute to the future of data at Cloudflare, working on systems that are fundamental to our global operations and customer insights. Our data lifecycle spans ingestion, processing, and storage, powering critical logs and analytics with real‑time visibility.

Our mission is to empower customers to leverage their data effectively. To achieve this, we design, build, and maintain high-performance, massively scalable distributed systems capable of processing well over a billion events per second.

Data Organisation Teams

Data Delivery / Data Pipeline :

Design, develop, and operate a high-throughput, low-latency data delivery pipeline written in Go, ingesting and routing massive volumes of data from Cloudflare's global network to core destinations.

Analytical Database Platform :

Contribute to our core analytical platform powered by ClickHouse, building a high-performance, scalable database platform optimized for the immense analytical workloads of all Cloudflare products.

Data Retrieval (Customer‑Facing Products) :

Build and continuously improve customer‑facing products, making data accessible and actionable. This department includes two groups :

Analytics and Alerts :

Develop public APIs such as the GraphQL Analytics API and build an alerting platform that empowers users to configure near real‑time alerts for critical logs and metrics.

Logs and Audit Logs :

Build a robust logging platform that delivers reliable data to customer destinations, ensuring usability, compliance, and performance.

Responsibilities

Design, build, and operate a robust logging platform ensuring reliable logging and secure data transfer to customer destinations.

Develop and maintain high-performance data connectors and integrations for log‑shipping products, focusing on usability, scalability, and data integrity.

Create and manage systems for handling comprehensive audit logs, delivering them securely and meeting strict compliance and performance standards.

Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, removing bottlenecks in processing and routing.

Work closely with Product and other engineering teams to define requirements for new logging platform and integrations.

Maintain the operational health of the log delivery platform through comprehensive monitoring and participation in an on‑call rotation.

Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability.

Key Qualifications

3+ years of experience working in software development covering distributed systems and data pipelines.

Strong programming skills (Go is preferable), with deep understanding of best practices for resilient, high-throughput systems.

Hands‑on experience with modern observability stacks, including Prometheus, Grafana, and high‑cardinality metrics at scale.

Strong knowledge of SQL, including query optimisation.

Solid foundation in computer science : algorithms, data structures, distributed systems, and concurrency.

Strong analytical and problem‑solving skills, willing to debug, troubleshoot, and learn complex problems at high scale.

Ability to work collaboratively in a team environment and communicate effectively across Cloudflare.

Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.

Experience with logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (S3, R2, GCS) is a plus.

Experience with Infrastructure as Code tools like SALT or Terraform is a plus.

Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.

What Makes Cloudflare Special?

Cloudflare is not just a large-scale technology company; we are a company dedicated to protecting the free and open Internet. Our projects include :

Project Galileo :

Since 2014, we equip journalism and civil society organizations with tools to defend against censorship. This is available at no cost to enterprise customers.

Athenian Project :

In 2017, we created the Athenian Project to ensure state and local governments have the highest level of protection and reliability for free, enabling election information and voter registration. We have served over 425 local government election websites in 33 states.

1.1.1.1 :

We released 1.1.1.1, a faster, more secure privacy‑centric public DNS resolver. We do not store client IP addresses, nor do we sell user data to advertisers.

If you're passionate about building scalable, high‑performance data platforms with cutting‑edge technologies and want to work with a world‑class team of engineers, then we want to hear from you!

This position may require access to information protected under U.S. export control laws, including the U.S. Export Administration Regulations. Please note that any offer of employment may be conditioned on your authorization to receive software or technology controlled under these U.S. export laws without sponsorship for an export license.

Cloudflare is proud to be an equal opportunity employer. We are committed to providing equal employment opportunity for all people and place great value in both diversity and inclusiveness. All qualified applicants will be considered for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, ancestry, citizenship, age, disability, or any other basis protected by law. We are an AA / Veterans / Disabled Employer.

Cloudflare provides reasonable accommodations to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job. Examples of reasonable accommodations include, but are not limited to, changing the application process, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you require a reasonable accommodation to apply for a job, please contact us via e‑mail at hr@cloudflare.com or via mail at 101 Townsend St. San Francisco, CA 94107.

#J-18808-Ljbffr