Talent.com
Distinguished Software Engineer (Data Security - Distributed Systems, Big Data & AI )
Distinguished Software Engineer (Data Security - Distributed Systems, Big Data & AI )Palo Alto Networks • Santa Clara, CA, United States
Distinguished Software Engineer (Data Security - Distributed Systems, Big Data & AI )

Distinguished Software Engineer (Data Security - Distributed Systems, Big Data & AI )

Palo Alto Networks • Santa Clara, CA, United States
3 days ago
Job type
  • Full-time
Job description

Company Description

Our Mission

At Palo Alto Networks®, we're united by a shared mission-to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If you're ready to do the most meaningful work of your career alongside people who are just as passionate as you are, you're in the right place.

Who We Are

We believe collaboration thrives in person. That's why most of our teams work from the office full time, with flexibility when it's needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes.

Job Description

The Team

You'll be working in a top tier cybersecurity company and collaborating with some of the brightest minds in technology. Our team doesn't shy away from tackling big problems. You will help build and support the tools and infrastructure enabling our developers to release the products that our customers depend on to defend against cyberattacks. Joining this dynamic and fast-paced team will give you the opportunity and thrill of resolving the technical and process gaps that hold back productivity.

Job Summary

At Palo Alto Networks, we are redefining cybersecurity. As a Distinguished Engineer on the Enterprise DLP team, you will be the foremost technical leader responsible for architecting and scaling the data platform that underpins our industry-leading cloud-delivered DLP service. Your mission is to establish the standards and systems necessary to process and analyze massive volumes of sensitive data, leveraging cutting-edge AI / ML, to ensure our customers' data remains protected across all network, cloud, and user vectors.

Key Responsibilities

As a Distinguished Engineer, you will own the long-term technical direction and execution for all data and analytics infrastructure within Saas Data Security and AI.

I. Architecture & Strategic Vision

  • Define Architectural Roadmap : Set the 3-5 year technical strategy and architectural vision for the Enterprise DLP data platform, emphasizing scalability, performance, security, and cost-efficiency
  • Big Data & AI Foundation : Drive the design, implementation, scaling, and evangelism of the core BigQuery, Vertex AI, Nvidia Triton, Kubeflow platform components that enable high-velocity data ingestion, transformation, and Machine Learning model serving for DLP detections
  • Real-time Decisioning : Architect and implement ultra-low latency data ingestion and processing systems (utilizing Kafka, Pub / Sub, Dataflow) to enable real-time DLP policy enforcement and alert generation at massive enterprise scale
  • Cross-Functional Influence : Act as the technical voice of the DLP data platform, collaborating with Engineering VPs, Product Management, and Data Science teams to align platform capabilities with product innovation

II. High-Scale Data Platform Engineering

  • Big Data Pipeline Mastery : Architect and Lead the design and implementation of highly resilient, optimized batch and real-time data pipelines (ETL / ELT) to transform raw data streams into high-quality, actionable datasets
  • Optimized Dataset s : Expertly design and optimize clean, well-structured analytical datasets within BigQuery, focusing on partitioning, clustering, and schema evolution to maximize query performance for both operational analytics and complex data science / ML feature generation
  • Database Strategy : Provide deep, hands-on expertise in both SQL and NoSQL databases like MongoDB, Spanner, BigQuery, advising on the optimal data persistence layer for diverse DLP data use cases (e.g., policy configurations, high-speed telemetry, analytical fact tables)
  • MLOps Implementation : Establish robust MLOps practices model deployment & execution pipelines like Vertex AI, Nvidia Triton for DLP models, including automated pipelines for continuous training, versioning, deployment, and monitoring of model drift
  • Performance Engineering : Debug, optimize, and tune the most challenging performance bottlenecks across the entire data platform, from initial data ingestion to final analytics query execution, often dealing with PBs of data
  • III. Mentorship & Operational Excellence

  • Technical Mentorship : Mentor and develop Principal and Staff-level engineers, raising the bar for engineering craftsmanship and data platform development across the organization
  • Operational Health : Define and implement advanced observability, monitoring, and alerting strategies to ensure the end-to-end health and SLOs of the mission-critical DLP data service
  • Qualifications

    Preferred Qualifications

  • 12+ years of experience in a high-scale data-intensive environment, with a minimum of 3+ years operating as a Distinguished or Principal-level Engineer / Architect
  • Mastery of Google Cloud Platform (GCP) with extensive, hands-on experience architecting and scaling solutions using BigQuery and Vertex AI or equivalent AWS, Azure, or other Big Data & AI services
  • Expertise in Big Data processing frameworks and managed services, specifically with building and scaling data and analytics pipelines using Dataflow, Pub / Sub, and GKE (or equivalent technologies like Apache Spark / Kafka)
  • Strong experience in SQL & NoSQL databases (e.g., MongoDB, Cassandra, Spanner), with an understanding of their respective architectural trade-offs for distributed systems
  • Demonstrated ability to design scalable data models and systems that enable high-precision
  • Proven ability to build and optimize clean, well-structured analytical datasets for large-scale business and data science use cases
  • Demonstrated experience in implementing and supporting Big Data solutions for both batch (scheduled) and real-time (streaming) analytics
  • Prior experience in the security domain (especially DLP, Data Security, or Cloud Security) is a significant advantage
  • Exceptional ability to influence technical and business leaders, translating ambiguous problems into clear, executable technical designs
  • BS / MS in Computer Science or Electrical Engineering or equivalent experience or equivalent military experience required
  • Additional Information

    Salary Disclosure

    The compensation offered for this position will depend on qualifications, experience, and work location. For candidates who receive an offer at the posted level, the starting base salary (for non-sales roles) or base salary + commission target (for sales / commissioned roles) is expected to be between $230,000 / YR - $300,000 / YR. The offered compensation may also include restricted stock units and a bonus. A description of our employee benefits may be found here.

    #LI-TD12

    Our Commitment

    We're problem solvers that take risks and challenge cybersecurity's status quo. It's simple : we can't accomplish our mission without diverse teams innovating, together.

    We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at accommodations@paloaltonetworks.com.

    Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

    All your information will be kept confidential according to EEO guidelines.

    Create a job alert for this search

    Software Engineer Security • Santa Clara, CA, United States

    Related jobs
    Security Engineer

    Security Engineer

    Glow Networks • Mountain View, CA, United States
    Full-time
    We are seeking a Security Engineer to design and implement Data Loss Protection capabilities for complex security use cases, identifying bad actor threat behaviors and preventing / reducing malicious...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Data Engine

    Software Engineer - Data Engine

    Applied Intuition • Sunnyvale, CA, United States
    Full-time
    Applied Intuition is the vehicle intelligence company that accelerates the global adoption of safe, AI-driven machines.Founded in 2017 and now valued at $15 billion following its recent Series F fu...Show more
    Last updated: 3 days ago • Promoted
    Distinguished Engineer - Applied AI

    Distinguished Engineer - Applied AI

    GEICO • Palo Alto, CA, United States
    Full-time
    Distinguished Engineer - Applied AI page is loaded## Distinguished Engineer - Applied AIremote type : Hybridlocations : Palo Alto, CA : Chevy Chase, MDtime type : Full timeposted on : Posted T...Show more
    Last updated: 25 days ago • Promoted
    Security Engineer - Data Loss Prevention (DLP)

    Security Engineer - Data Loss Prevention (DLP)

    Cadence Design Systems • San Jose, CA, United States
    Full-time
    At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.A highly skilled and experienced Security Engineer with a strong focus on Data Loss Prev...Show more
    Last updated: 7 days ago • Promoted
    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Capital One • San Jose, CA, United States
    Full-time +1
    Distinguished AI Engineer (Agentic AI Platform Infrastructure).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an indu...Show more
    Last updated: 3 days ago • Promoted
    Senior Software and Data Engineer - SIML, ISE

    Senior Software and Data Engineer - SIML, ISE

    Apple • Santa Clara, CA, United States
    Full-time
    Senior Software and Data Engineer - SIML, ISE.Do you believe Machine Learning and AI can change the world? We truly believe it can. We are the Data Team of the System Intelligence and Machine Learni...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Distributed Data Systems

    Senior Software Engineer - Distributed Data Systems

    Databricks • Mountain View, CA, United States
    Full-time
    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Distributed Data Systems

    Software Engineer - Distributed Data Systems

    Xai • Palo Alto, CA, United States
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excelle...Show more
    Last updated: 3 days ago • Promoted
    Software Engineer, AI and Security

    Software Engineer, AI and Security

    Glean.info • Palo Alto, CA, United States
    Full-time
    Glean is the Work AI platform that helps everyone work smarter with AI.What began as the industry's most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelli...Show more
    Last updated: 30+ days ago • Promoted
    Bigdata Engineer

    Bigdata Engineer

    VeeRteq Solutions Inc. • Mountain View, CA, United States
    Full-time
    Quick Apply
    Position Details : Job Title : Bigdata Engineer Work Location : Mountain View, CA Dura...Show more
    Last updated: 3 days ago
    Principal Cyber Security Engineer

    Principal Cyber Security Engineer

    Cloud Software Group, Inc. • San Ramon, CA, United States
    Full-time
    Architectural Leadership : Design, develop, and maintain the comprehensive security architecture for Cloud Software Group's products and corporate infrastructure. Cloud Security Expertise : Lead the s...Show more
    Last updated: 30+ days ago • Promoted
    Distinguished, Software Engineer

    Distinguished, Software Engineer

    Walmart • Sunnyvale, CA, United States
    Full-time +1
    Enterprise Safety and Security team.Walmart plays a critical role in safeguarding the world's largest retail ecosystem.Operating at the intersection of innovation and security, our team is responsi...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer @ AI Security Startup

    Lead Software Engineer @ AI Security Startup

    Right Hand Talent • Mountain View, CA, United States
    Full-time
    Mountain View, CA (on-site 4 days / week).Our client is an AI company focused on building trustworthy, production-grade systems that power the "authenticity layer" of the internet.They develop two co...Show more
    Last updated: 3 days ago • Promoted
    Security Engineer

    Security Engineer

    Kforce • Cupertino, CA, United States
    Full-time
    Kforce has a client that is seeking a Security Engineer ibn Cupertino, CA.Scope of Work & Technologies : This role involves conducting security assessments across a wide range of applications, includ...Show more
    Last updated: 9 days ago • Promoted
    Big Data Engineer - Onsite

    Big Data Engineer - Onsite

    Saransh Inc • Mountain View, CA, United States
    Full-time
    Quick Apply
    Min of 7+ years working with Apache Flink and Apache Spark • 5+ years' experience with Java • Strong expertise in Python Expertis...Show more
    Last updated: 3 days ago
    Senior Software Engineer, Big Data

    Senior Software Engineer, Big Data

    ZipRecruiter • Palo Alto, CA, United States
    Full-time
    We offer a hybrid work environment.Most US-based positions can alsobeperformed remotely (any exceptions will be noted in the Minimum Qualifications below. To actively connect people to their next gr...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Security)

    Data Engineer (Security)

    Insight Global • Santa Clara, CA, United States
    Full-time
    Insight Global is looking for a Data Engineer to work 4 days on-site in Santa Clara, CA for a fast-growing technology company specializing in secure networking solutions-including SD-WAN, SASE, and...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

    Senior / Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

    Tik Tok • San Jose, CA, United States
    Full-time
    Team Introduction Our team plays a crucial role in the data ecosystem of the TikTok Recommendation System, focusing on creating offline and real-time data storage solutions for large-scale recommen...Show more
    Last updated: 30+ days ago • Promoted