Talent.com
Principal AI Knowledge AI Architect

Principal AI Knowledge AI Architect

FreshworksSan Mateo, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Company Description

Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and employees. To help them grow. Software is a choice that can make or break a business. Create better or worse experiences. Propel or throttle growth. Business software has become a blocker instead of ways to get work done.

There’s another option. Freshworks. With a fresh vision for how the world works.

At Freshworks, we build uncomplicated service software that delivers exceptional customer and employee experiences. Our enterprise-grade solutions are powerful, yet easy to use, and quick to deliver results. Our people-first approach to AI eliminates friction, making employees more effective and organizations more productive. Over 72,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks’ customer experience (CX) and employee experience (EX) software to fuel customer loyalty and service efficiency. And, over 4,500 Freshworks employees make this possible, all around the world.

Fresh vision. Real impact. Come build it with us.

Job Description

We are seeking a Principal AI Knowledge AI Architect to design and lead the architecture for next-generation knowledge and RAG systems that enable reasoning-driven AI assistants to deliver precise, contextually relevant answers at scale. This role focuses on advanced RAG pipelines leveraging ontologies, dynamic content ingestion, agentic retrieval, data synchronization with enterprise platforms, and continuous knowledge health monitoring to ensure high-fidelity, trustworthy knowledge delivery.

You will architect the knowledge layer of our AI Agentic Platform, integrating enterprise content repositories, knowledge bases, APIs, and external tools into an agent-driven reasoning and retrieval engine.

Key Responsibilities :

Advanced RAG Architecture

  • Architect and implement multi-layer RAG pipelines leveraging ontologies, semantic graphs, embeddings, and hybrid retrieval strategies.
  • Design agentic RAG workflows where autonomous agents reason about query decomposition, multi-hop retrieval, and context stitching for better factual accuracy.
  • Build hierarchical and ontology-based knowledge graphs to improve entity resolution, semantic search, and contextual reasoning.
  • Optimize retrieval for domain-specific knowledge using structured + unstructured data fusion.

Knowledge Ingestion & Synchronization

  • Lead development of content ingestion pipelines for enterprise sources (Confluence, SharePoint, Google Drive, Salesforce KB, ServiceNow KB, etc.)
  • Design real-time data sync connectors and ETL frameworks to keep knowledge sources fresh and in sync with external systems.
  • Implement document parsing, enrichment, chunking, metadata tagging, and semantic indexing pipelines at scale.
  • Agentic Knowledge & Reasoning Integration

  • Architect agentic knowledge workflows where agents autonomously evaluate, retrieve, and cross-reference multi-source knowledge.
  • Enable agents to invoke external APIs / tools dynamically to complement RAG with transactional or dynamic information retrieval.
  • Integrate multi-modal RAG (text, images, tables, PDFs) into reasoning loops for richer AI responses.
  • Knowledge Quality & Health Monitoring

  • Develop knowledge health check pipelines to automatically validate knowledge freshness, detect stale or redundant articles, and recommend updates.
  • Implement automated knowledge evaluation using LLMs (hallucination detection, coverage analysis, answer accuracy).
  • Define governance policies for knowledge versioning, lifecycle management, and auditing.
  • Scalability, Security & Compliance

  • Architect multi-tenant, enterprise-ready knowledge systems with strict access controls, encryption, and compliance (SOC2, HIPPA, GDPR).
  • Ensure cost-efficient vector database and embedding management strategies (e.g., partitioning, caching, tiered storage).
  • Thought Leadership & Collaboration

  • Mentor engineers on best practices for RAG pipelines, knowledge representation, and semantic search.
  • Work with product leadership to define long-term knowledge strategy for powering enterprise-grade agentic AI assistants.
  • Collaborate closely with LLM engineers on optimizing retrieval-planning-generation loops for factual accuracy and latency.
  • Please note : This is a hybrid role that will be based in San Mateo, CA, or Bellevue, WA, and requires an in-office presence three days per week (Tuesday - Thursday).

    Qualifications

    Required Qualifications

  • 10+ years in software architecture, with at least 3+ years in AI-driven knowledge systems, RAG pipelines, or semantic search
  • Deep expertise in retrieval techniques (vector search, hybrid search, ontology-based retrieval) and knowledge graph design
  • Experience with ontology design and reasoning (OWL, SPARQL, etc.) for enterprise knowledge modeling
  • Proven experience building RAG pipelines with LLMs (OpenAI, Anthropic, LLaMA, etc.) integrated into production systems
  • Strong proficiency in Java & Python and AI / ML frameworks (LangChain, LangGraph, etc.)
  • Knowledge of vector DBs (Pinecone, ElasticSearch, etc.) and graph DBs (Neo4j, etc.)
  • Experience building enterprise knowledge ingestion frameworks from CMS / CRM / ITSM platforms (e.g, Salesforce, ServiceNow)
  • Background in document parsing (OCR, PDFs, HTML), metadata enrichment, and semantic embeddings
  • Expertise in scalable cloud-native architecture (Kubernetes, event-driven microservices, streaming pipelines)
  • Understanding of agentic AI frameworks (LangChain, LangGraph) and their integration with retrieval for reasoning
  • Preferred Qualifications :

  • Familiarity with self-healing knowledge pipelines (auto-detection and repair of broken links, stale knowledge)
  • Strong grounding in AI safety and governance for enterprise knowledge systems
  • Contributes to open-source RAG or knowledge graph frameworks are a plus
  • Familiarity with multi-modal knowledge retrieval (image / document embeddings and cross-modal search)
  • Additional Information

    The annual base salary range for this position is $260,500 - $374,440.

    Compensation is based on a variety of factors including but not limited to location, experience, job-related skills, and level. Bonus / equity may be available.

    Freshworks offers multiple options for dental, medical, vision, disability and life insurances. Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered. Freshworks also offers adoption and parental leave benefits.

    At Freshworks, we are creating a global workplace that enables everyone to find their true potential, purpose, and passion irrespective of their background, gender, race, sexual orientation, religion and ethnicity. We are committed to providing equal opportunity for all and believe that diversity in the workplace creates a more vibrant, richer work environment that advances the goals of our employees, communities and the business.

    #J-18808-Ljbffr

    Create a job alert for this search

    Ai Architect • San Mateo, CA, United States

    Related jobs
    • Promoted
    AI / ML Solutions Architect

    AI / ML Solutions Architect

    JobotSan Jose, CA, US
    Full-time
    Join one of the fasted growing AI / ML services companies!.This Jobot Job is hosted by : Adam Bennett.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Principal AI Architect

    Senior Principal AI Architect

    ServiceNow, Inc.Santa Clara, CA, United States
    Full-time
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...Show moreLast updated: 15 days ago
    • Promoted
    Principal AI UI Architect

    Principal AI UI Architect

    FreshworksSan Mateo, CA, United States
    Full-time
    Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and employees.Softw...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Platform Architect, Agentic AI

    Principal Platform Architect, Agentic AI

    NVIDIA CorporationSanta Clara, CA, United States
    Full-time
    NVIDIA has been transforming accelerated computing with innovation that’s fueled by great technology—and amazing people.As part of Nvidia's applied AI team for chip design, you will have the opport...Show moreLast updated: 30+ days ago
    • Promoted
    Solutions Architect, AI and ML

    Solutions Architect, AI and ML

    NVIDIA CorporationSanta Clara, CA, United States
    Full-time
    Solutions Architect, AI and ML page is loaded## Solutions Architect, AI and MLlocations : US, WA, Redmond : US, CA, Santa Clara : US, WA, Seattletime type : Full timeposted on : Posted Yesterd...Show moreLast updated: 13 days ago
    • Promoted
    Solutions Architect, Applied AI

    Solutions Architect, Applied AI

    Menlo VenturesSan Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show moreLast updated: 30+ days ago
    • Promoted
    Forward-Deployed AI Solutions Architect

    Forward-Deployed AI Solutions Architect

    Horizontal TalentSan Francisco, CA, United States
    Full-time
    Join a dynamic team as a Forward-Deployed AI Solutions Architect, where you\'ll drive AI-powered transformations in healthcare operations. Collaborate with cross-functional teams to design and imple...Show moreLast updated: 30+ days ago
    • Promoted
    Principal AI Engineer, Intelligent Sensors

    Principal AI Engineer, Intelligent Sensors

    1010 Analog Devices Inc.Rio Robles, CA, United States
    Full-time +1
    NASDAQ : ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologie...Show moreLast updated: 30+ days ago
    • Promoted
    Principal AI Solution Architect

    Principal AI Solution Architect

    McKinsey & CompanySan Francisco, CA, United States
    Full-time
    Principal AI Solution Architect — Job ID : 102466.As a Principal AI Solution Architect at McKinsey, you will combine deep expertise in full-stack engineering and advanced AI systems to deliver trans...Show moreLast updated: 15 days ago
    • Promoted
    Principal AI Architect at The Talent Co-op San Francisco, CA

    Principal AI Architect at The Talent Co-op San Francisco, CA

    The Talent Co-opSan Francisco, CA, United States
    Full-time
    Principal AI Architect job at The Talent Co-op.Principal AI Architect Opportunity | San Francisco | Hybrid.A stealth-mode, seed-stage fintech startup is hiring a Head of AI / Principal AI Architect...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Principal AI Architect

    Senior Principal AI Architect

    ServiceNowSanta Clara, CA, United States
    Full-time
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. ServiceNow stands as a global market leader, bringing innovat...Show moreLast updated: 15 days ago
    • Promoted
    Principal AI Architect

    Principal AI Architect

    IntappPalo Alto, CA, United States
    Full-time
    Intapp’s Intelligent Cloud platform.This executive-level, hands-on role is critical to ensuring our technology ecosystem is scalable, integrated, and AI-enabled. You’ll collaborate across engineerin...Show moreLast updated: 30+ days ago
    • Promoted
    Applied AI, Partner Solution Architect

    Applied AI, Partner Solution Architect

    AnthropicSan Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show moreLast updated: 5 days ago
    • Promoted
    AI Solution Architect

    AI Solution Architect

    CognizantSan Francisco, CA, United States
    Full-time
    Imagine a world where businesses predict market shifts before they happen, anticipate customer needs with precision, make the smartest decisions in real-time, and augment their business processes f...Show moreLast updated: 30+ days ago
    • Promoted
    Principal AI Architect (BHJOB22048_622)

    Principal AI Architect (BHJOB22048_622)

    ITmPowered ConsultingPleasanton, CA, United States
    Full-time
    Principal AI Architect (BHJOB22048_622).Be among the first 25 applicants.Principal AI Architect (BHJOB22048_622).Principal AI Enterprise Architect – ITmPowered. Principal AI Architect is responsible...Show moreLast updated: 21 days ago
    • Promoted
    Conversational AI Solution Architect

    Conversational AI Solution Architect

    Empower StaffingSan Francisco, CA, United States
    Full-time
    Our client, a leader in healthcare innovation for over a decade, is seeking a seasoned AI Solution Architect to join its AI Platform Partnership team. In this position, you’ll be one of five team me...Show moreLast updated: 27 days ago
    • Promoted
    Solutions Architect, Agentic AI

    Solutions Architect, Agentic AI

    NVIDIA CorporationSanta Clara, CA, United States
    Full-time
    Solutions Architect, Agentic AI page is loaded## Solutions Architect, Agentic AIlocations : US, CA, Santa Clara : US, Remotetime type : Full timeposted on : Posted Yesterdayjob requisition id : ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Solutions Architect, Gen AI, Startups, AGS North America Gen AI Startups (AWS)

    Senior Solutions Architect, Gen AI, Startups, AGS North America Gen AI Startups (AWS)

    AmazonSan Francisco, CA, United States
    Full-time
    Senior Solutions Architect, Gen AI, Startups – AWS North America Gen AI Startups.Build and guide architecture for Gen AI-focused startups, helping them adopt scalable, secure, and cost-effective cl...Show moreLast updated: 2 days ago