Talent.com
Product Analyst, AI Solutions
Product Analyst, AI SolutionsTyler Technologies, Inc. • Yarmouth, ME, US
Product Analyst, AI Solutions

Product Analyst, AI Solutions

Tyler Technologies, Inc. • Yarmouth, ME, US
2 days ago
Job type
  • Full-time
Job description

The Product Analyst, AI Solutions shapes, optimizes, and maintains advanced AI-driven features and user experiences within our product suite. This role sits at the intersection of business analysis, AI tuning, and user experience, combining expertise in software requirements gathering, prompt engineering, and AI model evaluation. The Analyst focuses on refining how AI systems behave in real-world scenarios, ensuring outputs are accurate, trustworthy, and closely aligned with client needs.

You will partner with AI Engineers, Product Managers, UX / UI Designers, QA, and Subject Matter Experts (SMEs) to extract user requirements, translate those into actionable user stories and evaluation metrics, and continuously tune AI systems for best-in-class performance and usability.

This role helps ensure our AI solutions provide maximum business value by aligning advanced technology with end-user needs while driving continuous improvement and reliability. The Analyst produces high-quality deliverables using systematic processes with impact across multiple projects, deadlines, and teams.

Principal Duties

AI Tuning & Output Quality

  • Design, evaluate, and refine prompts, templates, and conversation flows for reliability, cost effectiveness, and user alignment.
  • Maintain prompt libraries, track changes, and manage versioning.
  • Systematically test AI model outputs for accuracy, consistency, compliance, and tone, applying rerankers, guardrails, and validation layers to ensure business rules are met.
  • Collaborate with engineering and QA to promptly integrate feedback and resolve model drift or new scenarios.

Requirements Gathering & Documentation

  • Proactively gather requirements of moderate scope and complexity from diverse sources (clients, market analysis, SMEs) to drive product development and AI enhancements.
  • Document software and system requirements, including user stories, program functions, test cases, and steps required for new features or modifications.
  • Ensure all documentation supports future maintainability and growth of AI-enabled features.
  • Establish systematic evaluation frameworks for AI model outputs, leveraging quantitative and qualitative benchmarks.
  • Run experiments, A / B tests, and structured evaluations to compare tuning strategies and track performance metrics (accuracy, coverage, hallucination rates, latency).
  • Translate business and user feedback into actionable improvements, owning continuous iteration for released solutions.
  • Act as a bridge between technical and non-technical stakeholders, ensuring clear, effective communication and alignment.
  • Work closely with product, development, and UX / UI teams to ensure AI-driven features fit seamlessly into business workflows, are intuitive and user-friendly, and meet client needs.
  • Help shape the overall user experience for AI interactions, promoting explainability and transparency.
  • Evaluation, Metrics, & Continuous Improvement

  • Establish systematic evaluation frameworks for AI model outputs, leveraging quantitative and qualitative benchmarks.
  • Run experiments, A / B tests, and structured evaluations to compare tuning strategies and track performance metrics (accuracy, coverage, hallucination rates, latency).
  • Translate business and user feedback into actionable improvements, owning continuous iteration for released solutions.
  • Collaboration & UX Alignment

  • Act as a bridge between technical and non-technical stakeholders, ensuring clear, effective communication and alignment.
  • Work closely with product, development, and UX / UI teams to ensure AI-driven features fit seamlessly into business workflows, are intuitive and user-friendly, and meet client needs.
  • Help shape the overall user experience for AI interactions, promoting explainability and transparency.
  • Education, Experience and Special Skills

  • Bachelor's degree in Computer Science, Management Information Science, Business, or related field OR equivalent work experience.
  • 1+ years' experience in software, AI / ML, or related product analysis roles.
  • Experience with AI / ML applications (LLMs, NLP, machine learning pipelines).
  • Strong understanding of prompt engineering and generative AI interaction design.
  • Basic knowledge of data modeling, relational database concepts, and SQL.
  • Familiarity with model evaluation techniques and performance metrics.
  • Proficiency with Python or JavaScript for prototyping and evaluation.
  • Experience with Agile SCRUM development processes.
  • Excellent planning, organization, and interpersonal communication skills.
  • Ability to work independently and collaboratively across functional groups.
  • Experience in ERP systems, enterprise software, or complex business domains.
  • Familiarity with RAG (retrieval-augmented generation), embeddings, MLOps, and responsible AI practices.
  • Experience with fine-tuning methods (LoRA, QLoRA, PEFT), running structured evaluation series, or human-in-the-loop systems.
  • Location

    Yarmouth, Maine

    Travel

    0-5%

    Great Place to Work & Grow Your Career

    Join us as we transform the public sector. Our mission, vision, and values guide everything we do. We're frequently recognized as a great workplace locally and nationally.

    Taking Care of You & Your Family

    Your health and well-being are important. We offer competitive benefits to support health and financial wellness. Learn more about how we care for our people.

    Equal Opportunity

    Tyler Technologies is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, creed, gender, marital status, sexual orientation, citizenship status, color, religion, national origin, age, disability, protected veteran status, or any other status protected under applicable laws. If you require reasonable accommodation for any part of the application or hiring process due to a disability, please submit your request by emailing jobs@tylertech.com or by calling 800.646.2633 ext. 791008.

    J-18808-Ljbffr

    Create a job alert for this search

    Product Analyst • Yarmouth, ME, US

    Related jobs
    Product Manager II - AI Capabilities

    Product Manager II - AI Capabilities

    WEX • Portland, ME, US
    Full-time
    WEX is seeking an experienced and results-oriented Intermediate Product Manager to lead the development of our shared AI capabilities. In this role, you will own the execution of specific features a...Show more
    Last updated: 23 days ago • Promoted
    Senior Product Manager - Data & AI •Remote Opportunity •

    Senior Product Manager - Data & AI •Remote Opportunity •

    WEX • Portland, ME, US
    Remote
    Full-time
    Sr Product Manager, Data And AI.WEX's AI & Data organization is on a mission to transform financial services through data-driven insights and intelligent automation. We build scalable data platforms...Show more
    Last updated: 30+ days ago • Promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data Annotation • Portland, Maine
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Systems Integration Analyst

    Systems Integration Analyst

    MaineHealth • Westbrook, ME, United States
    Full-time
    The Systems Integration Analyst role is responsible for the analysis and design of data flow across a variety of clinical, financial, and administrative systems. Responsible for creation of design d...Show more
    Last updated: 10 days ago • Promoted
    Certified Nursing Assistant (CNA) - Medical Surgical Telemetry (MS4)

    Certified Nursing Assistant (CNA) - Medical Surgical Telemetry (MS4)

    MaineHealth • Biddeford, ME, United States
    Full-time +1
    For a limited time MaineHealth is offering sign on bonuses for Certified Nursing Assistants (CNAs).Eligible candidates are hired (offer accepted) into a Full or Part time ANA / CNA position.Bonus amo...Show more
    Last updated: 30+ days ago • Promoted
    Tax Expert - Onsite

    Tax Expert - Onsite

    Intuit • Biddeford, ME, US
    Full-time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show more
    Last updated: 3 days ago • Promoted
    Product Manager - Enrichment

    Product Manager - Enrichment

    Relativity • Portland, ME, United States
    Full-time
    AtRelativity, we make software to help users organize data, discover the truth, and act on it.Our e-discovery platform is used by more than 13,000 organizations around the world to manage large vol...Show more
    Last updated: 30+ days ago • Promoted
    Systems Analyst

    Systems Analyst

    MaineHealth • Westbrook, ME, United States
    Full-time
    Come join our fast-paced ERP (Enterprise Resource Management) Team at MaineHealth.Our team is focused on implementing, maintaining, and supporting critical Enterprise solutions for MaineHealth incl...Show more
    Last updated: 17 days ago • Promoted
    Senior Financial Analyst - MHMG

    Senior Financial Analyst - MHMG

    MaineHealth • Kennebunk, ME, United States
    Full-time
    South Portland, Hybrid or fully remote work options.The Senior Financial Analyst - MHMG role manages specific assigned responsibilities as it relates to budgets, cost accounting, reimbursement and ...Show more
    Last updated: 17 days ago • Promoted
    Commercial Credit Analyst I

    Commercial Credit Analyst I

    Partners Bank • Sanford, ME, US
    Full-time
    Commercial Credit Department Manager.Full Time / Exempt / Onsite Only.Must already be authorized to work in the United States. Maine and New Hampshire that has established superior service level exp...Show more
    Last updated: 1 day ago • Promoted
    Epic Beaker Systems Analyst

    Epic Beaker Systems Analyst

    MaineHealth • Scarborough, ME, United States
    Full-time
    The Epic Beaker Systems Analyst role is accountable for the analysis, building, testing and implementation of computer systems in a healthcare setting. These systems include functionality to support...Show more
    Last updated: 11 days ago • Promoted
    Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

    Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

    Intuit • Biddeford, ME, US
    Full-time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show more
    Last updated: 3 days ago • Promoted
    Tax Expert - 2+ Yrs Paid Tax Experience Required

    Tax Expert - 2+ Yrs Paid Tax Experience Required

    Intuit • Lisbon, ME, US
    Full-time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show more
    Last updated: 3 days ago • Promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data Annotation • Portland, Maine
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data Annotation • Portland, Maine
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Associate Technical Training Analyst

    Associate Technical Training Analyst

    MaineHealth • Scarborough, ME, United States
    Full-time
    This role supports the delivery and ongoing improvement of training programs within Patient Access across the health system. The position partners with instructional designers, operational trainers ...Show more
    Last updated: 10 days ago • Promoted
    Tax Expert - Local

    Tax Expert - Local

    Intuit • Lisbon, ME, US
    Full-time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show more
    Last updated: 3 days ago • Promoted
    Senior Tax Professional - 2+ Yrs Paid Tax Experience Required

    Senior Tax Professional - 2+ Yrs Paid Tax Experience Required

    Intuit • Standish, ME, US
    Full-time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show more
    Last updated: 3 days ago • Promoted