Job Role : Senior AI QE Engineer
Location : West Palm Beach, Florida (Onsite)
Client : Florida Power & Light Company
Job ID : 4799 – 2 positions
Visa Status – US Green Card or Citizen
Job Description : Role Summary
We are looking for a Senior AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.
Core Experience
- 6–10 years as a Software Engineer, SDET, or Automation Engineer.
- Strong coding skills in Python, TypeScript, or Java.
- Hands-on experience developing automation scripts, tools, or frameworks.
- Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.
- Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.
- Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).
AI / ML Technologies
Practical experience with AI / ML frameworks :LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.Experience with ML / DL libraries such as :Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.Ability to work with embeddings, similarity search, and content evaluation metrics.GenAI & AI Agent Development
Ability to integrate or build GenAI components, including RAG pipelines or agent-based workflows.Support model evaluation tasks such as :Output quality checksHallucination detectionPrompt validationRegression checks for model updatesAutomation & Quality Engineering
Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.Ability to design and execute automated tests for :FunctionalIntegrationAPIBasic performance & reliability testingHands-on experience testing RESTful APIs and building automated API suites.Cloud, DevOps & CI / CD
Exposure to deploying AI or automation solutions on AWS.Working knowledge of CI / CD pipelines, including :Automated testingModel validation stepsVersioning & artifact management