GEN AI Engineer

Job Title : GEN AI Engineer

Location : Charlotte, NC (onsite)

Job Type : Full time

Job Description

Must Have Technical / Functional Skills

o Bachelors or Masters degree in Data Science, Computer Science, MIS ,related field, or equivalanet experience

o 10+ yrs of experience designing and developing AI solution architecture to scale

o Proven Hands-on experience in GenAI Ops-Operationalizing LLM and RAG applications in production

o Strong hands-on experience with the Langchain framework

o Experience specifically with the Open AI API, chat completions, embeddings,etc

o Have a solid awareness on TensorRT and VLLM implementation.

o Strong proficiency in python and data Science libraries(NumPy,Pandas,scikit-learn,PyTorch / TensorFlow)

o Proven experience applying guardrails and observability to LLM or RAG-powered applications.

o Experience with LLMs as Judges and SMLs for evaluation (attribution,adherence, bias, PII, etc)

o Hands-on experience with OpenShift(or Kubernetes) for containerized AL workloads.

o Experience measuring and optimizing inference latency.

Roles & Responsibilities

o Implement Guardrails and observability across RAG and LLM applications

o Setup GenAI Ops workflows to continuously monitor inference latency, throughput, quality and safety metrics.

o Define,track,and analyze RAG guardrail metrics using LLMs as Judges and SMLs(e.g. attribution, grounding,prompt injection,tone,PII leekage)

o Implement annotation,structured feedback loops,fine-tuning, and alignment methods to calibrate judge models

o Use langchain to orchestrate guardrail checks, manage prompt versioning and integrate judge model scoring workflows.

o Work with Openshift to deploy,scale and monitor containerized genAI services.

o Build observability dashboards and alerts(Grafana or equivalent) for AI reliability.

o Contribute to emerging evaluation and guardrails as autonomous AI workflows expand.