Alliance Health
Morrisville, NC
The AI Quality Engineer is responsible for ensuring the reliability, accuracy, and safety of AI-driven solutions from the earliest stages of development. This role is deeply integrated into the development lifecycle, focusing on building quality products by designing sophisticated evaluation frameworks for LLMs, agentic systems, and intelligent automation. The AI Quality Engineer ensures that AI models and AI Agents behave predictably, follow complex workflows, and meet the high standards required for clinical and operational healthcare environments.
This position is full-time hybrid. Selected candidate must come into the Home office in Morrisville on Wednesdays, for business meeting as needed, reside within 50 miles of Morrisville North Carolina.
Responsibilities & Duties
AI Evaluation & Framework Design
Design and implement scalable AI Quality Engineering strategies supporting LLM solutions, agentic systems, and enterprise AI platforms...