AI Agent Evaluation Engineer Jobs

Hands-on experience building, evaluating, or improving LLM-based applications or agents, including tool use and multi-step workflows.

Coval is the evaluation platform for conversational AI: we help enterprise teams simulate, monitor and improve voice and chat agents before those agents ever reach

coding agents and language models: benchmark datasets, agent evaluation runs at scale, and automated task quality checks.

When an agent reaches a permission boundary, a separate model evaluates the proposed action in context and determines whether it should proceed.

You will own the engineering strategy and execution for production systems that evaluate agent behavior, identify risk, and take appropriate action without creating

and mid-level engineers on production-grade agentic engineering.

We're seeking a Senior Software Engineer to build the AI agents patients actually talk to.

We’re looking for research engineers who can build reliable data and evaluation systems, question what a metric actually tells us, and work closely with researchers

…all in one place, alongside agents that carry the load with them.

We’re looking for research engineers who can build reliable data and evaluation systems, question what a metric actually tells us, and work closely with researchers

…include applied AI or ML engineering, forward-deployed engineering, software engineering, customer engineering, solutions architecture,