Agent Evaluation Engineer Jobs in San Francisco, CA

Hands-on experience building, evaluating, or improving LLM-based applications or agents, including tool use and multi-step workflows.

You’ll work on the Agent SDK — the orchestration engine, runtime, and primitives that define how agents reason, take actions, and interact with users and systems

…Tech Lead Manager of AI Evaluations, you will lead a team of applied AI scientists and engineers and build the evaluation strategy and

Coval is the evaluation platform for conversational AI: we help enterprise teams simulate, monitor and improve voice and chat agents before those agents ever reach

…more relevant areas, such as agent harnesses, tool use, context engineering, model evaluation, browser automation,

We're seeking a Senior Software Engineer to build the AI agents patients actually talk to.

…all in one place, alongside agents that carry the load with them.

criteria, while protecting evaluators' ability to publish their own conclusions Scope evaluations with researchers and engineers, turning evaluators' questions

Turn compliance rules into agent-ready logic.

This foundation powers Glean’s agentic capabilities - AI agents that automate real work across teams by accessing the industry’s broadest range of data: enterprise

Perplexity is seeking an Engineering Manager to lead and grow our highly driven Agent Engine team.