Remote Engineer Evals Agent Quality Jobs

You'll work at the intersection of ML engineering, observability, and quality assurance to ensure our agents meet the rigorous standards our customers demand.

If you are the kind of product marketer who runs your own demos, can hold your own with an engineer on evals and guardrails, and can turn that fluency into compelling

This is a role for engineers who've built advanced agents that do actual work , not just a thin wrapper around an LLM.

Position Overview As a Senior Backend Engineer - Agents at Nebulock, you will work on the agent infrastructure

As our next Seller Customer Experience Agent, you’ll bring a seller's perspective and a service mindset.

Check out the latest Whatnot updates on our news and engineering blogs

Own agent quality: create eval infrastructure, monitor regressions, and ensure that agents improves with every release.

Unblock product engineers building on the harness, pair on extensions, and review agent-adjacent designs.

error messages agents can act on Attention to AEO (answer engine optimization): make sure agents find and recommend PlanetScale Build and maintain

Responsibilities Define and own the roadmap for North's agent harness, including the agent loop, context engineering

Build evals and benchmarks that run real coding agents against real integration tasks.

We want someone who's done it and has the scars: an API an agent can drive, an MCP server, evals, docs written for a machine. Side projects count.

The role As a Product Engineer at Asendia, you'll build the AI agents that are the product, the voice interviewers that

You won’t just be building features — you’ll be co-designing the processes and systems that define how we ship high-quality AI products at Crux.

Deep familiarity with LLM-based product development , prompt engineering , multi-agent orchestration