# Member of Technical Staff (Evals)

**Company:** [Jarmin](https://zerogtalent.com/frontier-companies/jarmin)
**Location:** San Francisco, CA, US
**Work mode:** On-site
**Seniority:** Mid
**Employment type:** Full Time
**Salary:** USD 200K–300K/yr
**Category:** Engineering
**Department:** Engineering
**Listed:** 2026-08-17

[View and apply on Zero G Talent](https://zerogtalent.com/frontier-jobs/jarmin/member-of-technical-staff-evals-104832)

## Job description

As a Member of Technical Staff on Evals, you'll own how we measure AI Employee performance on the job.

**Areas you may work in:**

-   Evaluation systems: datasets, offline replay, scorers, and regression alerts
-   Feedback loops for models and agents
-   Autonomous failure analysis
-   Defining what good, degraded, and failed runs look like, and alerting on them

**You may be a good fit if you:**

-   Have built evaluation or measurement systems, such as AI evals, experimentation, ranking, or search quality
-   Can turn ambiguous quality questions into concrete metrics and decisions
-   Have strong software engineering fundamentals and ship production systems
-   Are comfortable where there are few established patterns
-   Want to work in person in San Francisco

**Even better:**

-   You've shipped LLM systems to production and learned where they break
-   You have strong data instincts and work well with researchers
-   You contribute to open source projects

## Other open roles at Jarmin

- [Founding Sales - Account Executive](https://zerogtalent.com/frontier-jobs/jarmin/founding-sales-account-executive-109580) — San Francisco, CA, US / Remote (US)
- [Member of Technical Staff](https://zerogtalent.com/frontier-jobs/jarmin/member-of-technical-staff-108288) — San Francisco, CA, US
- [Member of Technical Staff (Models)](https://zerogtalent.com/frontier-jobs/jarmin/member-of-technical-staff-models-104833) — San Francisco, CA, US
- [Member of Technical Staff (Agents)](https://zerogtalent.com/frontier-jobs/jarmin/member-of-technical-staff-agents-104830) — San Francisco, CA, US
- [Member of Technical Staff (Agent Infrastructure)](https://zerogtalent.com/frontier-jobs/jarmin/member-of-technical-staff-agent-infrastructure-104829) — San Francisco, CA, US

---
*Source: [Zero G Talent](https://zerogtalent.com), the job board for space, defense, AI, robotics and frontier-tech companies.*
