Benchmarks Jobs in United States

public benchmark project.

The bar is a benchmark report a skeptical researcher can't poke holes in.

Integrate new models, agents, and benchmarks in a way that generalizes, without a special case for each one.

Design and build benchmarks and evaluation methods that measure LLM capabilities in both text and multimodal modalities.

Experience identifying benchmark contamination, saturation, or gaps between benchmark scores and the intended capability.

…analysis, risk-adjusted positioning, and competitive benchmarking

Build and maintain capability benchmarks like our Legal Agent Benchmark (LAB), along with product-focused evals that track how models perform on

Experience detecting benchmark contamination and removing overlapping examples from training data.

What You'll Do Frontier benchmarks and evaluation Identify high-impact gaps in existing benchmark and evaluation

Build and maintain capability benchmarks like our Legal Agent Benchmark (LAB), along with product-focused evals that track how models perform on