Member Of Technical Staff Pretraining Evaluations Jobs

Experience evaluating checkpoints during pretraining or mid-training.

Develop evaluation frameworks and internal benchmarks to measure pretraining progress and model capability.

As a Member of Technical Staff in our Evals and Post-training team, you’ll build the evaluation and measurement systems that tell us how good AI (including

…understand why this data breaks pretrained models.

The role As a Member of Technical Staff focused on Machine Learning, you will ship models, training infrastructure, harnesses

Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.

…the performance of Hark's Megatron-based pretraining systems across thousands of GPUs.

Contributions to open-source evaluation frameworks or public benchmarks.

…the large-scale RL and agent evaluation platforms that enable Perplexity to train state-of-the-art models and optimize agent harnesses.

Sound technical judgment in balancing task quality, latency, reliability, and cost, with a track record of translating evaluation findings into shipped

…Research Engineer to join our Pretraining team, responsible for developing the next generation of large language models.