Member Of Technical Staff Multimodal Pretraining Data Jobs

Experience with data mixtures, curricula, or scaling laws for data.

…learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.

…the post-training pipeline for our multimodal models end to end — from data strategy and reward modeling to preference optimization, distillation

…will work across the full pretraining stack, from large-scale data curation and mixture design to model architecture, scaling, distributed training, and evaluation

…and initiatives in voice and multimodal AI from problem definition through technical design, implementation, and launch.

…until you understand why this data breaks pretrained models.

…in results, and work with data researchers to detect training-data contamination.

Deep understanding of LLM or multimodal pretraining, including data pipelines, scaling behavior, and optimization.

RESPONSIBILITIES: Data Platform: Build the platform that turns raw web, code, multimodal, and acquired data into

Improve data quality for large-scale multimodal training by developing data filtering, curation, and synthetic data generation techniques.

…Research Engineer to join our Pretraining team, responsible for developing the next generation of large language models.

…foundational layer for visual intelligence: multimodal models trained jointly on

…will Train and fine-tune large-scale multimodal models (vision-language, audio, speech) from scratch and from pretrained