Staff Tech Lead Ml Data Infrastructure Inference Platform Jobs

The ML Data Infrastructure and Inference Platform team owns the Data as well as the Data infrastructure for all ML Flywheels at Waymo.

Maintain an in-house ML inference platform to serve large language models efficiently.

…the Role We're hiring a Staff Engineer to help lead, drive, and contribute to projects on our Inference Platform team.

Maintain an in-house ML inference platform to serve large language models efficiently.

About the role: The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers

You'll lead a strong group of ML platform, infrastructure, and distributed-systems engineers working alongside the teams that build our ML internals and

…be building and optimizing the platform to enable our next generation LLM training, inference and data curation.

…work is a mix of data and ML infrastructure, model development and evaluation, and internal tools used by partner teams.

As a tech lead manager, you’ll also manage a small team of Product Data Scientists, setting their agenda and raising the bar for how data shapes product decisions

…allows Cerebras to deliver industry- leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services

Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect, scheduling constraints

Our inference platform already serves production traffic at scale.

…of Claude on each cloud platform, from API integration and intelligent request routing to inference execution, capacity management,

You will: Lead the design and development of ML infrastructure that takes DUE models from data to training to production serving

Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect, scheduling constraints