Staff Sr Software Engineer Cloud Inference Launch Engineering Jobs in San Francisco, CA

Within Cloud Inference, the model & inference launch team owns the validation pipeline for our inference server and load balancer on these platforms.

…product of Claude on each cloud platform, from API integration and intelligent request routing to inference execution, capacity management,

…is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented, with

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

…closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

…About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization

Our exabyte-scale, multi-cloud storage infrastructure underpins training, CI, sandboxing, inference, warehousing, and long-term data retention.

A software-engineering mindset first: you write and ship production code, and you think about GPU infrastructure as software to be engineered, not a fleet

You’ll also own our engineering platform, improving how engineers build, test, deploy, and operate software through better tooling and developer experience

…Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference

…and go-to-market partners, including non- engineers Make the engineers around you better through

fastest LLM inference engine with state-of-the-art GPU cloud infrastructure.