Inference Jobs in San Francisco, CA

…the performance of our AI inference systems.

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

…We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

Responsibilities Build inference services with smart batching and caching Optimize kernels, tokenization

…speculative execution, or other efficient inference techniques.

You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization

…vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.

Own the developer experience around inference.

Qualifications CUDA + GPU inference optimization vLLM, SGLang, or TensorRT-LLM experience KV caching, paged attention, batching

…into the complexities of distributed inference, compiler-aware optimization, and novel inference-time computation strategies

About the Role Anthropic's inference fleet serves Claude to millions of users across our own products and the world's largest

The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities.

across a rapidly evolving inference stack.

…into the complexities of distributed inference, compiler-aware optimization, and novel inference-time computation strategies

Shape the core inference backbone that powers Together AI’s frontier models.