Software Engineer Model Routing Inference Jobs in San Francisco, CA

About the Role As a Software Engineer on the Model Routing & Inference team at SpaceXAI, you'll build the inference

for OCR and multimodal models.

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

…the Role We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

…closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

…is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing

…We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams.

…Role You will build the model runtime within the inference engine that executes complex, frontier models at scale on OpenAI

…Technical Staff to join the Model Serving team at Cohere.

of the inference engine that powers Databricks Foundation Model API..

The engineers here design placement and load-balancing algorithms, build quantitative models of demand, capacity, and system performance, improve latency across

AI models Optimizing model serving infrastructure for high throughput and low latency at scale Developing and integrating advanced inference optimization

…directly with research scientists and engineers to make new visual models fast and efficient at inference time.

…Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference