Staff Software Engineer Inference Api Jobs in San Francisco, CA

…looking for Members of Technical Staff to join the Model Serving team at Cohere.

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

…on each cloud platform, from API integration and intelligent request routing to inference execution, capacity management,

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

of the inference engine that powers Databricks Foundation Model API..

…is seeking an exceptional Senior Staff Software Engineer to join the Claude Developer

…on each cloud platform, from API integration and intelligent request routing to inference execution, capacity management,

Qualifications 3+ years of professional software engineering experience with meaningful work on ML inference or high-performance

…closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

…breakthrough demands innovations on the inference engine itself.

…We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams.