Senior Software Engineer Inference Jobs in San Francisco, CA

We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises, YC startups, public investment firms, and growth-stage

About the Role We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

We’re hiring a Senior Software Engineer with real industry experience, someone who has built and maintained production systems, seen them break, and knows

About the Role As a Senior SWE you’ll play a key role in engineering decisions, working closely with the founders and focus on questions

What you'll do You would be one of the first engineering hires, working directly with the founders—Full-stack IC work: We work in

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

Shape the core inference backbone that powers Together AI’s frontier models.

Inference engine. The software between the accelerator kernels and the routing layer that serves every request.

About the Team We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams.

Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.