Staff Software Engineer Inference Jobs in San Francisco, CA

We are looking for Members of Technical Staff to join the Model Serving team at Cohere.

We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises, YC startups, public investment firms, and growth-stage

About the Role We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

P-1285 About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization

Every breakthrough demands innovations on the inference engine itself.

Qualifications 3+ years of professional software engineering experience with meaningful work on ML inference or high-performance

We collaborate closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

or ML experience is not required Have significant software engineering experience, with a strong background in high-performance, large-scale distributed

our core inference platform forward.