Staff Sr Software Engineer Cloud Inference Jobs in San Francisco, CA

…product of Claude on each cloud platform, from API integration and intelligent request routing to inference execution, capacity management,

Within Cloud Inference, the model & inference launch team owns the validation pipeline for our inference server and load balancer on these platforms.

…looking for Members of Technical Staff to join the Model Serving team at Cohere.

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented

Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented, with

We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

…closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

…About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization

Our exabyte-scale, multi-cloud storage infrastructure underpins training, CI, sandboxing, inference, warehousing, and long-term data retention.

fastest LLM inference engine with state-of-the-art GPU cloud infrastructure.

Make the engineers around you better through design review and mentoring Use AI tools as a regular part of how you design, build, and review software

Role Overview As a Staff Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing

…common work, you’ll let product engineers focus on shipping features rather than re-inventing the wheel.