Latency Optimization Jobs in San Francisco, CA

Explore algorithmic optimizations including quantization, sparsity, caching, compilation, attention optimizations, and alternative execution strategies

Explain what the requests did, how load was distributed, the hardware and resource limits, latency and error rates, and which changes you owned.

Influence architecture and design decisions to prioritize latency, throughput, and efficiency at scale.

The Inference System Dynamics team is responsible for understanding that whole system and holding it to a high bar across four dimensions: throughput, latency

What You Will Do Optimize inference and serving end to end — latency, throughput, batching, caching, and scheduling —

Work on cross-cutting RL considerations such as EDA-tool latency optimization and proxy rewards. Conduct experiments and shape our roadmap.

A significant portion of this work will involve designing and optimizing kernels for the TPU.

A proven track record shipping real-time systems operating under tight latency, power, and memory constraints.

As a Performance Engineer, you'll be responsible for identifying these problems, and then developing systems that optimize the throughput and robustness of our largest

Design resilient, low-latency networking solutions to manage data communication between autonomous vehicles operating in the field and distributed cloud

Improve latency, throughput, availability, and network efficiency through measurement, testing, and careful production rollouts.

Build benchmarks and tools to measure performance, validate correctness, and guide optimization work.

We identify, triage, and resolve the bottlenecks that limit what our fleets can deliver – from contact scheduling and downlink latency, to collection capacity, to

Caching & Latency Optimization — Build caching infrastructure that keeps EHR API latency out of critical user paths.

• You understand real-time media, WebRTC, and latency budgets.