Member Of Technical Staff Inference Jobs

Written widely-shared technical blogs or side projects on vLLM or LLM inference.

Written widely-shared technical blogs or side projects on vLLM or LLM inference.

our core inference platform forward.

Low-precision inference: INT8/FP8/FP4 quantization, mixed-precision serving.

We are looking for an AI Inference Engineer to join our growing team.

Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking

As a Staff Software Engineer on our Inference team, you will work end to end, identifying and addressing key infrastructure blockers to

inference team.

Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking

), or a track record of getting deep in an unfamiliar technical domain quickly.

Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking

This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services

We are looking for Members of Technical Staff to join the Model Serving team at Cohere.

Some of the problems we are facing are genuinely hard: detecting whether a PDF was forged or edited, inferring latent financial profiles from messy payment data,