Remote Inference Optimization Engineer Jobs

Strong engineering skills in GPU programming and inference optimization (e.g., CUDA, Triton, TensorRT, or serving frameworks such as vLLM or SGLang

open source and commercial CV inference engine, keeping it healthy and high-quality as contribution volume scales.

Every breakthrough demands innovations on the inference engine itself.

Track pareto-optimality across models and hardware configurations.

ABOUT THE ROLE You’ll be working in the compute team focusing on GPU workload scheduling and inference serving optimization.

Role Summary We have an opening to hire a Staff Software Engineer - Agent Optimization Temporal provides a reliable

What you'll be doing: Build and own the model serving infrastructure, real-time inference, feature retrieval, and the

Minimum Requirements 5+ years of relevant experience in machine learning engineering, data engineering,

Overview The Advertiser Optimization team is the decision-making engine of Instacart's $1B+ ads business.

Learning Engineer I, Economist (post-PhD industry experience).

Learning Engineer I, Economist (post-PhD industry experience).

Low-level inference optimization, from speculative decoding, quantization, KV-cache and memory management Work directly with customers to

and inference, optimizing performance, and advancing agentic AI workflows that accelerate scientific discovery.

We have a lab, and we also power our own models in our own proprietary inference environment.

We have a lab, and we also power our own models in our own proprietary inference environment.