Inference Optimization Engineer Jobs

Evaluate new inference runtimes, compilers, frameworks, optimization techniques, and accelerator hardware.

About the Role Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing

About the Role We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

Optimize inference performance.

Qualifications CUDA + GPU inference optimization vLLM, SGLang, or TensorRT-LLM experience KV caching, paged attention, batching

SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING) The application software team is the central nervous system of SpaceX – we

inference team.

AI models Optimizing model serving infrastructure for high throughput and low latency at scale Developing and integrating advanced inference optimization

data centers and model engine pods.

About the Team We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams.

Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments is highly encouraged but not strictly necessary.

This role sits in the Inference team within the company’s Model team and partners closely with Model, Infrastructure, and Application engineering.

As a Software Engineer, Training/Inference (C++), you will design and optimize large-scale model serving systems end-to-end.