Inference Jobs in United States

…the performance of our AI inference systems.

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers

…We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models

Responsibilities Build inference services with smart batching and caching Optimize kernels, tokenization

…speculative execution, or other efficient inference techniques.

…dedicated to helping evolve our Inference APIs to enable a state of the art inference stack.

…Manager, you will work with inference providers to support the adoption and growth of Mistral AI models

SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING) The application software team is the central nervous system of SpaceX – we

…to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services

You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization

…vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.

Own the developer experience around inference.

…quantization and numerics in LLM inference and training Experience in developing inference engines, e.g.