Remote Software Engineer Model Routing Inference Jobs

open source and commercial CV inference engine, keeping it healthy and high-quality as contribution volume scales.

…intelligent: automated evaluations, prompt optimization, model routing, and

Software Engineer We build the infrastructure that frontier AI labs use to evaluate coding agents and language models:

Strong engineering skills in GPU programming and inference optimization (e.g., CUDA, Triton, TensorRT, or serving frameworks such as vLLM or SGLang

…the Role We're hiring a Software Engineer on our Platform team to own and scale the systems that route and serve millions

…pipelines and feature datasets feeding model training and inference.

This is hands-on, software-first, systems engineering work.

The product is sovereign, self-serve inference: a mid-market or enterprise buyer picks a model, a region and a GPU size, and is running the same afternoon with no

…will also collaborate with data engineering to build datasets that are used to train machine learning models.

control plane to speed up model deployment and inference request serving Collaborate with research to improve research velocity continuously

As a Senior/Staff Software Engineer, you will: Evolve and scale the backend systems that power Model Vault, including

…substrate: GPU capacity, training and inference pipelines, and the reliability and cost of the systems serving models

Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrough demands innovations on the inference engine itself.

This role is ideal for engineers who love autonomy, value collaboration, and have a track record of shipping software that works.

…for We’re hiring for mid-stage software engineers.