Llm Orchestration Jobs

Our work spans efficient LLM training and inference, parallel and diffusion-based generation, sparsity, scaling laws, and training dynamics.

…on agentic flows and current LLM model family architectures. Understanding of model compilers and optimization.

orchestration frameworks.

…and support production AI agents, orchestration services

…using containers, Kubernetes or comparable orchestration systems, and CI/CD.

orchestration frameworks.

…with microservices deployment, debugging, and orchestration at scale.

orchestration frameworks.

…including emerging optimizations for AI/ LLM search.

Experience applying AI/LLM tooling to engineering workflows or developer productivity.

…Linux, containers, Kubernetes or comparable orchestration systems, CI/CD, and operating latency-sensitive services in production.

…vLLM, SGLang, PyTorch, Triton, TensorRT- LLM, or another open-source ML systems project.

Orchestration & Networking: Strong proficiency with container orchestration tools (e.g., Kubernetes, Slurm, Ray) and high-performance cluster

Familiarity with containers, cluster orchestration, cloud infrastructure, CI/CD, or high-performance computing.

…vLLM, SGLang, PyTorch, Triton, TensorRT- LLM, or another open-source ML systems project.