Llm Serving Jobs in United States

Requirements • Hands-on LLM fine-tuning and post-training, with strong Python and PyTorch or JAX and practical distributed-training experience.

evaluation systems, including LLM-as-judge, human preference, and task-specific benchmarks Experience serving and optimizing open-weight models

Build and tune serving systems using SGLang, vLLM, NVIDIA Dynamo, TensorRT-LLM, or comparable frameworks.

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare

You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization

The impact you'll have: Evaluate ML and LLM approaches for CustomerLake's personalization use cases, push the models and

Experience with model-serving frameworks or systems such as vLLM, Triton Inference Server or similar technologies.

Shipped an LLM-based support or operations agent in production and understand the trust, escalation, and quality-measurement problems that come with it

Nice to Have Experience at a leading LLM model lab, AI inference provider, or developer-first AI infrastructure

Client Relationship Management: Serve as the primary contact for clients with a prescriptive and consultative approach and serving as a thought partner

Client Relationship Management: Serve as the primary contact for clients with a prescriptive and consultative approach and serving as a thought partner