Llm Tools Jobs in United States

evaluation: LLM-as-judge, benchmark design, agent harnesses, calibration, and understanding how to integrate them into professional settings Sound

Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.

Experience with human-in-the-loop review tools, or with fine-tuning and prompt optimization for production LLM features.

Familiarity with LLM APIs, embedding models, Hugging Face tools or plugins, OpenWebUI, and related AI application frameworks.

and non-tuning work like tool use and context engineering.

…build and lead our Internal Tooling team in San Francisco or New York City.

Familiarity with LLM observability and tracing tools.

Hands-on experience shipping LLM features to production: tool use, retrieval, and structured output.

Comfort learning tools and frameworks; experience with agent runtimes, model APIs, MCP, tracing, or evaluation tools is helpful.

…You'll Build Browser agent and tool-calling multi-agent systems.