Llm Evaluation Jobs

Experience evaluating technology choices for future hardware or software architectures.

Our work spans efficient LLM training and inference, parallel and diffusion-based generation, sparsity, scaling laws, and training dynamics.

Build and maintain evaluation pipelines to measure model performance across tasks and domains.

Serve as a GenAI/LLM expert across the company – owning best practices for architecture, safety, evaluation, and deployment.

Systematically train, tune, and evaluate models to guide/advise production scenarios.

…integration of foundation models ( LLMs

…and drive adoption of rigorous evaluation methodologies.

Write clear design documents, evaluate technical tradeoffs, break projects into deliverable milestones, and coordinate implementation with a small group

Experience writing model quality evaluations and system prompt harnesses.

…building workload replay tools, ML evaluation pipelines, or MLPerf Inference benchmark suites.

…AI roadmap, including agentic workflows, LLM integrations, RAG architectures, and AI infrastructure.

…AI roadmap, including agentic workflows, LLM integrations, RAG architectures, and AI infrastructure.

…AI roadmap, including agentic workflows, LLM integrations, RAG architectures, and AI infrastructure.

AI platform evaluation and production reliability • Evaluate models, agent frameworks, connectors and enterprise platforms through structured proofs

Experience applying AI/LLM tooling to engineering workflows or developer productivity.