Grants Token Jobs

Centralize secrets management - keys, tokens, certificates - across cloud and enterprise environments.

Optimize streaming behavior, time to first token, request latency, throughput, batching, serialization, tokenization, scheduling, and communication between

Track critical serving metrics including Time-to-First-Token (TTFT), Inter-Token Latency (ITL), request throughput, tail latency (P99), and capacity efficiency.

Depending on your background, your work may emphasize runtime capabilities such as token orchestration, scheduling, communication, and distributed execution

Profile and optimize time to first token, request throughput, tokens per second per GPU, tail latency, GPU utilization, memory efficiency, and rack-level

Experience reducing time to first token (TTFT) and tail latency is a strong plus.

Evaluate emerging techniques in areas such as parallel token generation, diffusion and speculative decoding, attention, sparsity, mixture-of-experts