# Cloud Inference Engineer

**Company:** [Luminal](https://zerogtalent.com/ai-companies/luminal)
**Location:** San Francisco, CA, US
**Work mode:** On-site
**Seniority:** Entry
**Employment type:** Full Time
**Salary:** USD 150K–250K/yr
**Category:** Engineering
**Department:** Engineering
**Listed:** 2026-03-24

[View and apply on Zero G Talent](https://zerogtalent.com/ai-jobs/luminal/cloud-inference-engineer-83575)

## Job description

### Qualifications

-   CUDA + GPU inference optimization
-   vLLM, SGLang, or TensorRT-LLM experience
-   KV caching, paged attention, batching, token streaming, etc.
-   Distributed compute (with GPUs is a super plus)
-   No degree required

### Company

Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line.

### Role

Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.

Day to day responsibilities:

-   Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
-   Conducting model performance reviews
-   Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
-   Sometimes write kernels and, yes, occasional tasteful shitposting

## Other open roles at Luminal

- [Head of Growth](https://zerogtalent.com/ai-jobs/luminal/head-of-growth-120828) — San Francisco, CA, US
- [Founding Kernel Engineer](https://zerogtalent.com/ai-jobs/luminal/founding-kernel-engineer-120827) — San Francisco, CA, US
- [Senior Compiler Engineer](https://zerogtalent.com/ai-jobs/luminal/senior-compiler-engineer-94688) — San Francisco, CA, US
- [Compiler Engineer](https://zerogtalent.com/ai-jobs/luminal/compiler-engineer-80694) — San Francisco, CA, US

---
*Source: [Zero G Talent](https://zerogtalent.com), the job board for space, defense, AI, robotics and frontier-tech companies.*
