
Founding MTS
Equity offered; details discussed individually.About Litmus
At Litmus, we’re building evals for humans and redefining how talent is evaluated. Teams like Mercor, Wispr, Composio, Neo Scholars, Astranis, and more are already using Litmus to build their technical teams.
Every company in the world will soon be powered by neo-humans (agent assisted people). But building evals to measure neo-human performance is unexplored and difficult. It requires systematically benchmarking neo-human capabilities and failure modes across all sectors of knowledge work, developing reproducible environments that test neo-human performance on complex tasks, and designing causal attribution frameworks over execution trajectories to identify and validate reproducible action sequences and decision patterns that lead to successful outcomes.
At Litmus, we’re solving this problem. We deliver hiring insights to companies by capturing how candidates use tools, reason, and make decisions in their interviews, giving agentic graders the evidence to evaluate candidate skillset and predict job performance.
The role
We're building a founding engineering team with complementary strengths across infrastructure, product engineering, and AI research. Depending on your expertise, your work could involve:
Platform & infrastructure
- Architect, build, and scale reliable infrastructure that powers our hiring and evaluation platform
- Own technical decisions across distributed systems and platform infrastructure, supporting high-throughput workloads
Product engineering
- Own product features end-to-end, from technical design through deployment and iteration
- Work closely with engineering and talent leaders at frontier technical teams and turn recurring customer needs into reusable platform capabilities
AI evaluation & research infrastructure
- Design RL environments, evaluation rubrics, and reward signals that expose meaningful limits in neo-human systems.
- Develop experiment orchestration and tracking systems for reproducible evaluations across humans and agents.
- Build meta-optimization systems that use evaluation results, human and agent trajectories, and failure analysis to iteratively improve evaluation design.
What we’re looking for
Required qualifications
- Proficiency in Python, JavaScript/TypeScript, or Node.js.
- A track record of building, shipping, and operating production systems OR experience in an early stage team
- Ability to break down ambiguous problems and move quickly from ideas to execution
- Strong independent judgment, with a willingness to challenge assumptions and take ownership of decisions
- Ability to learn quickly, incorporate feedback, and improve based on evidence
High signals
- Ex-founder
- Experience operating distributed systems, cloud infrastructure (AWS/GCP), or serverless architectures
- Experience building high-throughput data pipelines and distributed data processing systems
- Experience with production-quality ML training, evaluation, or research infrastructure
- Hands-on experience with reinforcement learning, LLM fine-tuning, or post-training
You’ll work directly alongside the founders, shaping product and technical direction. If you have deep expertise in one or more of these areas and are passionate about the mission, you’d be a good fit at Litmus.
Optimize your resume for this job
Get a match score and the keywords you're missing
About Litmus
Litmus is the most accurate read on how an engineer actually builds. We evaluate candidates through async technical assessments built from your own tech context (repos, tickets, and job descriptions), generated from scratch and scoped as real end-to-end features. Candidates work in their own setup with all their tools including AI, while we track and evaluate their process and output. Every submission runs in a sandbox, and grading is tuned to your company across tool fluency, process, and outcome. You get a real read on how someone actually builds, not just how they interview.
Similar roles


