Job Description

Figure is an AI robotics company developing autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. Figure is headquartered in San Jose, CA.

Figure's vision is to deploy autonomous humanoids at a global scale. Our Helix team is looking for an experienced Training Infrastructure Engineer to take our infrastructure to the next level. This role is focused on managing the training cluster, implementing distributed training algorithms, data loaders, and developer tools for AI researchers.

Responsibilities

Design, deploy, and maintain Figure's training clusters
Architect, optimize, and maintain scalable deep learning frameworks for training on massive robot datasets
Work together with AI researchers to implement training of new model architectures at a large scale
Implement distributed training, advanced parallelization strategies, and high-performance data loaders to reduce model development cycles
Profile, identify, and eliminate training bottlenecks at the hardware and software levels to maximize Model FLOPs Utilization (MFU)
Implement tooling for data processing, model experimentation, and continuous integration

Requirements

Strong software engineering fundamentals
Bachelor's or Master's degree in Computer Science, Robotics, Engineering, or a related field
Extensive professional experience with Python and PyTorch
Proven track record of scaling and running large-scale training experiments personally on 800+ GPUs
Experience managing HPC clusters for deep neural network training
Minimum of 4 years of professional, full-time experience building reliable backend systems and infrastructure

Bonus Qualifications

Experience contributing to or maintaining open-source distributed training frameworks (Megatron-LM, DeepSpeed, TorchTitan)
Experience managing cloud infrastructure (AWS, Azure, GCP)
Experience with job scheduling / orchestration tools (SLURM, Kubernetes, LSF, etc.)
Experience with configuration management tools (Ansible, Terraform, Puppet, Chef, etc.)
Deep understanding of CUDA and hands-on experience writing custom GPU kernels to optimize training

The US base salary range for this full-time position is between $200,000 - $400,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

Optimize Your Resume for This Job

Get a match score and see exactly which keywords you're missing

Optimize Resume

Ready to Apply?

This will take you to the Figure AI application page

Apply on Figure AI

About Figure AI

Figure AI is developing a general-purpose humanoid robot, Figure 02, designed to address labor shortages and perform tasks in environments built for humans. Backed by leading investors including Microsoft, OpenAI, and Jeff Bezos, they are building commercially viable autonomous humanoid robots.

Helix AI Engineer, Training Infrastructure

Job Description

Optimize Your Resume for This Job

Ready to Apply?

Job Details

About Figure AI

More Roles at Figure AI

Similar Operations Roles

See full Operations compensation at Figure AI