# Member of Technical Staff (Site Reliability Engineer, Crawler)

**Company:** [Perplexity](https://zerogtalent.com/ai-companies/perplexity)
**Location:** London
**Work mode:** On-site
**Seniority:** Senior
**Employment type:** Full Time
**Category:** Engineering
**Department:** Search
**Listed:** 2026-11-13

[View and apply on Zero G Talent](https://zerogtalent.com/ai-jobs/perplexity/member-of-technical-staff-site-reliability-engineer-crawler-190962f1-a955-4690-8025-6943dcbf063c)

## What you'll do

- Operate and optimize Kubernetes workloads for crawler services
- Build and maintain infrastructure as code and CI/CD pipelines
- Define SLOs and build monitoring, alerting, and observability
- Own capacity planning and diagnose queue backlogs and bottlenecks
- Lead incident response and turn postmortems into reliability improvements

## What you need

- 5+ yrs in SRE, production engineering, or infrastructure-heavy backend roles
- Strong programming skills in Python, C++, Rust, or Go
- Hands-on experience with production Kubernetes and Terraform
- Strong Linux and networking fundamentals including TCP/IP, DNS, TLS
- Experience with Datadog, Prometheus, or Grafana and SLOs

## Job description

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.

  

**Responsibilities**

-   Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
    
-   Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
    
-   Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
    
-   Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
    
-   Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
    
-   Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
    

  

**Qualifications**

-   5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
    
-   Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
    
-   Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
    
-   Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
    
-   Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
    

  

**Nice to have**

-   Experience operating web crawlers, search infrastructure, or browser fleets at scale.
    
-   Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.

## Other open roles at Perplexity

- [Member of Technical Staff (Web Access Engineer, Crawler)](https://zerogtalent.com/ai-jobs/perplexity/member-of-technical-staff-web-access-engineer-crawler-f32bb0d4-fb91-4fa6-8d7d-bd1a70ce2836) — London
- [Head of Marketing Operations](https://zerogtalent.com/ai-jobs/perplexity/head-of-marketing-operations-0ddf1b9a-9875-445c-a78f-f033d023a34a) — San Francisco
- [Growth GTM Engineer, Revenue Operations](https://zerogtalent.com/ai-jobs/perplexity/growth-gtm-engineer-revenue-operations-e916f0c8-5a31-4bb6-b4e3-7c4a64b95fda) — San Francisco
- [Lead Product Designer, Growth (Mobile)](https://zerogtalent.com/ai-jobs/perplexity/lead-product-designer-growth-mobile-14a45e74-9cde-4622-8172-1b6968810802) — San Francisco
- [Lead Product Designer, Mobile (Native & Mobile)](https://zerogtalent.com/ai-jobs/perplexity/lead-product-designer-mobile-native-mobile-1354f2e8-56c8-4a66-81f8-eb5d5b944506) — San Francisco

---
*Source: [Zero G Talent](https://zerogtalent.com), the job board for space, defense, AI, robotics and frontier-tech companies.*