Ceph Infrastructure Engineer

Palantir Technologies•London, ENG EC1A, GB• Full Time

Posted 11 months ago• Operations

Job Description

A World-Changing Company

Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.

The Role

Join the Substrate Edge Team at Palantir, where we are responsible for mission-critical production infrastructure — encompassing hundreds of Kubernetes clusters across on-premises deployments, from large data centres to small-footprint edge devices. We are now seeking a Senior Infrastructure Engineer with specialised experience in Ceph to boost the scale and reliability of our ruggedised Kubernetes offerings under novel operating constraints.

If you are passionate about infrastructure at scale, have a deep understanding of Ceph, and are eager to engage with the broader open-source community, we encourage you to apply for this exciting opportunity.

As a Senior Infrastructure Engineer, you will leverage your expertise in Ceph to manage and optimise storage solutions at scale, ensuring seamless integration with our Kubernetes infrastructure. You will play a key role in automating hundreds of deployments of Ceph clusters on heterogeneous hardware, and making core contributions to the broader Ceph and CNCF communities.

Core Responsibilities

Manage Ceph at Scale: Design, deploy, and maintain Ceph storage solutions across diverse hardware environments, ensuring high availability and performance under challenging constraints.

Automate Deployments: Develop and implement automation strategies for managing multiple Ceph deployments, reducing manual intervention and enhancing operational efficiency using world-class tooling.

Innovate and Contribute: Drive the adoption of novel features and tools within the Ceph and CNCF ecosystems, contributing upstream as necessary to improve the broader community.

Engage with Communities: Actively participate in the Ceph developer community and the CNCF, sharing insights and collaborating on open-source projects.

Infrastructure Excellence: Collaborate with the team to design and build the next generation of Palantir’s infrastructure, focusing on systems that are scalable, stable, and secure.

What We Value

Ceph & Rook Expertise: Practical, hands-on experience managing Ceph storage solutions, with a deep understanding of its architecture and operational nuances, ideally using Rook.

Automation Proficiency: Strong skills in infrastructure automation tools such as Terraform, Kubernetes Operators, and with coding proficiency in Go, Java, or equivalent.

Systems Programming: Experience in systems programming with proficiency in Go, Rust, C/C++, or equivalent languages.

Hardware and OS Knowledge: Deep familiarity with hardware configurations, operating systems, and diagnostic tools.

Networking Fundamentals: Solid understanding of networking principles, with experience in CNIs or cloud networking infrastructure preferred.

On-premises Data Centre Experience: Experience working with on-premises hardware, or as sysadmin/SRE in data centres.

What We Require

Professional Experience: 4+ years of software development experience focused on core infrastructure with an emphasis on operational excellence.

System Design Expertise: 2+ years of experience in system design or architecture, including reliability and scaling of new and existing systems.

SRE / Operational Experience: 1+ year of being operationally responsible for production-grade Ceph clusters.

Educational Background: Bachelor’s degree in Computer Science or equivalent practical experience.

Life at Palantir

We want every Palantirian to achieve their best outcomes, that’s why we celebrate individuals’ strengths, skills, and interests, from your first interview to your longterm growth, rather than rely on traditional career ladders. Paying attention to the needs of our community enables us to optimize our opportunities to grow and helps ensure many pathways to success at Palantir. Promoting health and well-being across all areas of Palantirians’ lives is just one of the ways we’re investing in our community. Learn more at Life at Palantir and note that our offerings may vary by region.

In keeping consistent with Palantir’s values and culture, we believe employees are “better together” and in-person work affords the opportunity for more creative outcomes. Therefore, we encourage employees to work from our offices to foster connectivity and innovation. Many teams do offer hybrid options (WFH a day or two a week), allowing our employees to strike the right trade-off for their personal productivity. Based on business need, there are a few roles that allow for “Remote” work on an exceptional basis. If you are applying for one of these roles, you must work from the city and or country in which you are employed. If the posting is specified as Onsite, you are required to work from an office.

If you want to empower the world's most important institutions, you belong here. Palantir values excellence regardless of background. We are committed to making the application and hiring process accessible to everyone and will provide a reasonable accommodation for those living with a disability. If you need an accommodation for the application or hiring process, please reach out and let us know how we can help.