Software discovery is shifting away from traditional search engines toward autonomous reasoning models and coding agents. When tools like Claude Code or Codex select an API or vendor to run an automated workflow, they bypass corporate marketing copy and search engine optimization. Instead, these models search the web for rigorous performance data to determine which endpoints actually work. Openbenchmarks builds the evaluation infrastructure to run independent, reproducible tests on these developer tools and sells private analytics so vendors can see where they fall short.
The San Francisco-based company, backed by Y Combinator's Fall 2024 batch, operates with a four-person team and is now recruiting engineers, communicators, and go-to-market operators across the United States and India to expand its automated testing suites.
The Shift From Search Engine Optimization to Agent Benchmarks
Traditional B2B software relies heavily on content marketing and SEO to capture human attention. Autonomous agents, however, evaluate vendors differently. In a demonstration published on YouTube, the team demonstrated how a coding agent searching for company data APIs filters through web search results, rejects pure marketing blogs, and selects APIs backed by open benchmarks that measure precision across thousands of queries.
Openbenchmarks produces public, standardized benchmarks that evaluate developer tools, APIs, and infrastructure. Autonomous agents consult these public evaluations when recommending integrations or executing workflows. To help vendors adapt, Openbenchmarks provides private analytics and benchmarking tools. Companies use the platform to diagnose where their performance lags behind competitors, improve their endpoints, and win selection from AI agents.
Technical Backgrounds in Cloud Systems and Agentic AI
Openbenchmarks was founded in 2024 by Fenil Suchak and Aditya Lahiri.
CEO Fenil Suchak spent four years working across cloud and AI infrastructure. His background includes scaling Oracle's 23ai Cloud Database across Google Cloud Platform, Microsoft Azure, and Amazon Web Services. Earlier in his career, Suchak built and sold educational software directly to offline language classes in India.
CTO Aditya Lahiri focuses on agent architectures and machine learning systems. He previously built machine learning models at American Express AI Labs, conducted graduate research on the controlled generation of multimodal models, and engineered autonomous leasing agents in the property technology sector. Both founders previously worked together on OpenFunnel, developing personalized agents triggered by real-time intent signals across the web.
Building Autonomous Testing Pipelines and Data Reports
To expand its evaluation coverage, Openbenchmarks is hiring across engineering, data storytelling, and go-to-market functions in both San Francisco and India.
On the technical side, the company is looking for a Founding Engineer (AI + Backend) in San Francisco ($100,000–$120,000) and a remote Founding Engineer (AI + Backend) - Remote, India (₹4,000,000–₹4,500,000). Both roles require designing domain-specific benchmarks and building the autonomous infrastructure needed to execute evaluations at scale.
Turning benchmark raw data into verifiable findings is central to the product's adoption. Openbenchmarks is hiring a Benchmarks Storyteller in San Francisco ($100,000–$150,000) and a remote Benchmarks Storyteller ($30,000–$37,000). These hires will produce technical reports, data visualizations, and communications generated by the evaluation infrastructure, upholding statistical rigor to make sure all published benchmarks are reproducible.
For commercial distribution, the startup lists an onsite Founding GTM in the United States ($100,000–$150,000) and a remote Founding GTM role based in India ($30,000–$37,000). Both positions analyze benchmark outputs to spot failure modes, performance trends, and vendor trade-offs, packaging those insights for human engineers and autonomous agents.
Open Roles at Openbenchmarks
| Role | Location | Work Mode | Salary |
|---|---|---|---|
| Founding Engineer (AI + Backend) - Remote, India | IN / Remote (IN) | Remote | ₹4,000,000 – ₹4,500,000 |
| Benchmarks Storyteller | Remote | Remote | $30,000 – $37,000 |
| Benchmarks Storyteller | San Francisco, CA, US | Onsite | $100,000 – $150,000 |
| Founding GTM | US | Onsite | $100,000 – $150,000 |
| Founding GTM | IN / Remote (IN) | Remote | $30,000 – $37,000 |
| Founding Engineer (AI + Backend) | San Francisco, CA, US | Onsite | $100,000 – $120,000 |



