Senior Software Engineer (Agentic Search) - Web Access Engineer
Posted1 day ago
About Tavily
We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.
We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.
The Role
We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.
In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.
Your responsibilities will include:
Research and analyse how modern websites communicate with browsers across the complete request lifecycle
Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access
Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation
Translate technical research into production systems operating at internet scale
Requirements
You have 5+ years of experience as a software engineer working on production backend or infrastructure systems, and are an expert in several of the following areas:
Browser Technologies
Chromium architecture and browser internals
Browser lifecycle and navigation
Chrome DevTools Protocol (CDP)
Playwright, Puppeteer, Selenium, or similar browser automation frameworks
Browser instrumentation and debugging
Web Platform
HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking
Cookies, browser storage, caching, redirects, and session management
JavaScript execution and modern client-side rendering
Resource loading, page lifecycle, and browser networking
Browser fingerprinting concepts and browser characteristics
Nice to Have
Experience working on browser engines or browser infrastructure
Experience reverse engineering browser or web application behaviour
Experience building internet-scale distributed systems
Go, C++, Rust, or Python
Kubernetes and cloud infrastructure
We conduct coding interviews as part of the process.
Why Tavily?
Full ownership — small team, you own the entire infrastructure, not a slice of it
Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests
AI-native company — your infra directly powers AI agents used by leading companies in the space.
Find more English Speaking Jobs in United Kingdom on Arbeitnow
We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.
We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.
The Role
We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.
In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.
Your responsibilities will include:
Research and analyse how modern websites communicate with browsers across the complete request lifecycle
Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access
Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation
Translate technical research into production systems operating at internet scale
Requirements
You have 5+ years of experience as a software engineer working on production backend or infrastructure systems, and are an expert in several of the following areas:
Browser Technologies
Chromium architecture and browser internals
Browser lifecycle and navigation
Chrome DevTools Protocol (CDP)
Playwright, Puppeteer, Selenium, or similar browser automation frameworks
Browser instrumentation and debugging
Web Platform
HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking
Cookies, browser storage, caching, redirects, and session management
JavaScript execution and modern client-side rendering
Resource loading, page lifecycle, and browser networking
Browser fingerprinting concepts and browser characteristics
Nice to Have
Experience working on browser engines or browser infrastructure
Experience reverse engineering browser or web application behaviour
Experience building internet-scale distributed systems
Go, C++, Rust, or Python
Kubernetes and cloud infrastructure
We conduct coding interviews as part of the process.
Why Tavily?
Full ownership — small team, you own the entire infrastructure, not a slice of it
Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests
AI-native company — your infra directly powers AI agents used by leading companies in the space.
Find more English Speaking Jobs in United Kingdom on Arbeitnow
Apply on Arbeitnow →
Job sourced from Arbeitnow. Applications happen directly on the original platform — we never collect your data.