AI Cost Optimisation Gateway MVP

via Freelancer ·

Budget / Salary$5,000–10,000
TypeFreelance project
LocationRemote
Posted1 hour ago
I need an experienced backend engineer to build a pilot-ready MVP of an AI cost-optimisation gateway for UK companies, built on LiteLLM. It sits between clients’ apps and OpenAI, Anthropic and Google to cut AI costs and protect personal data.

Stack: LiteLLM (single gateway) with Python hooks, TypeScript/NestJS services, Next.js dashboards, PostgreSQL, Redis, Docker, AWS London (two availability zones).

Scope: per-client keys, budgets and spend tracking; PII masking with Presidio plus UK detectors (NI, NHS with checksum, postcodes); exact and semantic caching isolated per client; retries and backup models; savings ledger with shadow-mode baseline; basic batch API routing, cache-hit diagnostics and spend-spike alerts; dashboard and monthly savings statement; audit log, tests and docs.

Fixed-price milestones paid on acceptance tests, code in my company GitHub from day one. Target: pilot-ready by mid-December.

Please share a gateway or proxy project you’ve built (not just a chatbot) and your experience with LiteLLM, Presidio and AWS. Nice to have: UK GDPR awareness and experience with provider batch APIs and prompt caching. Shortlisted candidates sign a short NDA before seeing the full brief, and the best one or two may do a small paid trial (the UK PII detectors). Please include your price per milestone, weekly availability and start date. Weekly progress updates expected.
python amazon web services poster design node.js redis typescript docker api development next.js large language models (llms)
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.