Sr. Applied ML Engineer

At Memory Bridge, we’re tackling one of the hardest problems in AI: Large language models perfect memory while preserving user privacy.
We’re looking for an exceptional ML Engineer who sees beyond simple RAG tutorials and understands that building production-grade memory systems requires deep software engineering expertise first, ML knowledge second. You’ll architect and build the core retrieval engine that powers personalized AI experiences across conversations, privacy-aware filtering, and adaptive memory updates.
This is a rare opportunity to join our team as the founding ML engineer, where your code will directly shape how AI systems remember and learn. If you’re a strong programmer who has evolved into NLP/ML, we should talk.
About You

The ideal candidate has evolved from senior software development into NLP/ML, bringing the architectural thinking and code craftsmanship needed to tackle complex memory persistence, multi-tier retrieval, and real-time personalization challenges that separate production systems from proof-of-concepts.

You champion frequent deployments. You believe in shipping code regularly and improving through real-world feedback rather than seeking perfection.

You solve problems creatively. You tackle challenges with a can-do attitude, recognizing when to build new features versus strengthening foundations.

Key Responsibilities

Design and implement the core memory subsystem architecture, including storage tiers, retrieval pipelines, and privacy-aware filtering mechanisms

Build evaluation frameworks to measure memory retrieval quality, relevance scoring, and augmentation effectiveness with clear metrics and benchmarks

Implement sophisticated memory extraction and classification systems that identify, rank, and surface relevant user context from chat histories

Research and adapt cutting-edge memory architectures from academic papers and open-source implementations (e.g., MemGPT, Reflexion, cognitive architectures)

Architect the memory update pipeline that learns from user interactions, including relevance feedback, correction mechanisms, and adaptive privacy classification

Design hybrid search strategies that combine semantic embeddings with structured metadata, graph relationships, and temporal patterns for optimal memory retrieval

Collaborate with PM to define technical constraints and feasibility for memory system features

Takes ownership of production reliability for AI features—comfortable being on-call for prompt failures, extraction issues, or integration breakdowns

Understanding of AI system failure modes and fallback strategies—knows when to gracefully degrade vs. retry vs. escalate to human review

Requirements (Must-haves)

5+ years total experience, with at least 3 years in software engineering and 2 years building ML/NLP systems

Hands-on experience building LLM-powered systems with a focus on context management, memory persistence, or personalization features

Production experience with vector databases (Pinecone, Weaviate, Chroma) and hybrid search systems combining semantic and keyword search

Proven experience shipping LLM-powered features to production, with an understanding of prompt engineering, context window management, and API reliability patterns

Hands-on experience with LLM orchestration frameworks (LangChain, LangGraph, Mem0, MemGPT, Letta) for building complex AI workflows

Demonstrated ability to implement hybrid search systems combining dense vectors, sparse indices, and metadata filtering

Strong debugging skills for RAG pipelines, prompt reliability, extraction accuracy, and function calling/MCP integrations

Experience with agentic architectures, including tool calling, MCP (Model Context Protocol), and function orchestration for database access and external integrations

Experience with privacy-preserving ML techniques or building systems with strict data isolation requirements

Expert Python programming, plus working knowledge of JavaScript/TypeScript for API integration and JSON schema design for LLM tool definitions

Nice-to-Have Skills

You’re familiar with underlying technologies like transformer networks, attention mechanisms, and how they contribute to models’ abilities to generate coherent responses, function calls, and other language tasks

Experience with graph databases or knowledge graphs for representing user memory relationships

Familiarity with testing LLM applications—prompt regression tests, evaluation datasets, and A/B testing for AI features

Experience designing LLM-friendly APIs with structured outputs, streaming responses, and token usage optimization

Experience with experiment tracking and model versioning for memory/retrieval systems

Experience with privacy regulations (GDPR/CCPA) and implementing data deletion, consent management, or audit trails in ML systems

Background in recommendation systems or personalization engines

Contributions to open-source LLM/RAG projects or memory-related research

Master’s or PhD degree in physics, biology, CS, Electrical Engineering, etc., can be helpful but not required

Tech Stack & Tools

Core

Python – Primary language for ML/AI development

FastAPI – For building high-performance async APIs

Git/GitHub – Version control and collaboration workflow

GitHub Actions – Familiarity with CI/CD automation pipelines

JSON – Standard for structured data exchange and API contracts

Databases

Vector Databases – Pinecone, Weaviate, Chroma, Qdrant

PostgreSQL – Primary relational database for structured data

MongoDB – Document store for flexible, user-defined memory structures

AI/ML Frameworks

LLM Orchestration – LangChain, LangGraph, LlamaIndex, Haystack

Model Provider APIs – OpenAI, Anthropic, Cohere, and others

Nice to Have

Elasticsearch – Full-text search and log-based memory indexing

Docker – For local development and containerized deployment

How To Apply
At Memory Bridge, we believe that diverse perspectives and experiences make us better, which is why we have a non-standard application process designed to promote inclusion and equity. We’re looking for the best fit for each of our roles, regardless of the type of companies in your background, so we encourage you to apply even if your skills and experiences don’t exactly match the job description. All we ask is that you answer a few in-depth questions in our application that would typically be asked at the start of an interview process. This helps speed things up by letting us get to know you and your skillset a bit better right out of the gate. Please be sure to answer each question; the updated resume is essential.
Education is not a requirement for our roles; however, if you receive an offer, you will need to include your most recent educational experience as part of our background check process.
Memory Bridge is an equal-opportunity employer and we’re excited to work with talented and empathetic people of all identities. Memory Bridge does not discriminate based on someone’s identity in any aspect of hiring or employment, as required by law and in line with our commitment to Diversity, Inclusion, Belonging, and Equity. Our code of conduct provides a beacon for the kind of company we strive to be, and we celebrate our differences because those differences are what allow us to make a product that serves a global user base. Memory Bridge will consider all qualified applicants, including those with criminal histories, consistent with applicable laws.
The anticipated application window is 30 days from the date the job is posted, unless the number of applicants requires it to close sooner or later, or if the position is filled.
How We Work
We are a remote-native company, intentionally designed for deep work and focused execution. We hire the best minds, wherever they are, and empower them to solve some of the hardest problems in AI. Our culture thrives on asynchronous communication, radical transparency, and a commitment to sustainable performance—not burnout.
If you’re obsessed with solving the AI context problem and want to ship products that will redefine human-computer interaction, we want to hear from you.
Originally posted on Himalayas