AI Product Engineering
03Relevant memory injection

Selective Memory Retrieval

Selective memory is partly about better responses, but it is also about showing which pieces of context actually mattered.

After making memory visible and editable, the next question was how much of that memory should be sent with each request.

For this version, I experimented with retrieving only the memories that seem relevant to the current prompt instead of passing the user's entire history every time.

That matters for quality, but it also matters for trust. If an answer feels personal, the interface should make it possible to see which pieces of personal context were actually used.

The prototype uses embedding-based retrieval to find context-relevant memories and inject them into the request. The retrieved memories are shown in the UI and can be removed one at a time.

The prototype improves in two practical ways: the responses use more relevant context, and the system is easier to inspect.

human-AI prototype showing retrieved memories used to shape a response.