Anupam Choudhari The Workbench

Context Passport

Your context, owned by you, handed to each AI tool in slices.

October 2026 Concept 4 minute read

Try the prototype →

The itch

Every AI tool meets you as a stranger. The planner knows how you think about roadmaps, the editor knows your conventions, the drafting tool knows you hate the word “leverage”, and none of them talk to each other. Vendors are fixing this by remembering you inside their own walls. The better shape is a passport: one document you own, stamped by the tools that have read it, handed over in slices. It keeps itself current as you work, so there’s no queue at the passport office to renew it.

How it works

1COLLECTwhere your context already livesAI chatsClaude, ChatGPTpushCoding agentCursorpushDocs and notesNotion, Google Docspull, dailyEmailGmailpull, dailyHand-writtenphoto or screenshotupload2FILTERWorth keeping?a small model decidesno: droppedyesAlready known?matched against the storenew: add itsame: refresh its datechangedYou reviewchanges and private bitsapproved3KEEPThe passportyours, local-first: one page per topicWho I amHow I workWhat I'm buildingPreferencesPrivateeach fact keeps its source and the date it was last confirmed4HAND OVERPrivate never leavesScope ruleswho may read which pageHandoverover MCP, on requestAgents that ask, andthe pages each one getsCoding agentCursorHow I workWhat I'm buildingResearch agentPerplexityWho I amWhat I'm buildingRecruiter agenta hiring botWho I amHow I workChat assistantClaude, ChatGPTEverything exceptPrivate
Context comes in from wherever it already lives, gets filtered before it is kept, and goes out one slice per agent. AI chats sit at both ends: they create context and they use it.

Design decisions

The store

OptionGood atWeak at
Markdown files in gitReadable, portable, every change has a historySearch beyond keywords
SQLite (full-text plus a vector extension)One local file, fast search by keyword and by meaningNot something you’d open and read
Vector databaseSimilarity search at scaleOverkill for one person; facts become opaque chunks
GraphRelationships between people, projects and factsHeavy to model and keep tidy

The pick: Markdown is the source of truth, one file per page. SQLite is an index rebuilt from those files, so it can be thrown away and regenerated any time. Retrieval checks scope first and similarity second, so a page an agent isn’t allowed never reaches the search at all.

Intake

DecisionThe callPriority
AuthOAuth per source, read-only scopes, tokens kept on the deviceMust
Push or pullAgents push at the end of a session over MCP; docs and email get pulledMust
How often to pullOnce a day in a batchMust
Worth keeping?A small model separates lasting facts from passing chatter, and raw text is dropped once checkedMust
Already recorded?Match by meaning against the page. Same fact refreshes its date; a changed fact goes to review, with the old version keptMust
Webhooks instead of pollingGmail push and Notion webhooks, so changes arrive within minutesShould
Hand-written notesA photo or screenshot goes through a vision model, then the same filterShould
Auto-acceptSkip review above a confidence threshold, so the queue stays shortShould
Contradictions across sourcesFlag when two sources disagree about the same factCould
Real-time captureEvery message, as it happensWon’t
Keeping raw documentsOnly extracted facts are stored, never the email or doc itselfWon’t
Writing back to sourcesThe passport reads from your tools; it never edits themWon’t

Under the hood

  • MCP as the handover. The passport runs as an MCP server, so any tool that speaks the protocol asks for context instead of being pasted into.
  • A small model for intake. Filtering and matching are cheap, narrow jobs, which makes them a good test of how far a small, fast model goes before a frontier one is needed.

Where it goes

The personal version is a concept. The bigger version of the same idea is being built for the enterprise: an organisation’s AI context, scattered across tools and teams, brought together into one shared knowledge layer.