Skip to content

Add claude-distill: first-principles memory, A/B tested (+6pts vs vanilla)#280

Open
tomacco wants to merge 1 commit into
jqueryscript:mainfrom
tomacco:add-distill-v2
Open

Add claude-distill: first-principles memory, A/B tested (+6pts vs vanilla)#280
tomacco wants to merge 1 commit into
jqueryscript:mainfrom
tomacco:add-distill-v2

Conversation

@tomacco
Copy link
Copy Markdown

@tomacco tomacco commented May 15, 2026

What

claude-distill — a /distill slash command that teaches Claude Code principles, not just facts.

Why it belongs here

Every memory tool in this list stores observations: "user prefers X." claude-distill stores principles: "never retry permanent failures — applies to any pooled resource, any service." Then it pushes back when you're about to violate what it learned.

A/B tested against vanilla Claude (full results):

  • User asks to retry HTTP 404s → vanilla complies silently. distill refuses and explains why.
  • User follows outdated deploy procedure → vanilla helps execute the wrong plan. distill catches it in 355 characters.
  • User queries another service's DB → vanilla writes the SQL. distill cites the architecture principle and gives alternatives.

Average improvement: +6.0 on a 12-point scale across 5 scenarios.

Technical details

  • Zero dependencies. No MCP server, no database, no Node.js.
  • Entire retrieval system: ~/.claude/rules/distill.md (18 lines). Uses Claude Code's native rules/ directory.
  • Knowledge markers: [UPDATED], [CONTEXT], [NON-NEGOTIABLE], [PROVISIONAL]
  • Sub-agent architecture: distillation runs in isolated context, never consumes your session.
  • Interactive demo (try typing claude in the terminal)

Placement

Added to Tools & Utilities section after existing memory/context tools. One line, no disruption.

Diff

+1 line
-0 lines

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant