How to optimize your AI token usage
repo-brain is an open-source tool that compresses an entire codebase into a single Markdown context file, achieving up to 96% compression and significantly reducing AI token usage. It supports static analysis, architecture analysis, semantic relationships, and multiple AI providers.
Article intelligence
Key points
- Compress entire codebase into a single Markdown context file to reduce AI token usage
- Achieved 96% compression on a 262-file repo (154,229 to 6,487 tokens)
- Supports Tree-sitter AST parsing, architecture analysis, and semantic relationship discovery
- Compatible with OpenAI, Claude, Gemini, and more; one-liner installers available
Why it matters
This matters because compress entire codebase into a single Markdown context file to reduce AI token usage.
Technical impact
May affect model selection, inference cost, product capability, and evaluation benchmarks.
Notifications You must be signed in to change notification settings
Fork 0
Star 0
repo-brain v1.0.0
Latest
Latest
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading. Please reload this page.
No results found
KrishivPiduri
released this
28 May 15:11
v1.0.0
b8552d4
Compress an entire codebase into a single markdown context file.
Feed it to any LLM once instead of re-reading your repo every conversation.
Achieved 96% compression on a 262-file repo (154,229 → 6,487 tokens).
What's included
Static analysis — Tree-sitter AST parsing for Python, JS, TS, Go, Rust;
regex fallback for Java, Ruby, C#, C/C++, Swift, Kotlin, Shell, and more
Architecture analysis — single LLM call identifies layers, components,
entry points, and data flow
Semantic relationships — LLM-discovered producer/consumer links,
shared data structures, parallel implementations, and polyglot bridges
Multi-provider support — OpenAI, Claude, Deepseek, Gemini, Groq, Ollama,
Mistral, xAI, Perplexity, OpenRouter
One-liner installers — no manual venv or config setup required
Install
Mac / Linux:
curl -fsSL https://github.com/KrishivPiduri/repo-brain/releases/latest/download/install.sh | bash
Windows (PowerShell):
irm https://github.com/KrishivPiduri/repo-brain/releases/latest/download/install.ps1 | iex
Assets
Upload these files to this release:
install.sh
install.ps1
repo-brain.zip (zip of: main.py, llm.py, ingest.py, analyze.py,
relationships.py, generate_prompt.py, mcp_server.py,
config.example.py, requirements.txt)