Token cost is a design problem, not a billing problem. Most LLM cost overruns come from architectural waste, not model pricing. This tool is a token waste profiler that helps you understand where your tokens are going and which ones are useless.
- High-Performance Codebase: Built using
Pythonand modern engineering principles. - Modular & Scalable Design: Structured directory tree for seamless development and deployment.
- Core Language:
Python - Libraries & Tools: Python
- Deployment Infrastructure: Vercel Edge / Cloud Services
tokenlens/
├── .github
├── .github/ISSUE_TEMPLATE
├── .github/ISSUE_TEMPLATE/bug_report.md
├── .github/ISSUE_TEMPLATE/feature_request.md
├── .github/PULL_REQUEST_TEMPLATE.md
├── .github/workflows
├── .github/workflows/ci.yml
├── .gitignore
├── CODE_OF_CONDUCT.md
├── CONTRIBUTING.md
├── LICENSE
├── README.md
├── analyzer.py
├── cli.py
├── examples
└── ... [additional codebase files]
- Python 3.9+
- pip package manager
-
Clone the repository:
git clone https://github.com/Tarunjit45/tokenlens.git cd tokenlens -
Install dependencies:
pip install -r requirements.txt
-
Execute application:
python main.py
Architected & Developed by Tarunjit Biswas.
Distributed under the MIT License.