Skip to content

Repository files navigation

🚀 tokenlens

Language License Status

📌 Overview

Token cost is a design problem, not a billing problem. Most LLM cost overruns come from architectural waste, not model pricing. This tool is a token waste profiler that helps you understand where your tokens are going and which ones are useless.

✨ Key Features & Architecture

  • High-Performance Codebase: Built using Python and modern engineering principles.
  • Modular & Scalable Design: Structured directory tree for seamless development and deployment.

🛠️ Tech Stack & Dependencies

  • Core Language: Python
  • Libraries & Tools: Python
  • Deployment Infrastructure: Vercel Edge / Cloud Services

📁 Architecture & File Layout

tokenlens/
├── .github
├── .github/ISSUE_TEMPLATE
├── .github/ISSUE_TEMPLATE/bug_report.md
├── .github/ISSUE_TEMPLATE/feature_request.md
├── .github/PULL_REQUEST_TEMPLATE.md
├── .github/workflows
├── .github/workflows/ci.yml
├── .gitignore
├── CODE_OF_CONDUCT.md
├── CONTRIBUTING.md
├── LICENSE
├── README.md
├── analyzer.py
├── cli.py
├── examples
└── ... [additional codebase files]

🚀 Quickstart & Installation

Prerequisites

  • Python 3.9+
  • pip package manager

Setup Instructions

  1. Clone the repository:

    git clone https://github.com/Tarunjit45/tokenlens.git
    cd tokenlens
  2. Install dependencies:

    pip install -r requirements.txt
  3. Execute application:

    python main.py

📜 Author & License

Architected & Developed by Tarunjit Biswas.
Distributed under the MIT License.

About

Token cost is a design problem, not a billing problem. Most LLM cost overruns come from architectural waste, not model pricing. This tool is a token waste profiler that helps you understand where your tokens are going and which ones are useless.

Topics

Resources

Code of conduct

Contributing

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages