Skip to content
#

weight-quantization

Star

Here are 3 public repositories matching this topic...

Henvezz95 / VAR-Compressor

Star 5

W4A4 and INT8 KV-cache quantization for Infinity VAR models. Optimized for high-fidelity generative AI deployment on edge GPUs (e.g. NVIDIA Jetson).

computer-vision pytorch gpu-acceleration quantization model-compression nvidia-jetson inference-optimization edge-ai on-device-ml weight-quantization post-training-quantization autoregressive-models generative-ai kv-cache-quantization activation-quantization visual-autoregressive-model svdquant infinity-var
  • Updated Jun 11, 2026
  • Python

JohnScheuer / quantization-impact-analyzer

Star 0

Analyzes per-layer quantization sensitivity in GPT-2 across 9 quantization configs (INT8/INT6/INT5/INT4/INT3/INT2 with group-wise and per-tensor). Key findings: INT8-g32 achieves 1.8x compression with +0.13 perplexity; group-wise quantization reduces INT4 degradation by 99%; mlp_proj layers dominate sensitivity.

python compression gpu transformers inference pytorch quantization int8 mixed-precision gpt2 weight-quantization int4 llm
  • Updated Jul 10, 2026
  • Python

Improve this page

Add a description, image, and links to the weight-quantization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the weight-quantization topic, visit your repo's landing page and select "manage topics."

Learn more