Popular repositories Loading

1. LLM-Drop LLM-Drop Public

   The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".

   Python 191 23

2. Unified-MoE-Compression Unified-MoE-Compression Public

   The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".

   Python 89 6

3. Router-Tuning-Mixture-of-Depths Router-Tuning-Mixture-of-Depths Public

   The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for Enabling Dynamic Depth in Transformers. (EMNLP 2025)"

   Python 31 3

4. Capacity-Aware-MoE Capacity-Aware-MoE Public

   The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).

   Python 20 3

5. Pruning-on-Representations Pruning-on-Representations Public

   The official implementation of the paper "Demystifying When Pruning Works via Representation Hierarchies" (ICML 2026).

   Python 11 2

6. counterfactual_fairness_2025 counterfactual_fairness_2025 Public

   Python 8