Skip to content
@FasterDecoding

FasterDecoding

Think deeper, decode faster

Pinned Loading

  1. Medusa Medusa Public

    Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

    Jupyter Notebook 2.8k 205

Repositories

Showing 5 of 5 repositories
  • REST Public

    REST: Retrieval-Based Speculative Decoding, NAACL 2024

    FasterDecoding/REST's past year of commit activity
    C 220 Apache-2.0 17 15 0 Updated Mar 5, 2026
  • SnapKV Public
    FasterDecoding/SnapKV's past year of commit activity
    Python 333 Apache-2.0 35 18 1 Updated Jul 10, 2025
  • TEAL Public
    FasterDecoding/TEAL's past year of commit activity
    Python 170 MIT 16 6 1 Updated Feb 15, 2025
  • BitDelta Public
    FasterDecoding/BitDelta's past year of commit activity
    Jupyter Notebook 206 Apache-2.0 16 3 1 Updated Dec 5, 2024
  • Medusa Public

    Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

    FasterDecoding/Medusa's past year of commit activity
    Jupyter Notebook 2,771 Apache-2.0 205 51 6 Updated Jun 25, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…