Pinned Loading

1. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 128k 22.9k

2. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python

5. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

6. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 165k 34.5k