Popular repositories Loading

1. docs docs Public

   Forked from tensorflow/docs

   TensorFlow documentation

   Jupyter Notebook

2. mlx-lm mlx-lm Public

   Forked from ml-explore/mlx-lm

   Run LLMs with MLX

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

5. exllamav3 exllamav3 Public

   Forked from turboderp-org/exllamav3

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python

6. tabbyAPI tabbyAPI Public

   Forked from theroyallab/tabbyAPI

   The official API server for Exllama. OAI compatible, lightweight, and fast.

   Python