Pinned Loading

1. hyper-attn-nano hyper-attn-nano Public

   A minimal proof-of-concept decoder-only language model with per-head learnable curvature in hyperbolic attention.

   Python 1

2. freq-weight-compression freq-weight-compression Public

   An experiment testing whether the weight matrices of GPT-2 can be compressed in the frequency domain using the 2D Fast Fourier Transform (2D FFT).

   Python

3. track-analyst track-analyst Public

   Timestamped structural analysis of a music file for scene and edit planning.

   Python

4. udon-reference udon-reference Public

   A collection of Udon and UdonSharp reference information sourced from the SDK and Community docs.

   1

5. non-euclidean-geometry-llms non-euclidean-geometry-llms Public

   Experiments in Non-Euclidean Geometry for Language Models

   Python

6. novel-llm-architectures novel-llm-architectures Public

   This repository documents a seven-round investigation into whether alternative computational geometries can improve upon the standard dot-product attention mechanism used in transformer language mo…

   Python