Skip to content
@shallowbyte

shallowbyte

Popular repositories Loading

  1. parmar parmar Public

    Subword-tokenization pre-filter for byte-level compressors, and the harness that tested it. +7-9.6% over raw bytes on LZMA2; the gap widens with corpus size then plateaus at the dictionary window. …

    Python 3

Repositories

Showing 1 of 1 repositories
  • parmar Public

    Subword-tokenization pre-filter for byte-level compressors, and the harness that tested it. +7-9.6% over raw bytes on LZMA2; the gap widens with corpus size then plateaus at the dictionary window. 452 matrix cells on PG-19 (64MB-4GB), all sha256 round-trip verified.

    shallowbyte/parmar's past year of commit activity
    Python 3 Apache-2.0 0 0 0 Updated Aug 17, 2026

Top languages

Loading…

Most used topics

Loading…