Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
-
Updated
Sep 21, 2023 - Java
Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
A virtual filesystem for Crystal: unify directories and archives into a single tree with compression, encryption, and chunked storage.
Fast content-defined chunking in Go.
Content-addressed delivery for game updates, assets, and engine packs — smaller downloads, persistent cache reuse, and byte-identical reconstruction.
Streaming Content-Defined Chunking (CDC) using FastCDC algorithm with modernized API, support sync and async I/O. Prioritizes correctness, determinism, and composability. Flexible async backend support such as Tokio, async-std, and smol ect.
A memory-safe, Rust-based version control system that uses a private blockchain to ensure absolute data sovereignty and an immutable audit trail. Optimized for large binary assets with FastCDC, it offers granular file-level permissions for mission-critical corporate environments.
Smart Storage for Your Builds
Fast, encrypted, deduplicating backup tool written in Rust.
Find (partial content) duplicate files.
Print FastCDC rolling hash chunks and checksums.
A high-performance FastCDC 2020 implementation written in Python + Cython
Ship a search index to a device as signed, content-addressed bundles: fail-closed Ed25519 verification, FastCDC chunking so the next release downloads only the chunks that changed, then FAISS + BM25 rank fusion locally. Python. 309 tests, 98% coverage.
Megh - Zero-Knowledge Encrypted Cloud Storage. Source-available under BSL 1.1.
Parallel implementation of DumbVersion's patch format, now with ZSTD
A FUSE-based filesystem implementing content-defined chunking and deduplication in Rust.
Professional-grade 3D asset manager built in Rust. Bypasses physical I/O limits via FastCDC deduplication. Reclaim 60% storage.
Add a description, image, and links to the fastcdc topic page so that developers can more easily learn about it.
To associate your repository with the fastcdc topic, visit your repo's landing page and select "manage topics."