Skip to content

Backup files without unnecessary copies #108

Description

@christoph-maurer

Measurement data can have multiple GigaByte and it usually does not change. Do not store multiple copies of the same files as backup. Use a content-addressable store or file system or a file system with similar functionality, for example, btrfs with cp --reflink=always ..., OpenZFS with copy-on-write clones, or the content-addressed composefs. A low-tech solution may use simple SHA-256 or SHA-3 hashes with symlinks into a directory with only content-addressed files whose names are but their hash value. And another solution may be using Git LFS or git-annex without a remote.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

2601ISEFraunhofer Institute for Solar Energy Systems ISE

Type

No type

Projects

  • Status
    ✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions