diff options
author | n-peugnet <n.peugnet@free.fr> | 2021-09-02 17:48:23 +0200 |
---|---|---|
committer | n-peugnet <n.peugnet@free.fr> | 2021-09-02 17:48:23 +0200 |
commit | d9703a9daa05f30e77bb99393eab8a0d40e788e4 (patch) | |
tree | 813f08947ad0958dd3c42f7db62bd39fe6430bbf /TODO.md | |
parent | 2a048d5d8b2b25326685ba53fc390781ba96deed (diff) | |
download | dna-backup-d9703a9daa05f30e77bb99393eab8a0d40e788e4.tar.gz dna-backup-d9703a9daa05f30e77bb99393eab8a0d40e788e4.zip |
hash and store chunks left by matchStream
Diffstat (limited to 'TODO.md')
-rw-r--r-- | TODO.md | 18 |
1 files changed, 9 insertions, 9 deletions
@@ -1,7 +1,7 @@ priority 1 ---------- -- add deltaEncode chunks function - - do not merge consecutive smaller chunks as these could be stored as chunks if no similar chunk is found. Thus it will need to be of `chunkSize` or less. Otherwise it could not be possibly used for deduplication. +- [x] add deltaEncode chunks function + - [x] do not merge consecutive smaller chunks as these could be stored as chunks if no similar chunk is found. Thus it will need to be of `chunkSize` or less. Otherwise it could not be possibly used for deduplication. ``` for each new chunk: find similar in sketchMap @@ -12,13 +12,13 @@ priority 1 store in fingerprintMap store in sketchMap ``` -- read from repo - - store recipe - - load recipe - - read chunks in-order into a stream -- properly store informations to be DNA encoded +- [ ] read from repo + - [ ] store recipe + - [ ] load recipe + - [ ] read chunks in-order into a stream +- [ ] properly store informations to be DNA encoded priority 2 ---------- -- use more the `Reader` API (which is analoguous to the `IOStream` in Java) -- refactor matchStream as right now it is quite complex +- [ ] use more the `Reader` API (which is analoguous to the `IOStream` in Java) +- [ ] refactor matchStream as right now it is quite complex |