Age | Commit message (Collapse) | Author | |
---|---|---|---|
2021-09-22 | fix findSimilarChunk max is not updated | n-peugnet | |
2021-09-21 | store file listing incrementally | n-peugnet | |
2021-09-21 | define name of gob registered structs | n-peugnet | |
also store uncompressed delta for now and add wrapper parameter | |||
2021-09-21 | fix recipe diff deepequal replaces everything... | n-peugnet | |
...by hydrating the chunks in loadRecipes instead of in restoreStream. Otherwise repo is not set in r.recipe chunks. Also added a generic loadDeltas for future use in loadFileLists | |||
2021-09-21 | fix same delta chunk is not found on second commit | n-peugnet | |
2021-09-21 | store recipes incrementally | n-peugnet | |
2021-09-20 | store recipe compressed | n-peugnet | |
for now using zlib on a 556Mo dir: recipe: 11668558 o -> 5540831 o size divided by 2 | |||
2021-09-20 | remove errored files from fileList | n-peugnet | |
and add tests with non existing link | |||
2021-09-20 | store fileList compressed | n-peugnet | |
for now using zlib on a 556Mo dir: files: 1469447 o -> 207289 o size divided by 7 | |||
2021-09-20 | less noisy file read errors | n-peugnet | |
2021-09-15 | add storeWorker and use it to store chunk content and hashes | n-peugnet | |
2021-09-14 | perf: move hash parallelism from sketch to repo | n-peugnet | |
2021-09-14 | fix error with link should not cause panic | n-peugnet | |
2021-09-14 | close some unclosed files | n-peugnet | |
try to consistently fix windows tests | |||
2021-09-14 | add load/store sketches+fingerprints & store them | n-peugnet | |
Fix corresponding Commit tests by adding sketches and fingerprints files in repo_8k and repo_8k_zlib. Also enhance CommitTests by checking recipe files | |||
2021-09-14 | logger add panic + colors & remove ln variants & use it | n-peugnet | |
2021-09-13 | fix loadChunks by using cache instead of reading file | n-peugnet | |
This way there is only one place where we read chunks and where the read/write wrapper is used. This also allows to remove LoadedChunk as it is not used anymore. | |||
2021-09-13 | close opened files in loadChunkContent and Restore | n-peugnet | |
to try to fix tests on windows | |||
2021-09-13 | fix for windows, use filepath instead of path | n-peugnet | |
2021-09-13 | fix golint ci errors | n-peugnet | |
2021-09-13 | add read write wrappers to compress chunks' content | n-peugnet | |
2021-09-10 | use moare the reader interface | n-peugnet | |
2021-09-09 | better commit and restore tests (almost complete) | n-peugnet | |
added some file path management function for prfixes and trailing slash | |||
2021-09-09 | first add of restore function to Repo | n-peugnet | |
2021-09-09 | fix matchStream: encode prev if exists in epilogue | n-peugnet | |
2021-09-09 | remove merge and extract tempchunks | n-peugnet | |
2021-09-09 | move unused functions from repo to repo_test | n-peugnet | |
2021-09-09 | export sketch in its own package | n-peugnet | |
so that tests can be cached and to make sure it is independant of the rest of the code also move tests in testdata as this folder is ignored by go test by default | |||
2021-09-08 | start using chunk cache | n-peugnet | |
2021-09-08 | add cache and start using it in repo | n-peugnet | |
2021-09-07 | fix matchStream did not store first chunk | n-peugnet | |
2021-09-07 | prepare for recipe encoding by exporting fileds | n-peugnet | |
2021-09-06 | initial chunk storage | n-peugnet | |
2021-09-06 | fixes: chunk id starts from 0 & nil check | n-peugnet | |
2021-09-06 | generate new Polynomial only once | n-peugnet | |
2021-09-02 | hash and store chunks left by matchStream | n-peugnet | |
2021-09-02 | move maps inside repo | n-peugnet | |
2021-09-02 | find similar chunks while matching stream | n-peugnet | |
2021-09-01 | Prepare for delta encoding | n-peugnet | |
2021-09-01 | move some consts into repo | n-peugnet | |
2021-08-31 | split extractTempChunks into 2 funcs | n-peugnet | |
2021-08-31 | fix matchStream if first chunk is not matched | n-peugnet | |
2021-08-31 | join too small temp chunks with previous one if possible | n-peugnet | |
2021-08-31 | do not fill partial cunks with padding | n-peugnet | |
this way a partial chunk may have less superfeatures than a complete one | |||
2021-08-30 | make sketch parameters global vars | n-peugnet | |
2021-08-30 | fix: matchStream returned incorrect nrw chunk data | n-peugnet | |
2021-08-30 | fix: last partial chunk is not added to recipe | n-peugnet | |
2021-08-30 | fix: chunkId added multiple times for same superFeature | n-peugnet | |
2021-08-30 | better diff test | n-peugnet | |
2021-08-30 | findSimilarChunk returns an Id if found | n-peugnet | |