aboutsummaryrefslogtreecommitdiff
path: root/repo.go
AgeCommit message (Collapse)Author
2021-09-22fix findSimilarChunk max is not updatedn-peugnet
2021-09-21store file listing incrementallyn-peugnet
2021-09-21define name of gob registered structsn-peugnet
also store uncompressed delta for now and add wrapper parameter
2021-09-21fix recipe diff deepequal replaces everything...n-peugnet
...by hydrating the chunks in loadRecipes instead of in restoreStream. Otherwise repo is not set in r.recipe chunks. Also added a generic loadDeltas for future use in loadFileLists
2021-09-21fix same delta chunk is not found on second commitn-peugnet
2021-09-21store recipes incrementallyn-peugnet
2021-09-20store recipe compressedn-peugnet
for now using zlib on a 556Mo dir: recipe: 11668558 o -> 5540831 o size divided by 2
2021-09-20remove errored files from fileListn-peugnet
and add tests with non existing link
2021-09-20store fileList compressedn-peugnet
for now using zlib on a 556Mo dir: files: 1469447 o -> 207289 o size divided by 7
2021-09-20less noisy file read errorsn-peugnet
2021-09-15add storeWorker and use it to store chunk content and hashesn-peugnet
2021-09-14perf: move hash parallelism from sketch to repon-peugnet
2021-09-14fix error with link should not cause panicn-peugnet
2021-09-14close some unclosed filesn-peugnet
try to consistently fix windows tests
2021-09-14add load/store sketches+fingerprints & store themn-peugnet
Fix corresponding Commit tests by adding sketches and fingerprints files in repo_8k and repo_8k_zlib. Also enhance CommitTests by checking recipe files
2021-09-14logger add panic + colors & remove ln variants & use itn-peugnet
2021-09-13fix loadChunks by using cache instead of reading filen-peugnet
This way there is only one place where we read chunks and where the read/write wrapper is used. This also allows to remove LoadedChunk as it is not used anymore.
2021-09-13close opened files in loadChunkContent and Restoren-peugnet
to try to fix tests on windows
2021-09-13fix for windows, use filepath instead of pathn-peugnet
2021-09-13fix golint ci errorsn-peugnet
2021-09-13add read write wrappers to compress chunks' contentn-peugnet
2021-09-10use moare the reader interfacen-peugnet
2021-09-09better commit and restore tests (almost complete)n-peugnet
added some file path management function for prfixes and trailing slash
2021-09-09first add of restore function to Repon-peugnet
2021-09-09fix matchStream: encode prev if exists in epiloguen-peugnet
2021-09-09remove merge and extract tempchunksn-peugnet
2021-09-09move unused functions from repo to repo_testn-peugnet
2021-09-09export sketch in its own packagen-peugnet
so that tests can be cached and to make sure it is independant of the rest of the code also move tests in testdata as this folder is ignored by go test by default
2021-09-08start using chunk cachen-peugnet
2021-09-08add cache and start using it in repon-peugnet
2021-09-07fix matchStream did not store first chunkn-peugnet
2021-09-07prepare for recipe encoding by exporting filedsn-peugnet
2021-09-06initial chunk storagen-peugnet
2021-09-06fixes: chunk id starts from 0 & nil checkn-peugnet
2021-09-06generate new Polynomial only oncen-peugnet
2021-09-02hash and store chunks left by matchStreamn-peugnet
2021-09-02move maps inside repon-peugnet
2021-09-02find similar chunks while matching streamn-peugnet
2021-09-01Prepare for delta encodingn-peugnet
2021-09-01move some consts into repon-peugnet
2021-08-31split extractTempChunks into 2 funcsn-peugnet
2021-08-31fix matchStream if first chunk is not matchedn-peugnet
2021-08-31join too small temp chunks with previous one if possiblen-peugnet
2021-08-31do not fill partial cunks with paddingn-peugnet
this way a partial chunk may have less superfeatures than a complete one
2021-08-30make sketch parameters global varsn-peugnet
2021-08-30fix: matchStream returned incorrect nrw chunk datan-peugnet
2021-08-30fix: last partial chunk is not added to recipen-peugnet
2021-08-30fix: chunkId added multiple times for same superFeaturen-peugnet
2021-08-30better diff testn-peugnet
2021-08-30findSimilarChunk returns an Id if foundn-peugnet