| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2021-09-30 | properly manage relative symlinks will CI pass ?? | n-peugnet | |
| 2021-09-30 | add some comments | n-peugnet | |
| 2021-09-29 | support symlinks if it is internal to source | n-peugnet | |
| adapt tests | |||
| 2021-09-29 | move old funcs to repo_test and add roundtrip test | n-peugnet | |
| 2021-09-29 | merge tryDeltaEncodeChunk and encodeTempChunk | n-peugnet | |
| to reuse the sketch calculation | |||
| 2021-09-27 | add CLI with subcommands | n-peugnet | |
| 2021-09-23 | Testing with Fdelta as the differ | n-peugnet | |
| 2021-09-23 | better error handling and start checking symlinks | n-peugnet | |
| 2021-09-23 | use repo wrappers for files and recipe | n-peugnet | |
| 2021-09-23 | add String to Delta struct and use it in logs | n-peugnet | |
| Also switch to external package for slice_test as it was already a case of "black box testing". | |||
| 2021-09-22 | fix mystical bug by making multiple passes | n-peugnet | |
| We make ne passes while new blocks have been added. This way we are assured that the result will be the same on following runs. result : 161 /tmp/test-1/00001/recipe 161 /tmp/test-1/00001/files 0 /tmp/test-1/00001/hashes 40 /tmp/test-1/00001/chunks 482 /tmp/test-1/00001 9904052 /tmp/test-1/00000/recipe 5377304 /tmp/test-1/00000/files 2061331 /tmp/test-1/00000/hashes 207958371 /tmp/test-1/00000/chunks 225301178 /tmp/test-1/00000 225301740 /tmp/test-1 | |||
| 2021-09-22 | fix calling with source "." | n-peugnet | |
| 2021-09-22 | export unprefix in utils and fix error msg | n-peugnet | |
| 2021-09-22 | fix for stream smaller than chunkSize | n-peugnet | |
| 2021-09-22 | add debug log level | n-peugnet | |
| 2021-09-22 | trying to fix the mystical bug | n-peugnet | |
| If prev is not null and no match if found, always encode both remaining chunks. Previously some chunks of chunkSize could have been stored as TempChunks in the recipe instead of as StoredChunks with hashes and an Id. This did not fix the mystical bug. But it helped finding where it came from. | |||
| 2021-09-22 | misc log messages and refactoring | n-peugnet | |
| 2021-09-22 | misc tests and log messages | n-peugnet | |
| 2021-09-22 | fix findSimilarChunk max is not updated | n-peugnet | |
| 2021-09-21 | store file listing incrementally | n-peugnet | |
| 2021-09-21 | define name of gob registered structs | n-peugnet | |
| also store uncompressed delta for now and add wrapper parameter | |||
| 2021-09-21 | fix recipe diff deepequal replaces everything... | n-peugnet | |
| ...by hydrating the chunks in loadRecipes instead of in restoreStream. Otherwise repo is not set in r.recipe chunks. Also added a generic loadDeltas for future use in loadFileLists | |||
| 2021-09-21 | fix same delta chunk is not found on second commit | n-peugnet | |
| 2021-09-21 | store recipes incrementally | n-peugnet | |
| 2021-09-20 | store recipe compressed | n-peugnet | |
| for now using zlib on a 556Mo dir: recipe: 11668558 o -> 5540831 o size divided by 2 | |||
| 2021-09-20 | remove errored files from fileList | n-peugnet | |
| and add tests with non existing link | |||
| 2021-09-20 | store fileList compressed | n-peugnet | |
| for now using zlib on a 556Mo dir: files: 1469447 o -> 207289 o size divided by 7 | |||
| 2021-09-20 | less noisy file read errors | n-peugnet | |
| 2021-09-15 | add storeWorker and use it to store chunk content and hashes | n-peugnet | |
| 2021-09-14 | perf: move hash parallelism from sketch to repo | n-peugnet | |
| 2021-09-14 | fix error with link should not cause panic | n-peugnet | |
| 2021-09-14 | close some unclosed files | n-peugnet | |
| try to consistently fix windows tests | |||
| 2021-09-14 | add load/store sketches+fingerprints & store them | n-peugnet | |
| Fix corresponding Commit tests by adding sketches and fingerprints files in repo_8k and repo_8k_zlib. Also enhance CommitTests by checking recipe files | |||
| 2021-09-14 | logger add panic + colors & remove ln variants & use it | n-peugnet | |
| 2021-09-13 | fix loadChunks by using cache instead of reading file | n-peugnet | |
| This way there is only one place where we read chunks and where the read/write wrapper is used. This also allows to remove LoadedChunk as it is not used anymore. | |||
| 2021-09-13 | close opened files in loadChunkContent and Restore | n-peugnet | |
| to try to fix tests on windows | |||
| 2021-09-13 | fix for windows, use filepath instead of path | n-peugnet | |
| 2021-09-13 | fix golint ci errors | n-peugnet | |
| 2021-09-13 | add read write wrappers to compress chunks' content | n-peugnet | |
| 2021-09-10 | use moare the reader interface | n-peugnet | |
| 2021-09-09 | better commit and restore tests (almost complete) | n-peugnet | |
| added some file path management function for prfixes and trailing slash | |||
| 2021-09-09 | first add of restore function to Repo | n-peugnet | |
| 2021-09-09 | fix matchStream: encode prev if exists in epilogue | n-peugnet | |
| 2021-09-09 | remove merge and extract tempchunks | n-peugnet | |
| 2021-09-09 | move unused functions from repo to repo_test | n-peugnet | |
| 2021-09-09 | export sketch in its own package | n-peugnet | |
| so that tests can be cached and to make sure it is independant of the rest of the code also move tests in testdata as this folder is ignored by go test by default | |||
| 2021-09-08 | start using chunk cache | n-peugnet | |
| 2021-09-08 | add cache and start using it in repo | n-peugnet | |
| 2021-09-07 | fix matchStream did not store first chunk | n-peugnet | |
| 2021-09-07 | prepare for recipe encoding by exporting fileds | n-peugnet | |
 |
index : dna-backup | |
| deduplicated versionned backups for dna | Nicolas Peugnet |
| aboutsummaryrefslogtreecommitdiff |