Age | Commit message (Collapse) | Author | |
---|---|---|---|
2021-09-23 | use repo wrappers for files and recipe | n-peugnet | |
2021-09-23 | add String to Delta struct and use it in logs | n-peugnet | |
Also switch to external package for slice_test as it was already a case of "black box testing". | |||
2021-09-23 | add SetLevel function to logger package | n-peugnet | |
2021-09-23 | better tests (util/io subtests + check log output) | n-peugnet | |
2021-09-22 | fix mystical bug by making multiple passes | n-peugnet | |
We make ne passes while new blocks have been added. This way we are assured that the result will be the same on following runs. result : 161 /tmp/test-1/00001/recipe 161 /tmp/test-1/00001/files 0 /tmp/test-1/00001/hashes 40 /tmp/test-1/00001/chunks 482 /tmp/test-1/00001 9904052 /tmp/test-1/00000/recipe 5377304 /tmp/test-1/00000/files 2061331 /tmp/test-1/00000/hashes 207958371 /tmp/test-1/00000/chunks 225301178 /tmp/test-1/00000 225301740 /tmp/test-1 | |||
2021-09-22 | add tests for io utils | n-peugnet | |
2021-09-22 | rename and remove unused utils | n-peugnet | |
2021-09-22 | fix calling with source "." | n-peugnet | |
2021-09-22 | export unprefix in utils and fix error msg | n-peugnet | |
2021-09-22 | fix for stream smaller than chunkSize | n-peugnet | |
2021-09-22 | add debug log level | n-peugnet | |
2021-09-22 | trying to fix the mystical bug | n-peugnet | |
If prev is not null and no match if found, always encode both remaining chunks. Previously some chunks of chunkSize could have been stored as TempChunks in the recipe instead of as StoredChunks with hashes and an Id. This did not fix the mystical bug. But it helped finding where it came from. | |||
2021-09-22 | misc log messages and refactoring | n-peugnet | |
2021-09-22 | misc tests and log messages | n-peugnet | |
2021-09-22 | fix findSimilarChunk max is not updated | n-peugnet | |
2021-09-22 | fix slice.Patch with empty delta | n-peugnet | |
2021-09-21 | store file listing incrementally | n-peugnet | |
2021-09-21 | define name of gob registered structs | n-peugnet | |
also store uncompressed delta for now and add wrapper parameter | |||
2021-09-21 | fix recipe diff deepequal replaces everything... | n-peugnet | |
...by hydrating the chunks in loadRecipes instead of in restoreStream. Otherwise repo is not set in r.recipe chunks. Also added a generic loadDeltas for future use in loadFileLists | |||
2021-09-21 | fix same delta chunk is not found on second commit | n-peugnet | |
2021-09-21 | store recipes incrementally | n-peugnet | |
2021-09-21 | print stack trace to logger output | n-peugnet | |
2021-09-21 | change recipe into a generic slice patch/diff package | n-peugnet | |
2021-09-21 | export asserts into a package | n-peugnet | |
2021-09-21 | logger perf don't call Sprint and Sprintf if quiet | n-peugnet | |
2021-09-21 | add patch and diff logic for recipes | n-peugnet | |
2021-09-21 | Use assertSame instead of assertSlice | n-peugnet | |
2021-09-20 | add test for load hashes and storageWorker | n-peugnet | |
2021-09-20 | update todolist | n-peugnet | |
2021-09-20 | store recipe compressed | n-peugnet | |
for now using zlib on a 556Mo dir: recipe: 11668558 o -> 5540831 o size divided by 2 | |||
2021-09-20 | remove errored files from fileList | n-peugnet | |
and add tests with non existing link | |||
2021-09-20 | update recipe to match latest version | n-peugnet | |
2021-09-20 | store fileList compressed | n-peugnet | |
for now using zlib on a 556Mo dir: files: 1469447 o -> 207289 o size divided by 7 | |||
2021-09-20 | less noisy file read errors | n-peugnet | |
2021-09-15 | add perf output | n-peugnet | |
2021-09-15 | add storeWorker and use it to store chunk content and hashes | n-peugnet | |
2021-09-15 | add build build status to readme | n-peugnet | |
2021-09-15 | fix tests on windows... | n-peugnet | |
2021-09-15 | logger fixes and better tests | n-peugnet | |
2021-09-14 | perf: move hash parallelism from sketch to repo | n-peugnet | |
2021-09-14 | fix error with link should not cause panic | n-peugnet | |
2021-09-14 | close some unclosed files | n-peugnet | |
try to consistently fix windows tests | |||
2021-09-14 | add load/store sketches+fingerprints & store them | n-peugnet | |
Fix corresponding Commit tests by adding sketches and fingerprints files in repo_8k and repo_8k_zlib. Also enhance CommitTests by checking recipe files | |||
2021-09-14 | logger add SetOutput + basic tests | n-peugnet | |
2021-09-14 | logger add panic + colors & remove ln variants & use it | n-peugnet | |
2021-09-14 | add basic logger | n-peugnet | |
2021-09-13 | fix typo in note | n-peugnet | |
2021-09-13 | first tests on real data | n-peugnet | |
2021-09-13 | fix loadChunks by using cache instead of reading file | n-peugnet | |
This way there is only one place where we read chunks and where the read/write wrapper is used. This also allows to remove LoadedChunk as it is not used anymore. | |||
2021-09-13 | fix english typos | n-peugnet | |