aboutsummaryrefslogtreecommitdiff
path: root/TODO.md
AgeCommit message (Collapse)Author
2021-10-18update todo and add CLI optionswork/exportn-peugnet
2021-10-08add chunkSize parameter to clin-peugnet
2021-10-06refactor main and loggern-peugnet
2021-10-01add some comments, summary, TODOs and infosn-peugnet
2021-09-30properly manage relative symlinks will CI pass ??n-peugnet
2021-09-29support symlinks if it is internal to sourcen-peugnet
adapt tests
2021-09-29move old funcs to repo_test and add roundtrip testn-peugnet
2021-09-29merge tryDeltaEncodeChunk and encodeTempChunkn-peugnet
to reuse the sketch calculation
2021-09-29add details and some todosn-peugnet
2021-09-27add CLI with subcommandsn-peugnet
2021-09-23Testing with Fdelta as the differn-peugnet
2021-09-22fix mystical bug by making multiple passesn-peugnet
We make ne passes while new blocks have been added. This way we are assured that the result will be the same on following runs. result : 161 /tmp/test-1/00001/recipe 161 /tmp/test-1/00001/files 0 /tmp/test-1/00001/hashes 40 /tmp/test-1/00001/chunks 482 /tmp/test-1/00001 9904052 /tmp/test-1/00000/recipe 5377304 /tmp/test-1/00000/files 2061331 /tmp/test-1/00000/hashes 207958371 /tmp/test-1/00000/chunks 225301178 /tmp/test-1/00000 225301740 /tmp/test-1
2021-09-22trying to fix the mystical bugn-peugnet
If prev is not null and no match if found, always encode both remaining chunks. Previously some chunks of chunkSize could have been stored as TempChunks in the recipe instead of as StoredChunks with hashes and an Id. This did not fix the mystical bug. But it helped finding where it came from.
2021-09-21store file listing incrementallyn-peugnet
2021-09-21store recipes incrementallyn-peugnet
2021-09-21change recipe into a generic slice patch/diff packagen-peugnet
2021-09-20update todolistn-peugnet
2021-09-20store recipe compressedn-peugnet
for now using zlib on a 556Mo dir: recipe: 11668558 o -> 5540831 o size divided by 2
2021-09-20remove errored files from fileListn-peugnet
and add tests with non existing link
2021-09-20store fileList compressedn-peugnet
for now using zlib on a 556Mo dir: files: 1469447 o -> 207289 o size divided by 7
2021-09-15add perf outputn-peugnet
2021-09-15add storeWorker and use it to store chunk content and hashesn-peugnet
2021-09-14perf: move hash parallelism from sketch to repon-peugnet
2021-09-14logger add SetOutput + basic testsn-peugnet
2021-09-14logger add panic + colors & remove ln variants & use itn-peugnet
2021-09-14add basic loggern-peugnet
2021-09-13first tests on real datan-peugnet
2021-09-13fix loadChunks by using cache instead of reading filen-peugnet
This way there is only one place where we read chunks and where the read/write wrapper is used. This also allows to remove LoadedChunk as it is not used anymore.
2021-09-13fix english typosn-peugnet
2021-09-13add read write wrappers to compress chunks' contentn-peugnet
2021-09-10use moare the reader interfacen-peugnet
2021-09-09better commit and restore tests (almost complete)n-peugnet
added some file path management function for prfixes and trailing slash
2021-09-09first add of restore function to Repon-peugnet
2021-09-09move unused functions from repo to repo_testn-peugnet
2021-09-08start using chunk cachen-peugnet
2021-09-07update todo and readmen-peugnet
2021-09-07udpate todo listn-peugnet
2021-09-02hash and store chunks left by matchStreamn-peugnet
2021-09-02move maps inside repon-peugnet
2021-09-02find similar chunks while matching streamn-peugnet
2021-09-01move some consts into repon-peugnet
2021-08-31join too small temp chunks with previous one if possiblen-peugnet
2021-08-30better diff testn-peugnet
2021-08-30findSimilarChunk returns an Id if foundn-peugnet
2021-08-28refactor(chunks): use more interfacesn-peugnet
2021-08-24refactor: extract chunk.og & add Reader gettern-peugnet