extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2025-08-18 17:38:52 +02:00
Code Issues Packages Projects Releases Wiki Activity

chunker: finish meta-format before release

Browse Source 
changes:
- chunker: remove GetTier and SetTier
- remove wdmrcompat metaformat
- remove fastopen strategy
- make hash_type option non-advanced
- adverise hash support when possible
- add metadata field "ver", run strict checks
- describe internal behavior in comments
- improve documentation

note:
wdmrcompat used to write file name in the metadata, so maximum metadata
size was 1K; removing it allows to cap size by 200 bytes now.
This commit is contained in:
Ivan Andreev
2019-09-25 02:18:30 +03:00
committed by Nick Craig-Wood
parent c41812fc88
commit ccecfa9cb1
5 changed files with 303 additions and 312 deletions
Download Patch File Download Diff File Expand all files Collapse all files

43
fstest/test_all/config.yaml
View File

@@ -33,9 +33,6 @@ backends:
- backend: "chunker"
remote: "TestChunkerNometaLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerCompatLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk3bLocal:"
fastlist: true
@@ -44,10 +41,6 @@ backends:
remote: "TestChunkerChunk3bNometaLocal:"
fastlist: true
maxfile: 6k
- backend: "chunker"
remote: "TestChunkerChunk3bCompatLocal:"
fastlist: true
maxfile: 6k
- backend: "chunker"
remote: "TestChunkerMailru:"
fastlist: true
@@ -66,30 +59,26 @@ backends:
- backend: "chunker"
remote: "TestChunkerS3:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
- backend: "chunker"
remote: "TestChunkerChunk50bS3:"
fastlist: true
maxfile: 1k
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
#- backend: "chunker"
# remote: "TestChunkerChunk50bMD5HashS3:"
# fastlist: true
# maxfile: 1k
#- backend: "chunker"
# remote: "TestChunkerChunk50bMD5QuickS3:"
# fastlist: true
# maxfile: 1k
#- backend: "chunker"
# remote: "TestChunkerChunk50bSHA1HashS3:"
# fastlist: true
# maxfile: 1k
#- backend: "chunker"
# remote: "TestChunkerChunk50bSHA1QuickS3:"
# fastlist: true
# maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bMD5HashS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1HashS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bMD5QuickS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1QuickS3:"
fastlist: true
maxfile: 1k
## end chunker
- backend: "drive"
remote: "TestDrive:"