rclone/backend/chunker
Maxwell Calman 9cc8ff4dd4 chunker: partially implement no-rename transactions (#4675)
Some storage providers e.g. S3 don't have an efficient rename operation.
Before this change, when chunker finished an upload, the server-side copy
and delete operations that renamed temporary chunks to their final names
could take a significant amount of time.
This PR records transaction identifier (versioning) in the metadata of
chunker composite objects striving to remove the need for rename
operations on such backends.
This approach will be triggered be the new "transactions" configuration
option, which can be "rename" (the default) or "norename".
We implement the new approach for uploads (Put operations).
The chunker Move operation still uses the rename operation of
underlying backend. Filling this gap is left for a later PR.

Co-authored-by: Ivan Andreev <ivandeex@gmail.com>
2021-02-28 10:49:17 +00:00
..
chunker_internal_test.go chunker: partially implement no-rename transactions (#4675) 2021-02-28 10:49:17 +00:00
chunker_test.go docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
chunker.go chunker: partially implement no-rename transactions (#4675) 2021-02-28 10:49:17 +00:00