rclone/fs/operations
Nick Craig-Wood a5700a4a53 operations: rework rcat so that it doesn't call the --metadata-mapper twice
The --metadata-mapper was being called twice for files that rclone
needed to stream to disk,

This happened only for:
- files bigger than --upload-streaming-cutoff
- on backends which didn't support PutStream

This also meant that these were being logged as two transfers which
was a little strange.

This fixes the problem by not using operations.Copy to upload the file
once it has been streamed to disk, instead using the Put method on the
backend.

This should have no effect on reliability of the transfers as we retry
Put if possible.

This also tidies up the Rcat function to make the different ways of
uploading the data clearer and make it easy to see that it gets
verified on all those paths.

See #7848
2024-05-20 18:16:54 +01:00
..
operationsflags sync: report list of synced paths to file -- see #7282 2024-01-20 14:50:08 -05:00
check_test.go operations: skip backends incapable of testing TestApplyTransforms - #7591 2024-02-13 15:07:41 -05:00
check.go vfs: fix unicode normalization on macOS - fixes #7072 2024-03-06 16:12:13 +00:00
copy_test.go operations: fix very long file names when using copy with --partial 2024-03-30 09:06:58 +00:00
copy.go operations: ensure SrcFsType is set correctly when using --metadata-mapper 2024-05-20 18:16:54 +01:00
dedupe_test.go test: replace defer cleanup with t.Cleanup 2022-12-09 14:38:05 +00:00
dedupe.go accounting: Make checkers show what they are doing 2023-03-01 11:10:38 +00:00
listdirsorted_test.go test: replace defer cleanup with t.Cleanup 2022-12-09 14:38:05 +00:00
logger.go operations: remove stray debug 2024-03-07 17:15:43 +00:00
lsjson_test.go lsjson,lsf: make sure metadata appears for directories 2024-02-28 16:26:14 +00:00
lsjson.go operations: fix lsjson --encrypted when using --crypt-XXX parameters 2024-05-13 17:59:58 +01:00
multithread_test.go operations: fix missing metadata for multipart transfers to local disk 2024-05-14 12:51:03 +01:00
multithread.go operations: fix missing metadata for multipart transfers to local disk 2024-05-14 12:51:03 +01:00
operations_internal_test.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
operations_test.go operations: rework rcat so that it doesn't call the --metadata-mapper twice 2024-05-20 18:16:54 +01:00
operations.go operations: rework rcat so that it doesn't call the --metadata-mapper twice 2024-05-20 18:16:54 +01:00
rc_test.go operations: add operations/hashsum to the rc as rclone hashsum equivalent 2024-02-29 16:21:42 +00:00
rc.go rc: fix stats groups being ignored in operations/check 2024-03-26 11:23:40 +00:00
reopen_test.go operations: fix retries downloading too much data with certain backends 2024-04-13 19:25:15 +01:00
reopen.go operations: fix retries downloading too much data with certain backends 2024-04-13 19:25:15 +01:00