extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-11-22 08:23:47 +01:00
Code Issues Packages Projects Releases Wiki Activity
2db0e23584
rclone/backend
History
Nick Craig-Wood 2db0e23584 backends: change OpenChunkWriter interface to allow backend concurrency override 
Before this change the concurrency used for an upload was rather
inconsistent.

- if size below `--backend-upload-cutoff` (default 200M) do single part upload.

- if size below `--multi-thread-cutoff` (default 256M) or using streaming
  uploads (eg `rclone rcat) do multipart upload using
  `--backend-upload-concurrency` to set the concurrency used by the uploader.

- otherwise do multipart upload using `--multi-thread-streams` to set the
  concurrency.

This change makes the default for the concurrency used be the
`--backend-upload-concurrency`. If `--multi-thread-streams` is set and larger
than the `--backend-upload-concurrency` then that will be used instead.

This means that if the user sets `--backend-upload-concurrency` then it will be
obeyed for all multipart/multi-thread transfers and the user can override them
all with `--multi-thread-streams`.

See: #7056
2023-09-03 11:47:05 +01:00
..
alias build: add package comments to silence revive linter 2022-08-28 13:43:51 +02:00
all protondrive: add protondrive backend - fixes #6072 2023-07-22 10:46:21 +01:00
amazonclouddrive build: reformat comments to pass go1.19 vet 2022-08-05 16:35:41 +01:00
azureblob backends: change OpenChunkWriter interface to allow backend concurrency override 2023-09-03 11:47:05 +01:00
b2 backends: change OpenChunkWriter interface to allow backend concurrency override 2023-09-03 11:47:05 +01:00
box box: fix unhelpful decoding of error messages into decimal numbers 2023-08-31 23:03:27 +01:00
cache build: update to go1.21rc3 and make go1.19 the minimum required version 2023-07-16 10:09:25 +01:00
chunker features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
combine build: fix lint errors when re-enabling revive exported & package-comments 2023-08-29 13:03:13 +01:00
compress features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
crypt features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
drive drive: fix typo in docs 2023-08-05 12:51:51 +01:00
dropbox rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
fichier fichier: fix error code parsing 2023-08-11 00:47:01 +09:00
filefabric filefabric: use atomic types 2023-08-22 12:52:13 +01:00
ftp ftp: fix 425 "TLS session of data connection not resumed" errors 2023-08-18 14:44:13 +01:00
googlecloudstorage rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
googlephotos fs: move operations.NewOverrideRemote to fs.NewOverrideRemote 2022-11-21 08:02:09 +00:00
hasher features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
hdfs rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
hidrive hidrive: remove unused code (fixes issue reported by the unused linter) 2023-03-26 14:28:15 +02:00
http http: ensure folders show the modtime configured by --default-time #6986 2023-05-04 15:03:11 +01:00
internetarchive rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
jottacloud jotta: added Telia Sky whitelabel (Norway) 2023-09-01 14:55:32 +01:00
koofr rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
local local: use atomic types 2023-08-22 12:52:13 +01:00
mailru rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
mega rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
memory Replace deprecated ioutil 2022-11-07 11:41:47 +00:00
netstorage rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
onedrive rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
opendrive rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
oracleobjectstorage backends: change OpenChunkWriter interface to allow backend concurrency override 2023-09-03 11:47:05 +01:00
pcloud rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
pikpak rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
premiumizeme rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
protondrive build: fix lint errors when re-enabling revive exported & package-comments 2023-08-29 13:03:13 +01:00
putio rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
qingstor rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
s3 backends: change OpenChunkWriter interface to allow backend concurrency override 2023-09-03 11:47:05 +01:00
seafile seafile: use atomic types 2023-08-22 12:52:13 +01:00
sftp docs: sftp: add note regarding format of server_command 2023-09-01 10:57:42 +01:00
sharefile rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
sia rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
smb smb: use atomic types 2023-08-22 12:52:13 +01:00
storj storj: performance improvement for large file uploads 2023-08-04 17:40:03 +09:00
sugarsync rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
swift swift: fix HEADing 0-length objects when --swift-no-large-objects set 2023-08-03 08:38:39 +01:00
union union: use atomic types 2023-08-22 12:52:13 +01:00
uptobox rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
webdav webdav: nextcloud: fix segment violation in low-level retry 2023-08-01 11:15:33 +09:00
yandex yandex: fix 400 Bad Request on transfer failure 2023-06-11 11:11:43 +01:00
zoho zoho: fix downloads with Range: header returning the wrong data 2023-06-14 17:43:26 +01:00