rclone/backend
Nick Craig-Wood f7e3115955 s3: fix Wasabi HEAD requests returning stale data by using only 1 transport
In this commit

fc5b14b620 s3: Added `--s3-disable-http2` to disable http/2

We created our own transport so we could disable http/2. However the
added function is called twice meaning that we create two HTTP
transports. This didn't happen with the original code because the
default transport is cached by fshttp.

Rclone normally does a PUT followed by a HEAD request to check an
upload has been successful.

With the two transports, the PUT and the HEAD were being done on
different HTTP transports. This means that it wasn't re-using the same
HTTP connection, so the HEAD request showed the previous object value.
This caused rclone to declare the upload was corrupted, delete the
object and try again.

This patch makes sure we only create one transport and use it for both
PUT and HEAD requests which fixes the problem with Wasabi.

See: https://forum.rclone.org/t/each-time-rclone-is-run-1-3-fails-2-3-succeeds/22545
2021-03-05 15:34:56 +00:00
..
alias alias: fix tests after parsing of ... change #4862 2020-12-21 18:23:16 +00:00
all HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
amazonclouddrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
azureblob azureblob: require go1.14+ to compile due to SDK changes 2021-01-30 18:01:12 +00:00
b2 b2: fix failed to create file system with application key limited to a prefix 2021-02-11 15:13:19 +00:00
box box: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
cache address stringent ineffectual assignment check in golangci-lint (#5093) 2021-03-04 14:26:48 +03:00
chunker address stringent ineffectual assignment check in golangci-lint (#5093) 2021-03-04 14:26:48 +03:00
compress compress: check type assertion in SetTier - fixes #4941 2021-01-20 22:59:14 +00:00
crypt crypt: add option to not encrypt data #1077 (#2981) 2021-02-17 03:40:37 +03:00
drive drive: refer to Shared Drives instead of Team Drives 2021-02-07 12:30:21 +00:00
dropbox dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
fichier fichier: implement copy & move 2021-02-24 21:05:41 +01:00
filefabric filefabric: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
ftp dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
googlecloudstorage Use http.NewRequestWithContext where possible after go1.13 minimum version 2021-02-03 17:41:27 +00:00
googlephotos gphotos: new flag --gphotos-include-archived - fixes #4728 2021-01-28 16:51:31 +00:00
hdfs hdfs: support kerberos authentication #42 2021-01-27 18:16:58 +00:00
http Use http.NewRequestWithContext where possible after go1.13 minimum version 2021-02-03 17:41:27 +00:00
hubic swift: update github.com/ncw/swift to v2.0.0 2021-02-03 20:23:37 +00:00
jottacloud jottacloud: Add support for Telia Cloud (#4930) 2021-01-17 02:38:57 +01:00
koofr fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
local local: Add flag --no-preallocate - #3207 2021-02-11 17:25:28 +00:00
mailru fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
mega fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
memory azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
onedrive dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
opendrive opendrive: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
pcloud azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
premiumizeme premiumizeme: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
putio Use http.NewRequestWithContext where possible after go1.13 minimum version 2021-02-03 17:41:27 +00:00
qingstor qingstor: fix rclone cleanup 2021-01-21 17:35:31 +00:00
s3 s3: fix Wasabi HEAD requests returning stale data by using only 1 transport 2021-03-05 15:34:56 +00:00
seafile fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
sftp sftp: close idle connections after --sftp-idle-timeout (1m by default) 2021-02-16 12:39:05 +00:00
sharefile fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
sugarsync sugarsync: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
swift swift: update github.com/ncw/swift to v2.0.0 2021-02-03 20:23:37 +00:00
tardigrade build: remove go1.13 build constraints 2021-02-03 17:46:08 +00:00
union union: fix mkdir at root with remote:/ 2021-02-17 12:11:34 +00:00
webdav webdav: check that purged directory really exists (#2921) 2021-02-23 23:27:30 +00:00
yandex dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
zoho zoho: fix custom client id's 2021-02-23 11:27:05 +00:00