extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-11-23 00:43:49 +01:00
Code Issues Packages Projects Releases Wiki Activity
189ef5f257
rclone/backend
History
Nick Craig-Wood 189ef5f257 azureblob: fix memory usage by upgrading the SDK and implementing a TransferManager 
In the Azure SDK there was a bug which caused excessive memory use
when doing repeated transfers:

https://github.com/Azure/azure-storage-blob-go/issues/233

This patch updates the SDK to v0.13.0 which allowed us to implement a
custom TransferManager which integrates with rclone's memory pool.

This fixes the excessive memory consumption.

See: https://forum.rclone.org/t/ask-for-settings-recommendation-for-azureblob/21505/
2021-01-30 17:26:59 +00:00
..
alias alias: fix tests after parsing of ... change #4862 2020-12-21 18:23:16 +00:00
all HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
amazonclouddrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
azureblob azureblob: fix memory usage by upgrading the SDK and implementing a TransferManager 2021-01-30 17:26:59 +00:00
b2 b2: fixed possible crash when accessing Backblaze b2 remote 2021-01-25 17:48:40 +00:00
box box: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
cache fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
chunker chunker: fix case-insensitive NewObject, test metadata detection #4902 2021-01-10 22:29:24 +03:00
compress compress: check type assertion in SetTier - fixes #4941 2021-01-20 22:59:14 +00:00
crypt fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
drive drive: add xdg office icons to xdg desktop files 2021-01-28 17:12:48 +00:00
dropbox dropbox: enable short lived access tokens #4792 2020-12-02 16:50:16 +00:00
fichier fichier: set Features.ReadMimeType=true as Object.MimeType is supported 2020-11-29 17:22:43 +00:00
filefabric filefabric: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
ftp ftp,sftp: Make --tpslimit apply - fixes #4906 2021-01-08 10:29:57 +00:00
googlecloudstorage gcs: Fix Entry doesn't belong in directory "" (same as directory) - ignoring 2021-01-19 16:50:37 +00:00
googlephotos gphotos: new flag --gphotos-include-archived - fixes #4728 2021-01-28 16:51:31 +00:00
hdfs hdfs: support kerberos authentication #42 2021-01-27 18:16:58 +00:00
http fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
hubic fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
jottacloud jottacloud: Add support for Telia Cloud (#4930) 2021-01-17 02:38:57 +01:00
koofr fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
local local: new flag --local-zero-size-links to fix sync on some virtual filesystems 2021-01-27 18:13:16 +00:00
mailru fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
mega fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
memory azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
onedrive onedrive: add support for china region operated by 21vianet #4963 (#4963) 2021-01-29 23:04:21 +03:00
opendrive opendrive: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
pcloud azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
premiumizeme premiumizeme: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
putio fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
qingstor qingstor: fix rclone cleanup 2021-01-21 17:35:31 +00:00
s3 s3: fix copy multipart with v2 auth failing with 'SignatureDoesNotMatch' 2021-01-27 14:43:02 +00:00
seafile fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
sftp sftp: implement --sftp-use-fstat 2021-01-28 16:07:26 +00:00
sharefile fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
sugarsync sugarsync: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
swift swift: ensure partially uploaded large files are uploaded unless --swift-leave-parts-on-error 2021-01-28 17:09:41 +00:00
tardigrade config: add context.Context #3257 #4685 2020-11-09 18:05:54 +00:00
union fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
webdav webdav: add "Depth: 0" to GET requests to fix bitrix 2020-12-30 10:14:50 +00:00
yandex yandex: set Features.WriteMimeType=false as Yandex ignores mime types 2020-11-29 17:22:43 +00:00
zoho new backend: zoho workdrive - fixes #4533 2020-12-30 17:56:08 +00:00