1415666074
lsjson: fix unterminated JSON in the presence of errors
...
See: https://forum.rclone.org/t/rclone-lsjson-invalid-json-produced-no-at-the-end/22046
2021-02-02 17:46:56 +00:00
bae550c71e
docs: Changelog: Correct link to digitalis.io
2021-02-02 17:26:41 +00:00
beff081abb
Start v1.55.0-DEV development
2021-02-02 16:30:58 +00:00
7f5ee5d81f
Version v1.54.0
2021-02-02 14:17:09 +00:00
8b41dfa50a
s3: add --s3-no-head parameter to minimise transactions on upload
...
See: https://forum.rclone.org/t/prevent-head-on-amazon-s3-family/21935
2021-02-02 10:07:48 +00:00
0d8bcc08da
Revert "fs/accounting: make edge bandwidth limiters have smaller bursts to make smoother" #4987
...
This reverts commit 463a18aa07https://forum.rclone.org/t/bug-report-for-v1-54-0-beta-5133/22015
2021-02-01 22:23:50 +00:00
d3b7f14b66
bump sgzip to v1.1.0 - fixes #4970
2021-02-01 18:34:42 +00:00
f66928a846
drive: fix copyid command with a bare filename: can't use empty string as a path
...
Before this change, running
rclone backend copyid drive: ID file.txt
Failed with the error
command "copyid" failed: failed copying "ID" "file.txt": can't use empty string as a path
This fixes the problem.
2021-02-01 15:17:25 +00:00
3b1122c888
azureblob: require go1.14+ to compile due to SDK changes
2021-01-30 18:01:12 +00:00
463a18aa07
fs/accounting: make edge bandwidth limiters have smaller bursts to make smoother
...
This change decreases the edge limiter burst size which dramatically
increases the smoothness of the bandwidth limiting.
The core bandwidth limiter remains with a large burst so it isn't
affected by double rate limiting on the edge limiters.
See: #4395
See: https://forum.rclone.org/t/bwlimit-is-not-really-smooth/20947
2021-01-30 17:39:30 +00:00
0a932dc1f2
Add --bwlimit for upload and download #1873
2021-01-30 17:39:30 +00:00
8856e0e559
fshttp: Obey bwlimit in http Transport - fixes #4395
...
This change uses the bwlimit code to apply limits to the receive and
transmit data functions in the HTTP Transport.
This means that all HTTP transactions will have limiting applied -
this includes listings for example.
For HTTP based transorts this makes the limiting in Accounting
redundant and possibly counter productive
2021-01-30 17:39:30 +00:00
3b6df71838
accounting: refactor bwlimit code to allow for multiple slots
2021-01-30 17:39:30 +00:00
31de631b22
vendor: run go mod tidy
2021-01-30 17:28:27 +00:00
189ef5f257
azureblob: fix memory usage by upgrading the SDK and implementing a TransferManager
...
In the Azure SDK there was a bug which caused excessive memory use
when doing repeated transfers:
https://github.com/Azure/azure-storage-blob-go/issues/233
This patch updates the SDK to v0.13.0 which allowed us to implement a
custom TransferManager which integrates with rclone's memory pool.
This fixes the excessive memory consumption.
See: https://forum.rclone.org/t/ask-for-settings-recommendation-for-azureblob/21505/
2021-01-30 17:26:59 +00:00
2f67681e3b
cmount: don't attempt to unmount if fs has been destroyed already #4957
2021-01-30 17:19:28 +00:00
41127965b0
fstest: add Onedrive Business and Onedrive China to the integration tests
2021-01-30 16:32:32 +00:00
8171671d82
Add Bob Pusateri to contributors
2021-01-30 16:24:54 +00:00
75617c0c3b
Add Pau Rodriguez-Estivill to contributors
2021-01-30 16:24:54 +00:00
8b9d23916b
Add Nicolas Rueff to contributors
2021-01-30 16:24:54 +00:00
e43b79e33d
azureblob: add examples for access tier
...
Azure Blob access tier values are case-sensitive, though this is
not indicated anywhere in the documentation. Adding examples
with proper casing.
2021-01-30 16:21:34 +00:00
459cc70a50
vfs: fix invalid cache path on windows when using :backend: as remote
...
The initial ':' is included in the ad-hoc remote name, but is illegal character
in Windows path. Replacing it with '^', which is legal in filesystems but illegal
in regular remote names, so name conflict is avoided.
Fixes #4544
2021-01-30 16:18:15 +00:00
20578f3f89
Add Sakuragawa Misty to contributors
2021-01-29 23:05:49 +03:00
15da53696e
onedrive: add support for china region operated by 21vianet #4963 ( #4963 )
...
fixes #3804
obsoletes #3973
obsoletes #4072
2021-01-29 23:04:21 +03:00
2bddba118e
fstest: apply shellcheck on rclone-serve.bash ( #4975 )
2021-01-29 19:07:17 +03:00
c7e5976e11
build: replace go 1.16-beta1 by 1.16-rc1 ( #4974 )
2021-01-29 19:05:46 +03:00
f0bf9cfda1
drive: add xdg office icons to xdg desktop files
2021-01-28 17:12:48 +00:00
671dd047f7
swift: ensure partially uploaded large files are uploaded unless --swift-leave-parts-on-error
...
This makes sure that partially uploaded large files are removed
unless the `--swift-leave-parts-on-error` flag is supplied.
- refactor swift.go
- add unit test for swift with chunk
- add unit test for large object with fail case
- add "-" to white list char during encode.
2021-01-28 17:09:41 +00:00
6272ca74bc
plugins: Move plugins cache path initialization to initPluginsOrError.
...
Fixes #4951 .
2021-01-28 16:58:23 +00:00
f5af761466
gphotos: new flag --gphotos-include-archived - fixes #4728
...
New flag --gphotos-include-archived to download and view archived media when needed.
2021-01-28 16:51:31 +00:00
06f1c0c61c
move: fix data loss when moving the same object
...
This checks to see if IDs are the same of the source and destination
object before deleting one of them and potentially causing data loss.
See: https://forum.rclone.org/t/files-deleted-and-not-moved/21830
2021-01-28 16:14:16 +00:00
e6a9f005d6
sftp: implement --sftp-use-fstat
...
See: https://forum.rclone.org/t/sftp-fails-to-sync-to-local-failed-to-copy-file-does-not-exist/21759
2021-01-28 16:07:26 +00:00
8f6f4b053c
obscure: make rclone osbcure - ignore newline at end of line
...
See: https://forum.rclone.org/t/authentification-issues-with-webdav-server/21891
2021-01-28 15:54:41 +00:00
fe15a2eeeb
Add Riccardo Iaconelli to contributors
2021-01-28 15:54:41 +00:00
019667170f
Add Zach Kipp to contributors
2021-01-28 15:54:41 +00:00
7a496752f3
fs: add support for flag --no-console on windows to hide the console window
2021-01-27 18:44:35 +00:00
b569dc11a0
hdfs: support kerberos authentication #42
2021-01-27 18:16:58 +00:00
df4e6079f1
local: new flag --local-zero-size-links to fix sync on some virtual filesystems
...
Assume the Stat size of links is zero (and read them instead)
On some virtual filesystems (such ash LucidLink), reading a link size via a
Stat call always returns 0.
However, on unix it reads as the length of the text in the link. This may
cause errors like this when syncing:
Failed to copy: corrupted on transfer: sizes differ 0 vs 13
Setting this flag causes rclone to read the link and use that as the size of
the link instead of 0 which in most cases fixes the problem.
Fixes #4950
Signed-off-by: Riccardo Iaconelli <riccardo@kde.org >
2021-01-27 18:13:16 +00:00
6156f90601
Fix test failure in different local time zones
...
TestParseDuration relied on an elapsed time calculation which
would vary based on the system local time. Fix the test by not relying
on the system time location. Also make the test more deterministic
by injecting time in tests rather than using system time.
Fixes #4529 .
2021-01-27 15:05:35 +00:00
cdaea62932
s3: fix copy multipart with v2 auth failing with 'SignatureDoesNotMatch'
...
Signed-off-by: zhuc <zhucan.k8s@gmail.com >
2021-01-27 14:43:02 +00:00
78afe01d15
filefabric: fix finding directories in a case insensitive way #4830
2021-01-27 14:28:17 +00:00
4eac88babf
premiumizeme: fix finding directories in a case insensitive way #4830
2021-01-27 14:28:17 +00:00
b4217fabd3
opendrive: fix finding directories in a case insensitive way #4830
2021-01-27 14:28:17 +00:00
92b9dabf3c
fstests: only test with ASCII uppercase for case insensitive tests
...
Upper/lower case for multilingual is provider dependent so we don't go
there in the tests.
2021-01-27 14:28:17 +00:00
4323ff8a63
docs: fix broken link in serve sftp/ftp #4968
2021-01-27 13:41:32 +03:00
3e188495f5
sugarsync: fix finding directories in a case insentive way #4830
2021-01-26 14:48:33 +00:00
acb9e17eb3
box: fix finding directories in a case insentive way #4830
2021-01-26 14:48:33 +00:00
c8ab4f1d02
fstests: add a test for finding a directory in a case insensitive way #4830
2021-01-26 14:48:06 +00:00
e776a1b122
fstests: don't run encoding tests on -short
2021-01-26 14:46:23 +00:00
c57af26de9
docs: add note about --check-first being useful with --order-by
2021-01-26 12:12:26 +00:00
