77dfe5f1fd
pacer: fix b2 deadlock by defaulting max connections to unlimited
...
Before this change, the maximum number of connections was set to 10.
This means that b2 could deadlock while uploading multipart uploads
due to a lock being held longer than it should have been.
2023-10-11 12:13:55 +01:00
e9a95a78de
s3: fix slice bounds out of range error when listing
...
In this commit:
5f938fb9ed
s3: fix "Entry doesn't belong in directory" errors when using directory markers
We checked that the remote has the prefix and then changed the remote
before removing the prefix. This sometimes causes:
panic: runtime error: slice bounds out of range [56:55]
The fix is to do the modification of the remote after removing the
prefix.
See: https://forum.rclone.org/t/cryptcheck-panic-runtime-error-slice-bounds-out-of-range/41977
2023-10-11 12:13:55 +01:00
82ca5295f4
docs: fix backend doc generator to not output duplicate config names
...
This was always the intention, it was just implemented wrong.
This shortens the s3 docs by 1369 bringing them down to half the size
just about.
Fixes #7325
2023-10-11 12:13:55 +01:00
9d8a40b813
docs: fix typos found by codespell in docs and code comments
2023-10-11 12:13:55 +01:00
12d80c5219
onedrive: fix the configurator to allow /teams/ID in the config
...
See: https://forum.rclone.org/t/sharepoint-to-google/41548/
2023-10-11 12:08:40 +01:00
038a87c569
lsjson: make sure we set the global metadata flag too
2023-10-11 12:08:40 +01:00
3ef97993ad
b2: fix multipart upload: corrupted on transfer: sizes differ XXX vs 0
...
Before this change the b2 backend wasn't writing the metadata to the
object properly after a multipart upload.
The symptom of this was that sometimes it would give the error:
corrupted on transfer: sizes differ XXX vs 0
This was fixed by returning the metadata in the chunk writer and setting it in Update.
See: https://forum.rclone.org/t/multipart-upload-to-b2-sometimes-failing-with-corrupted-on-transfer-sizes-differ/41829
2023-10-11 12:08:40 +01:00
04bba67cd5
azureblob: fix "fatal error: concurrent map writes"
...
Before this change, the metadata map could be accessed from multiple
goroutines at once, sometimes causing this error.
This fix adds a global mutex for adjusting the metadata map to make
all accesses safe.
See: https://forum.rclone.org/t/azure-blob-storage-with-vfs-cache-concurrent-map-writes-exception/41686
2023-10-11 12:08:40 +01:00
29dd29b9f3
build(deps): bump docker/setup-qemu-action from 2 to 3
...
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 2 to 3.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](https://github.com/docker/setup-qemu-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-11 12:08:40 +01:00
532248352b
build(deps): bump docker/setup-buildx-action from 2 to 3
...
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 2 to 3.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](https://github.com/docker/setup-buildx-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/setup-buildx-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-11 12:08:40 +01:00
ab803942de
storj: update storj.io/uplink to v1.12.0
...
The improved upload logic is active by default in uplink v1.12.0, so the
`testuplink.WithConcurrentSegmentUploadsDefaultConfig(ctx)` is not
required anymore.
See https://github.com/rclone/rclone/pull/7198
2023-10-11 12:08:40 +01:00
f933e80258
docs: add notes on how to update the website between releases
2023-10-11 12:08:40 +01:00
1c6f0101a5
docs: remove minio sponsor box for the moment
2023-10-11 12:08:40 +01:00
c6f161de90
docs: update Storj partner link
2023-10-11 12:08:40 +01:00
bdcf7fe28c
docs: add MacPorts install info
...
https://ports.macports.org/port/rclone/
2023-10-11 12:08:40 +01:00
776dc47eb8
build(deps): bump docker/metadata-action from 4 to 5
...
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 4 to 5.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Upgrade guide](https://github.com/docker/metadata-action/blob/master/UPGRADE.md )
- [Commits](https://github.com/docker/metadata-action/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: docker/metadata-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-11 12:08:40 +01:00
167046e21a
build(deps): bump docker/login-action from 2 to 3
...
Bumps [docker/login-action](https://github.com/docker/login-action ) from 2 to 3.
- [Release notes](https://github.com/docker/login-action/releases )
- [Commits](https://github.com/docker/login-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/login-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-11 12:08:40 +01:00
98d50d545a
build(deps): bump docker/build-push-action from 4 to 5
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 4 to 5.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-11 12:08:40 +01:00
48242c5357
fix overview of oracle object storage as it supports multithreaded
2023-10-11 12:08:40 +01:00
e437e6c209
operations: ensure concurrency is no greater than the number of chunks - fixes #7299
2023-10-11 12:08:40 +01:00
b813a01718
Start v1.64.1-DEV development
2023-10-11 11:55:24 +01:00
77f7bb08af
Version v1.64.0
v1.64.0
2023-09-11 15:59:44 +01:00
a5a61f4874
protondrive: make cached keys rclone style and not show with rclone config redacted
2023-09-11 15:57:08 +01:00
e8879f3e77
docs: document release signing and verification
...
Fixes #7257
2023-09-11 12:28:23 +01:00
2a6675cffd
docs: fix typo in rc docs - fixes #7287
2023-09-11 09:34:22 +01:00
fa4d171f62
protondrive: complete docs with all references to Proton Drive
2023-09-10 11:57:39 +01:00
d4d530bd8e
drive: add --drive-fast-list-bug-fix to control ListR bug workaround
...
See: https://forum.rclone.org/t/how-to-list-empty-directories-recursively/40995/12
2023-09-09 17:46:03 +01:00
f4b011e4e4
s3: add rclone backend restore-status command
...
This command shows the restore status of objects being retrieved from GLACIER.
See: https://forum.rclone.org/t/aws-s3-glacier-monitor-restore-status-command-for-glacier-restoring-process/41373/7
2023-09-09 17:44:36 +01:00
d80890bf32
Add Drew Stinnett to contributors
2023-09-09 17:44:36 +01:00
39392d70dd
Add David Pedersen to contributors
2023-09-09 17:44:36 +01:00
643386f026
rc: Add operations/settier to API
2023-09-09 17:41:02 +01:00
ed755bf04f
protondrive: implement two-password mode ( #7279 )
2023-09-08 22:54:46 +02:00
071c3f28e5
vfs: Update parent directory modtimes on vfs actions
...
This isn't written back to the storage so might change on remount but
makes the VFS just a little more POSIX compatible.
2023-09-08 17:19:52 +01:00
7453b7d5f3
hdfs: fix retry "replication in progress" errors when uploading
...
Before this change uploaded files could return the error "replication
in progress".
This error is harmless though and means the Close should be retried
which is what this patch does.
2023-09-08 15:35:50 +01:00
c9350149d8
hdfs: fix uploading to the wrong object on Update with overriden remote name
...
In this commit we discovered a problem with objects being uploaded to
the incorrect object name. It added an integration test for the
problem.
65b2e378e0
drive: fix incorrect remote after Update on object
This test was tripped by the hdfs backend and this patch fixes the
problem.
2023-09-08 15:35:50 +01:00
08789a5815
test_all: remove filefabric from integration tests
...
The filefabric test server doesn't seem to be working at all so remove
it from the integration tests pending revitalization.
2023-09-08 15:35:50 +01:00
4037af9c1a
Add Oksana and Volodymyr Kit to contributors
2023-09-08 15:35:50 +01:00
628ff8e524
quatrix: add backend to support Quatrix
...
Co-authored-by: Volodymyr Kit <v.kit@maytech.net >
2023-09-08 14:31:29 +01:00
578c75cb1e
protondrive: fix signature verification logic by accounting for legacy signing scheme ( #7278 )
2023-09-08 16:00:34 +08:00
63ab250817
vfs: add --vfs-cache-min-free-space to control minimum free space on the disk containing the cache
...
See: https://forum.rclone.org/t/rclone-fails-to-control-disk-usage-and-its-filling-the-disk-to-100/41494/
2023-09-07 15:57:45 +01:00
39f910a65d
rc: add core/du to measure local disk usage
2023-09-07 15:57:45 +01:00
0fb36562dd
Add lib/diskusage to measure used/free on disks
2023-09-07 15:57:45 +01:00
8c25a15a40
Add zjx20 to contributors
2023-09-07 15:57:45 +01:00
f5ee16e201
local: rmdir return an error if the path is not a dir
2023-09-07 14:30:08 +01:00
2bcbed30bd
s3: implement backend set command to update running config
2023-09-07 12:26:48 +01:00
5026a9171d
protondrive: improves 2fa and draft error messages ( #7280 )
2023-09-07 01:50:28 +08:00
b750c50bfd
zoho: remove Range requests workarounds to fix integration tests
...
Zoho are now responding to Range requests properly. The remnants of
our old workaround was breaking the integration tests so this removes
them.
2023-09-05 18:21:15 +01:00
535acd0483
fstests: fix PublicLink failing on storj
...
Storj requires a minimum duration of 1 minute for the link expiry so
increase what we are asking for from 1 minute to 2 minutes.
2023-09-05 18:01:37 +01:00
db37b3ef9e
opendrive: fix List on a just deleted and remade directory
...
Sometimes opendrive reports "403 Folder is already deleted" on
directories which should exist.
This might be a bug in opendrive or in rclone however we work-around
here sufficient to get the tests passing.
2023-09-05 17:59:03 +01:00
257607ab3d
operations: fix TestCopyFileMaxTransfer test to not be quite so fussy
2023-09-05 17:42:17 +01:00