b296f37801
s3: fix slice bounds out of range error when listing
...
In this commit:
5f938fb9ed
s3: fix "Entry doesn't belong in directory" errors when using directory markers
We checked that the remote has the prefix and then changed the remote
before removing the prefix. This sometimes causes:
panic: runtime error: slice bounds out of range [56:55]
The fix is to do the modification of the remote after removing the
prefix.
See: https://forum.rclone.org/t/cryptcheck-panic-runtime-error-slice-bounds-out-of-range/41977
2023-09-25 11:52:23 +01:00
23e44c6065
Add rinsuki to contributors
2023-09-25 11:52:23 +01:00
8fd66daab6
drive: add support of SHA-1 and SHA-256 checksum
2023-09-24 17:38:30 +01:00
9e80d48b03
s3: add docs on how to add a new provider
2023-09-23 14:36:48 +01:00
eb3082a1eb
s3: add Linode provider
2023-09-23 14:34:00 +01:00
77ea22ac5b
s3: Factor providers list out and auto generate textual version
2023-09-23 14:34:00 +01:00
9959712a06
docs: fix backend doc generator to not output duplicate config names
...
This was always the intention, it was just implemented wrong.
This shortens the s3 docs by 1369 bringing them down to half the size
just about.
Fixes #7325
2023-09-23 12:54:08 +01:00
7586fecbca
Add Nikita Shoshin to contributors
2023-09-23 12:54:08 +01:00
94cdb00eb6
rcserver: set Last-Modified
header for files served by --rc-serve
2023-09-23 12:20:29 +01:00
3d473eb54e
docs: fix typos found by codespell in docs and code comments
2023-09-23 12:20:01 +01:00
50b4a2398e
onedrive: fix the configurator to allow /teams/ID in the config
...
See: https://forum.rclone.org/t/sharepoint-to-google/41548/
2023-09-22 15:54:22 +01:00
e6b718c938
build: add btesth target to output beta log in HTML for email pasting
2023-09-21 16:15:48 +01:00
9370dbcc47
lsjson: make sure we set the global metadata flag too
2023-09-21 16:15:38 +01:00
8c1e9a2905
rc: always report an error as JSON
...
Before this change, the rclone rc command wouldn't actually report the
error as a JSON blob which is inconsitent with what the HTTP API does.
This change make sure we always report a JSON error, making a
synthetic one if necessary.
See: https://forum.rclone.org/t/when-using-rclone-rc-commands-somehow-return-errors-as-parsable-json/41855
Co-authored-by: Fawzib Rojas
2023-09-20 21:57:40 +01:00
6072d314e1
b2: fix multipart upload: corrupted on transfer: sizes differ XXX vs 0
...
Before this change the b2 backend wasn't writing the metadata to the
object properly after a multipart upload.
The symptom of this was that sometimes it would give the error:
corrupted on transfer: sizes differ XXX vs 0
This was fixed by returning the metadata in the chunk writer and setting it in Update.
See: https://forum.rclone.org/t/multipart-upload-to-b2-sometimes-failing-with-corrupted-on-transfer-sizes-differ/41829
2023-09-18 20:41:31 +01:00
9277ca1e54
b2: implement --b2-lifecycle to control lifecycle when creating buckets
2023-09-16 17:01:43 +01:00
d6722607cb
b2: implement "rclone backend lifecycle" to read and set bucket lifecycles
2023-09-16 16:44:28 +01:00
4ef30db209
b2: fix listing all buckets when not needed
...
Before this change the b2 backend listed all the buckets to turn a
single bucket name into an ID.
However in July 26, 2018 a parameter was added to the list buckets API
to make listing all the buckets unecessary.
This code sets the bucketName parameter so that only the results for
the desired bucket are returned.
2023-09-16 16:04:50 +01:00
55c12c9a2d
azureblob: fix "fatal error: concurrent map writes"
...
Before this change, the metadata map could be accessed from multiple
goroutines at once, sometimes causing this error.
This fix adds a global mutex for adjusting the metadata map to make
all accesses safe.
See: https://forum.rclone.org/t/azure-blob-storage-with-vfs-cache-concurrent-map-writes-exception/41686
2023-09-16 11:33:03 +01:00
4349dae784
build(deps): bump docker/setup-qemu-action from 2 to 3
...
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action ) from 2 to 3.
- [Release notes](https://github.com/docker/setup-qemu-action/releases )
- [Commits](https://github.com/docker/setup-qemu-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-09-15 10:25:14 +01:00
3e63f2c249
box: add more logging for polling
2023-09-15 10:24:43 +01:00
5118ab9609
box: filter more EventIDs when polling
2023-09-15 10:24:43 +01:00
7ea118aeae
build(deps): bump docker/setup-buildx-action from 2 to 3
...
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) from 2 to 3.
- [Release notes](https://github.com/docker/setup-buildx-action/releases )
- [Commits](https://github.com/docker/setup-buildx-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/setup-buildx-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-09-15 09:15:26 +01:00
af260921c0
storj: update storj.io/uplink to v1.12.0
...
The improved upload logic is active by default in uplink v1.12.0, so the
`testuplink.WithConcurrentSegmentUploadsDefaultConfig(ctx)` is not
required anymore.
See https://github.com/rclone/rclone/pull/7198
2023-09-14 14:01:35 +01:00
62db2bb329
docs: add notes on how to update the website between releases
2023-09-13 17:02:29 +01:00
8d58adbd54
docs: remove minio sponsor box for the moment
2023-09-13 17:02:29 +01:00
b4d251081f
docs: update Storj partner link
2023-09-13 17:02:29 +01:00
a382bf8f03
Add Herby Gillot to contributors
2023-09-13 17:02:29 +01:00
28fc43fb11
Add Pat Patterson to contributors
2023-09-13 17:02:29 +01:00
83be1501db
docs: add MacPorts install info
...
https://ports.macports.org/port/rclone/
2023-09-13 16:06:15 +01:00
be156133c5
build(deps): bump docker/metadata-action from 4 to 5
...
Bumps [docker/metadata-action](https://github.com/docker/metadata-action ) from 4 to 5.
- [Release notes](https://github.com/docker/metadata-action/releases )
- [Upgrade guide](https://github.com/docker/metadata-action/blob/master/UPGRADE.md )
- [Commits](https://github.com/docker/metadata-action/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: docker/metadata-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-09-13 15:56:38 +01:00
d494db78d9
build(deps): bump docker/login-action from 2 to 3
...
Bumps [docker/login-action](https://github.com/docker/login-action ) from 2 to 3.
- [Release notes](https://github.com/docker/login-action/releases )
- [Commits](https://github.com/docker/login-action/compare/v2...v3 )
---
updated-dependencies:
- dependency-name: docker/login-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-09-13 15:55:58 +01:00
1b9eb74204
build(deps): bump docker/build-push-action from 4 to 5
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 4 to 5.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-09-13 15:55:23 +01:00
cda09704a8
fix overview of oracle object storage as it supports multithreaded
2023-09-13 12:14:07 +01:00
71f2883562
operations: ensure concurrency is no greater than the number of chunks - fixes #7299
2023-09-13 12:12:27 +01:00
d29d263329
docs: fix minimum Go version and update to 1.18
...
Fixes #7288
2023-09-12 11:24:17 +01:00
20126de1aa
Start v1.65.0-DEV development
2023-09-12 11:24:17 +01:00
77f7bb08af
Version v1.64.0
v1.64.0
2023-09-11 15:59:44 +01:00
a5a61f4874
protondrive: make cached keys rclone style and not show with rclone config redacted
2023-09-11 15:57:08 +01:00
e8879f3e77
docs: document release signing and verification
...
Fixes #7257
2023-09-11 12:28:23 +01:00
2a6675cffd
docs: fix typo in rc docs - fixes #7287
2023-09-11 09:34:22 +01:00
fa4d171f62
protondrive: complete docs with all references to Proton Drive
2023-09-10 11:57:39 +01:00
d4d530bd8e
drive: add --drive-fast-list-bug-fix to control ListR bug workaround
...
See: https://forum.rclone.org/t/how-to-list-empty-directories-recursively/40995/12
2023-09-09 17:46:03 +01:00
f4b011e4e4
s3: add rclone backend restore-status command
...
This command shows the restore status of objects being retrieved from GLACIER.
See: https://forum.rclone.org/t/aws-s3-glacier-monitor-restore-status-command-for-glacier-restoring-process/41373/7
2023-09-09 17:44:36 +01:00
d80890bf32
Add Drew Stinnett to contributors
2023-09-09 17:44:36 +01:00
39392d70dd
Add David Pedersen to contributors
2023-09-09 17:44:36 +01:00
643386f026
rc: Add operations/settier to API
2023-09-09 17:41:02 +01:00
ed755bf04f
protondrive: implement two-password mode ( #7279 )
2023-09-08 22:54:46 +02:00
071c3f28e5
vfs: Update parent directory modtimes on vfs actions
...
This isn't written back to the storage so might change on remount but
makes the VFS just a little more POSIX compatible.
2023-09-08 17:19:52 +01:00
7453b7d5f3
hdfs: fix retry "replication in progress" errors when uploading
...
Before this change uploaded files could return the error "replication
in progress".
This error is harmless though and means the Close should be retried
which is what this patch does.
2023-09-08 15:35:50 +01:00