Commit Graph

2667 Commits

Author SHA1 Message Date
9133fd03df Add Oleksiy Stashok to contributors 2025-06-04 10:54:31 +01:00
3c66d9ccb1 backend/s3: require custom endpoint for Lyve Cloud v2 support
Lyve Cloud v2 no longer provides a shared S3 endpoint like v1 did. Instead, each customer receives
a unique, reseller-specific endpoint. To reflect this change, the S3 backend now requires users to
manually enter their endpoint when selecting Lyve Cloud as a provider.
Previously, users selected from a list of hardcoded Lyve Cloud v1 endpoints. This was not compatible
with Lyve Cloud v2 accounts and could cause confusion or misconfiguration.

This change:
- Removes outdated pre-defined endpoint selection for Lyve Cloud
- Requires users to provide their own endpoint
- Adds a format example to guide correct usage

Before: Users selected a fixed endpoint from a list (v1 only)
After:  Users must input their own endpoint (v2-compatible)
2025-06-03 16:19:41 +01:00
aeb43c6a4c Add Jeremy Daer to contributors 2025-06-02 17:22:37 +01:00
12322a2141 Add wbulot to contributors 2025-06-02 17:22:37 +01:00
4fd5a3d0a2 s3: add Pure Storage FlashBlade provider support (#8575)
Pure Storage FlashBlade is an enterprise object storage platform that
provides S3-compatible APIs. This change adds FlashBlade as a new
provider option in the S3 backend.

Before this change, FlashBlade users had to use the "Other" provider
with manual configuration of various compatibility flags. This often
resulted in suboptimal performance due to conservative default settings.

After this change, users can select the "FlashBlade" S3 provider and
get an optimal configuration:

- ListObjectsV2 enabled for better performance
- AWS-compatible multipart ETags for reliable transfers
- Proper handling of "AlreadyOwnedByYou" bucket creation responses
- Path-style URLs by default (virtual-host style with DNS setup)
- Unsigned payloads to ensure compatibility with all rclone features

FlashBlade supports modern S3 features including trailer checksum
algorithms (SHA256, CRC32, CRC32C), object versioning, and lifecycle
management.

Provider settings were verified by testing against a FlashBlade//E
system running Purity//FB 4.5.7.

Documentation and test configurations are included.

Integration test results:
```
go test -v -fast-list -remote TestS3FlashBlade:
PASS
ok  	github.com/rclone/rclone/backend/s3	232.444s
```
2025-05-30 12:35:13 +01:00
15510c66d4 log: add --windows-event-log-level to support Windows Event Log
This provides JSON logs in the Windows Event Log.
2025-05-23 11:27:49 +01:00
dfa4d94827 fs: Remove github.com/sirupsen/logrus and replace with log/slog
This removes logrus which is not developed any more and replaces it
with the new log/slog from the Go standard library.

It implements its own slog Handler which is backwards compatible with
all of rclone's previous logging modes.
2025-05-23 11:27:49 +01:00
36b89960e3 Add fhuber to contributors 2025-05-23 11:27:49 +01:00
b8fde4fc46 Changelog updates from Version v1.69.3 2025-05-22 09:55:00 +01:00
ebcf51336e Add Germán Casares to contributors 2025-05-15 15:25:10 +01:00
a334bba643 Add Jeff Geerling to contributors 2025-05-15 15:25:10 +01:00
d4fd93e7f3 googlephotos: update read only and read write scopes to meet Google's requirements.
As part of changes to the Google Photos APIs the scopes rclone used
for accessing Google photos have been removed.

This commit replaces the scopes with updated ones.

These aren't as powerful as the old scopes - this means rclone will
only be able to download photos it uploaded from March 31, 2025.

To use these new scopes do `rclone reconnect yourgooglephotosremote:`

Fixes #8434

Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2025-05-12 16:43:23 +01:00
68a65e878f docs: add hint about config touch and config file not found 2025-05-09 08:30:34 +01:00
7606ad8294 docs: add FAQ for dismissing 'rclone.conf not found'
See: https://forum.rclone.org/t/notice-about-missing-rclone-conf-is-annoying/51116
2025-05-09 08:23:31 +02:00
2e879586bd Add Clément Wehrung to contributors 2025-05-08 17:16:28 +01:00
fe880c0fac docs: move --max-connections documentation to the correct place 2025-05-06 15:23:55 +01:00
b160089be7 Add Ben Boeckel to contributors 2025-05-06 15:23:55 +01:00
c2254164f8 Add Tho Neyugn to contributors 2025-05-06 15:23:55 +01:00
e57b94c4ac docs: fix typo in s3/storj docs 2025-05-04 18:57:47 +02:00
f5501edfcf Changelog updates from Version 1.69.2 2025-05-01 16:43:16 +01:00
9f0e237931 Add Jugal Kishore to contributors 2025-04-29 14:16:09 +01:00
b94f80b9d7 docs: Update contributors
- Add Andrew Kreimer to contributors
- Add Christian Richter to contributors
- Add Ed Craig-Wood to contributors
- Add Klaas Freitag to contributors
- Add Ralf Haferkamp to contributors
2025-04-25 12:14:37 +01:00
6adb4056bb docs: fix typos via codespell
There are some types in the changelog.

Fix them via codespell.
2025-04-16 09:24:01 +02:00
0b9671313b webdav: add an ownCloud Infinite Scale vendor that enables tus chunked upload support
This change adds a new vendor called "infinitescale" to the webdav
backend. It enables the ownCloud Infinite Scale
https://github.com/owncloud/ocis project and implements its specific
chunked uploader following the tus protocol https://tus.io

Signed-off-by: Christian Richter <crichter@owncloud.com>
Co-authored-by: Klaas Freitag <klaas.freitag@kiteworks.com>
Co-authored-by: Christian Richter <crichter@owncloud.com>
Co-authored-by: Christian Richter <1058116+dragonchaser@users.noreply.github.com>
Co-authored-by: Ralf Haferkamp <r.haferkamp@opencloud.eu>
2025-04-11 12:23:55 +01:00
7af1a930b7 Add Ben Alex to contributors 2025-04-11 10:38:51 +01:00
6e46ee4ffa Add simwai to contributors 2025-04-11 10:38:51 +01:00
078d202f39 cloudinary: automatically add/remove known media files extensions #8416 2025-04-09 15:03:59 +01:00
3e105f7e58 Add Markus Gerstel to contributors 2025-04-09 15:03:59 +01:00
02ca72e30c Add Enduriel to contributors 2025-04-09 15:03:59 +01:00
e567c52457 Add huanghaojun to contributors 2025-04-09 15:03:59 +01:00
10501d0398 Add simonmcnair to contributors 2025-04-09 15:03:59 +01:00
972ed42661 Add Samantha Bowen to contributors 2025-04-09 15:03:59 +01:00
48802b0a3b s3: documentation regression - fixes #8438
We lost a previous documentation fix (#7077) detailing how to restore
single objects from AWS S3 Glacier.

Also make clearer that rclone provides restore functionality natively.

Co-authored-by: danielkrajnik <dan94kra@gmail.com>
2025-04-09 14:18:18 +01:00
a5d03e0ada docs: update fuse version in docker docs 2025-04-09 11:54:06 +01:00
cf571ad661 rc: In options/info make FieldName contain a "." if it should be nested
Before this would have Output "FieldName": "ListenAddr" where it
actually needs to be set in a sub object "HTTP".

After this fix it outputs "FieldName": "HTTP.ListenAddr" to indicate
"ListenAddr" needs to be set in the object "HTTP".
2025-04-09 11:12:07 +01:00
efe8ac8f35 Add Danny Garside to contributors 2025-04-09 11:12:06 +01:00
894ef3b375 docs: fix minor typo in box docs 2025-04-08 20:51:22 +01:00
385465bfa9 sync: implement --list-cutoff to allow on disk sorting for reduced memory use
Before this change, rclone had to load an entire directory into RAM in
order to sort it so it could be synced.

With directories with millions of entries, this used too much memory.

This fixes the probem by using an on disk sort when there are more
than --list-cutoff entries in a directory.

Fixes #7974
2025-04-08 18:02:24 +01:00
525798e1a5 Add Klaas Freitag to contributors 2025-04-07 13:41:29 +01:00
ea63052d36 Add eccoisle to contributors 2025-04-07 13:41:29 +01:00
b5a99c5011 Add Fernando Fernández to contributors 2025-04-07 13:41:29 +01:00
56b7015675 Add alingse to contributors 2025-04-07 13:41:29 +01:00
4ff970ebab Add Jörn Friedrich Dreyer to contributors 2025-04-07 13:41:29 +01:00
19aa366d88 pool: add --max-buffer-memory to limit total buffer memory usage 2025-03-17 18:01:15 +00:00
3fb4164d87 filter: Add --hash-filter to deterministically select a subset of files
Fixes #8400
2025-03-17 17:25:59 +00:00
6e7a3795f1 Add jack to contributors 2025-03-10 22:07:19 +00:00
aab6643cea docs: update minimum OS requirements for go1.24 2025-03-05 17:20:10 +00:00
85d467e16a Add luzpaz to contributors 2025-02-21 15:53:44 +00:00
cf4b55d965 Add Dave Vasilevsky to contributors 2025-02-21 15:53:10 +00:00
904c9b2e24 Dropbox: Support Dropbox Paper
These files must be "exported" to be useful. The export process
is controlled by the --dropbox-export-formats flag  and the ancilliary flags
--dropbox-skip-exports and --dropbox-show-all-exports modeled on the
Google drive equivalents
2025-02-17 18:20:37 +00:00