Nick Craig-Wood
aef9c2117e
serve s3: add serve rc interface
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
2a42d95385
serve dlna: add serve rc interface
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
e37775bb41
serve webdav: add serve rc interface - fixes #4505
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
780f4040ea
serve http: add serve rc interface
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
0b7be6ffb9
serve nfs: add serve rc interface
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
4d9a165e56
serve: Add rc control for serve commands #4505
...
This adds the framework for serving. The individual servers will be
added in separate commits.
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
21e5fa192a
configstruct: add SetAny to parse config from the rc
...
Now that we have unified the config, we can make a much more
convenient rc interface which mirrors the command line exactly, rather
than using the structure of the internal Go structs.
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
cf571ad661
rc: In options/info make FieldName contain a "." if it should be nested
...
Before this would have Output "FieldName": "ListenAddr" where it
actually needs to be set in a sub object "HTTP".
After this fix it outputs "FieldName": "HTTP.ListenAddr" to indicate
"ListenAddr" needs to be set in the object "HTTP".
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
b1456835d8
serve restic: convert options to new style
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
b930c4b437
serve s3: convert options to new style
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
cebd588092
serve http: convert options to new style
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
3c981e6c2c
serve webdav: convert options to new style
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
6054c4e49d
auth proxy: convert options to new style
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
028316ba5d
auth proxy: add VFS options parameter for use for default VFS
...
This is for use from the RC API.
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
df457f5802
serve: make the servers self registering
...
This is so that they can import cmd/serve without causing an import
loop.
The active servers can now be configured by commenting lines out in
cmd/all/all.go like all the other commands.
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
084e35c49d
lib/http: fix race between Serve() and Shutdown()
...
This was discovered by the race detector.
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
90ea4a73ad
lib/http: add Addr() method to return the first configured server address
2025-04-09 11:12:07 +01:00
Nick Craig-Wood
efe8ac8f35
Add Danny Garside to contributors
2025-04-09 11:12:06 +01:00
Danny Garside
894ef3b375
docs: fix minor typo in box docs
2025-04-08 20:51:22 +01:00
Nick Craig-Wood
385465bfa9
sync: implement --list-cutoff to allow on disk sorting for reduced memory use
...
Before this change, rclone had to load an entire directory into RAM in
order to sort it so it could be synced.
With directories with millions of entries, this used too much memory.
This fixes the probem by using an on disk sort when there are more
than --list-cutoff entries in a directory.
Fixes #7974
2025-04-08 18:02:24 +01:00
Nick Craig-Wood
0148bd4668
march: Implement callback based syncing
...
This changes the syncing method to take callbacks for directory
listings rather than being passed the entire directory listing at
once.
This will enable out of memory syncing.
2025-04-08 18:02:24 +01:00
Nick Craig-Wood
0f7ecf6f06
list: add ListDirSortedFn for callback oriented directory listing
...
This will be used for the out of memory sync
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
08e81f8420
list: Implement Sorter to sort directory entries
...
Later this will be extended to do out of memory sorts
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
0ac2d2f50f
cache: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
42fcb0a6fc
hasher: implement ListP interface
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
490dd14bc5
compress: implement ListP interface
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
943ea0acae
chunker: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
d64a97f973
union: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
5d8f1d4b88
crypt: implement ListP interface
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
b1d774c2e3
combine: implement ListP interface
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
fad579c4a2
s3: Implement paged listing interface ListP
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
37120ef7bd
list: add WithListP helper to implement List for ListP backends
2025-04-08 15:14:09 +01:00
Nick Craig-Wood
cba653d502
walk: move NewListRHelper into list.Helper to avoid circular dependency
...
It turns out that the list helpers were at the wrong level and needed
to be pushed down into the fs/list for future work.
2025-04-08 15:14:00 +01:00
Nick Craig-Wood
2a90de9502
fs: define ListP interface for paged listing #4788
2025-04-08 15:12:53 +01:00
Nick Craig-Wood
bff229713a
accounting: Add listed stat for number of directory entries listed
2025-04-08 15:12:53 +01:00
Nick Craig-Wood
117f583ebe
walk: factor Listing helpers into their own file and add tests
2025-04-08 15:12:53 +01:00
Nick Craig-Wood
205667143c
serve nfs: make metadata files have special file handles
...
Metadata files have the file handle of their source file with
0x00000001 suffixed in big endian so we can look them up directly from
their file handles.
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
fe84cbdc9d
serve nfs: change the format of --nfs-cache-type symlink file handles
...
This is an backwards incompatible change which will invalidate the
current handles.
This change adds a 4 byte big endian length prefix to the handles so
we can in future suffix extra info on the handles. This needed to be 4
bytes as Linux does not like File handles which aren't multiples of 4
bytes long.
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
533c6438f3
vfs: add --vfs-metadata-extension to expose metadata sidecar files
...
This adds --vfs-metadata-extension which can be used to expose sidecar
files with file metadata in. These files don't exist in the listings
until they are accessed.
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
b587b094c9
docs: Add rcloneui.com as Silver Sponsor
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
525798e1a5
Add Klaas Freitag to contributors
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
ea63052d36
Add eccoisle to contributors
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
b5a99c5011
Add Fernando Fernández to contributors
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
56b7015675
Add alingse to contributors
2025-04-07 13:41:29 +01:00
Nick Craig-Wood
4ff970ebab
Add Jörn Friedrich Dreyer to contributors
2025-04-07 13:41:29 +01:00
eccoisle
dccb5144c3
docs: replace option --auto-filename-header with --header-filename
2025-04-06 14:28:34 +02:00
dependabot[bot]
33b087171a
build: update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204
...
Bumps [github.com/golang-jwt/jwt/v5](https://github.com/golang-jwt/jwt ) from 5.2.1 to 5.2.2.
- [Release notes](https://github.com/golang-jwt/jwt/releases )
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md )
- [Commits](https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 )
See: https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp
See: https://www.cve.org/CVERecord?id=CVE-2025-30204
Signed-off-by: dependabot[bot] <support@github.com>
2025-04-06 11:46:13 +01:00
Fernando Fernández
58d9ae1c60
docs/googlephotos: fix typos
2025-04-06 10:49:02 +02:00
dependabot[bot]
20302ab6b9
build: bump github.com/golang-jwt/jwt/v4 from 4.5.1 to 4.5.2
...
Bumps [github.com/golang-jwt/jwt/v4](https://github.com/golang-jwt/jwt ) from 4.5.1 to 4.5.2.
- [Release notes](https://github.com/golang-jwt/jwt/releases )
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md )
- [Commits](https://github.com/golang-jwt/jwt/compare/v4.5.1...v4.5.2 )
---
updated-dependencies:
- dependency-name: github.com/golang-jwt/jwt/v4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-04-04 17:26:44 +02:00
alingse
6fb0de62a4
operations: fix call fmt.Errorf with wrong err
2025-04-04 16:21:45 +02:00
