Nick Craig-Wood
c1a98768bc
Implement Gofile backend - fixes #4632
2024-08-14 21:15:37 +01:00
Nick Craig-Wood
bac9abebfb
lib/encoder: add Exclamation mark encoding
2024-08-14 21:15:37 +01:00
Nick Craig-Wood
27b281ef69
chunkedreader: add --vfs-read-chunk-streams to parallel read chunks
...
This converts the ChunkedReader into an interface and provides two
implementations one sequential and one parallel.
This can be used to improve the performance of the VFS on high
bandwidth or high latency links.
Fixes #4760
2024-08-14 21:13:09 +01:00
Nick Craig-Wood
10270a4354
accounting: fix race detected by the race detector
2024-08-14 21:13:09 +01:00
Nick Craig-Wood
d08b49d723
pool: Add ability to wait for a write to RW
2024-08-14 21:13:09 +01:00
Nick Craig-Wood
cb2d2d72a0
pool: Make RW thread safe so can read and write at the same time
2024-08-14 21:13:09 +01:00
Nick Craig-Wood
e686e34f89
multipart: make pool buffer size public
2024-08-14 21:13:09 +01:00
Nick Craig-Wood
5f66350331
Add Fornax to contributors
2024-08-14 21:12:56 +01:00
Nick Craig-Wood
e1d935b854
build: use go1.23 for the linter
...
This reverts commit 485aa90d13
2024-08-14 18:27:13 +01:00
Nick Craig-Wood
61b27cda80
build: fix govet lint errors with golangci-lint v1.60.1
...
There were a lot of instances of this lint error
printf: non-constant format string in call to github.com/rclone/rclone/fs.Logf (govet)
Which were fixed by re-arranging the arguments and adding "%s".
There were quite a few genuine bugs which were found too.
2024-08-14 18:25:40 +01:00
Nick Craig-Wood
83613634f9
build: bisync: fix govet lint errors with golangci-lint v1.60.1
...
There were a lot of instances of this lint error
printf: non-constant format string in call to github.com/rclone/rclone/fs.Logf (govet)
Most of these could not easily be fixed so had nolint lines added.
This should probably be done in a neater way perhaps by making
LogColorf/ErrorColorf functions.
2024-08-14 18:21:31 +01:00
Nick Craig-Wood
1c80cbd13a
build: fix staticcheck lint errors with golangci-lint v1.60.1
2024-08-14 17:48:24 +01:00
Nick Craig-Wood
9d5315a944
build: fix gosimple lint errors with golangci-lint v1.60.1
2024-08-14 17:46:12 +01:00
Nick Craig-Wood
8d1d096c11
drive: fix copying Google Docs to a backend which only supports SHA1
...
When copying Google Docs to Backblaze B2 errors like this would happen
ERROR : test.docx: Failed to calculate src hash: hash type not supported
ERROR : test.docx: corrupted on transfer: sha1 hashes differ src
This was due to an oversight in
8fd66daab6
2024-08-12 20:27:12 +01:00
Nick Craig-Wood
4b922d86d7
drive: update docs on creating admin service accounts
2024-08-12 20:27:12 +01:00
Fornax
3b3625037c
Add pixeldrain backend
...
This commit adds support for pixeldrain's experimental filesystem API.
2024-08-12 13:35:44 +01:00
kapitainsky
bfa3278f30
docs: add comment how to reduce rclone binary size ( #8000 )
...
See #7998
2024-08-10 17:52:32 +01:00
albertony
e334366345
Make listremotes long output backwards compatible - fixes #7995
...
The format was changed to include the source attribute in #7404 , but that is now
reverted and the source information is only shown in json output.
2024-08-09 17:39:00 +01:00
Nick Craig-Wood
642d4082ac
test_backend_sizes.py calculates space in the binary each backend uses #7998
2024-08-09 12:13:24 +01:00
albertony
024ff6ed15
listremotes: added options for filtering, ordering and json output
2024-08-08 13:41:31 +01:00
albertony
d6b0743cf4
config: make getting config values more consistent
2024-08-08 13:41:31 +01:00
albertony
e4749cf0d0
config: make listing of remotes more consistent
2024-08-08 13:41:31 +01:00
albertony
8d2907d8f5
config: avoid remote with empty name from environment
2024-08-08 13:41:31 +01:00
albertony
1720d3e11c
help: global flags help command extended filtering
2024-08-08 13:41:31 +01:00
albertony
c6352231e4
help: global flags help command now takes glob filter
2024-08-08 13:41:31 +01:00
albertony
731947f3ca
filter: add options for glob to regexp without anchors and special path rules
2024-08-08 13:41:31 +01:00
albertony
16d642825d
docs: remove old genautocomplete command docs and add as alias from the newer completion command
2024-08-08 13:34:10 +01:00
albertony
50aebcf403
docs: replace references to genautocomplete with the new name completion
2024-08-08 13:34:10 +01:00
Nick Craig-Wood
c8555d1b16
serve s3: update to AWS SDKv2 by updating github.com/rclone/gofakes3
...
This is the last dependency for the SDKv1 and this commit removes it
from go.mod also.
2024-08-07 16:35:39 +01:00
Nick Craig-Wood
3ec0ff5d8f
s3: fix SSE-C after SDKv2 change
...
The new SDK apparently keeds the customer key to be base64 encoded
where the old one did that for you automatically.
See: https://github.com/aws/aws-sdk-go-v2/issues/2736
See: https://forum.rclone.org/t/new-s3-backend-help-testing-needed/47139/3
2024-08-07 12:13:13 +01:00
wiserain
746516511d
pikpak: update to using AWS SDK v2 #4989
2024-08-07 12:13:13 +01:00
Nick Craig-Wood
8aef1de695
s3: fix Cloudflare R2 integration tests after SDKv2 update #4989
...
Cloudflare will normally automatically decompress files with
`Content-Encoding: gzip` when downloaded. This is not what AWS S3 does
and it breaks the integration tests.
This fudges the integration tests to upload the test file with
`Cache-Control: no-transform` on Cloudflare R2 and puts a note in the
docs about this problem.
2024-08-07 12:13:13 +01:00
Nick Craig-Wood
cb611b8330
s3: add --s3-sdk-log-mode to control SDK debugging
2024-08-07 12:13:13 +01:00
Nick Craig-Wood
66ae050a8b
s3: fix GCS provider after SDKv2 update #4989
...
This also adds GCS via S3 to the integration tester.
2024-08-07 12:13:13 +01:00
Nick Craig-Wood
fd9049c83d
s3: update to using AWS SDK v2 - fixes #4989
...
SDK v2 conversion
Changes
- `--s3-sts-endpoint` is no longer supported
- `--s3-use-unsigned-payload` to control use of trailer checksums (needed for non AWS)
2024-08-07 12:13:13 +01:00
Nick Craig-Wood
a1f52bcf50
fstest: implement method to skip ChunkedCopy tests
2024-08-06 12:45:07 +01:00
Nick Craig-Wood
0470450583
build: disable wasm/js build due to go bug
...
Rclone is too big for js/wasm until
https://github.com/golang/go/issues/64856 is fixed
2024-08-04 12:18:34 +01:00
Nick Craig-Wood
1901bae4eb
Add @dmcardle as gitannex maintainer
2024-08-01 17:48:39 +01:00
Nick Craig-Wood
9866d1c636
docs: s3: add section on using too much memory #7974
2024-08-01 16:33:09 +01:00
Nick Craig-Wood
c5c7bcdd45
docs: link the workaround for big directory syncs in the FAQ #7974
2024-08-01 16:33:09 +01:00
Nick Craig-Wood
d5c7b55ba5
Add David Seifert to contributors
2024-08-01 16:33:09 +01:00
Nick Craig-Wood
feafbfca52
Add Will Miles to contributors
2024-08-01 16:33:09 +01:00
Nick Craig-Wood
abe01179ae
Add Ernie Hershey to contributors
2024-08-01 16:33:09 +01:00
David Seifert
612c717ea0
docs: rc: fix correct _path to _root in on the fly backend docs
2024-07-30 10:19:47 +01:00
Saleh Dindar
f26d2c6ba8
fs/http: reload client certificates on expiry
...
In corporate environments, client certificates have short life times
for added security, and they get renewed automatically. This means
that client certificate can expire in the middle of long running
command such as `mount`.
This commit attempts to reload the client certificates 30s before they
expire.
This will be active for all backends which use HTTP.
2024-07-24 15:02:32 +01:00
Will Miles
dcecb0ede4
docs: clarify hasher operation
...
Add a line to the "other operations" block to indicate that the hasher overlay will apply auto-size and other checks for all commands.
2024-07-24 11:07:52 +01:00
Ernie Hershey
47588a7fd0
docs: fix typo in batcher docs for dropbox and googlephotos
2024-07-24 10:58:22 +01:00
Nick Craig-Wood
ba381f8721
b2: update versions documentation - fixes #7878
2024-07-24 10:52:05 +01:00
Nick Craig-Wood
8f0ddcca4e
s3: document need to set force_path_style for buckets with invalid DNS names
...
Fixes #6110
2024-07-23 11:34:08 +01:00
Nick Craig-Wood
404ef80025
ncdu: document that excludes are not shown - fixes #6087
2024-07-23 11:29:07 +01:00
