Alex Chen
1c3c8babd3
docs: mention make for building and cmount tag for macos ( #5487 )
2021-10-19 12:18:06 +08:00
Ivan Andreev
690a7ac783
chunker: fix md5all test for no-meta test remotes
2021-10-18 18:04:07 +03:00
Ivan Andreev
bbcc9a45fe
serve/docker: allow to customize proxy settings of docker plugin
2021-10-18 18:03:06 +03:00
albertony
16949fde09
Do not override mime types from os defaults
...
https://forum.rclone.org/t/rclone-serve-http-save-as/26672
2021-10-18 13:28:22 +01:00
r0kk3rz
8e4b87ae03
s3: Add AWS Snowball Edge to providers examples - fixes #5720
2021-10-18 12:52:59 +01:00
Rajat Goel
db6002952e
dropbox: upgrade sdk version
2021-10-16 10:55:02 +01:00
Nick Craig-Wood
96e14bf456
sftp: fix initialization bug introduced by fs.ErrorIsDir return
...
3fbaa4c0b0
backends: make NewObject return fs.ErrorIsDir if possible
2021-10-16 10:38:24 +01:00
Nick Craig-Wood
54da6154c4
operations: fix lsjson --stat on root directories of bucket based backends
2021-10-16 10:38:24 +01:00
Ivan Andreev
f50537b64b
ftp: add option to disable tls13
2021-10-15 20:24:37 +03:00
Ivan Andreev
f37b25a2df
ftp: enable tls session cache by default
2021-10-15 19:54:25 +03:00
albertony
29b8c71522
build: force utf8 when updating backend docs from python script ( #5721 )
2021-10-15 18:51:57 +02:00
Nick Craig-Wood
7b66ca132d
build: increase timeout for golangci-lint to 10 minutes
2021-10-15 15:58:52 +01:00
Nick Craig-Wood
9ce0df3242
dropbox: add --dropbox-batch-commit-timeout to control batch timeout
...
This also adds an Debug message log showing how long each batch took
See: #5491
2021-10-15 15:32:40 +01:00
Nick Craig-Wood
f4c5f1f185
box: retry operation_blocked_temporary errors #5545
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
825f7826f5
box: add --box-owned-by to only show items owned by the login passed #5545
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
34140b2f57
box: delete items in parallel in cleanup using --checkers threads #5545
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
e18ae5da09
box: factor directory listing and cleanup listing into one function #5545
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
b61912b4c8
box: add --box-list-chunk to control listing chunk size #5545
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
bfecf5301b
box: when doing cleanup delete as much as possible - fixes #5545
...
Before this change the cleanup routine exited on the first deletion
error.
This change counts any errors on deletion and exits when the iteration
is complete with an error showing the number of deletion failures.
Deletion failures will be logged.
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
308323e9c4
box: make listings of heavily used directories more reliable #5545
...
Before this change we uses limit/offset paging for directories in the
main directory listing routine and in the trash cleanup listing.
This switches to the new scheme of limit/marker which is more reliable
on a directory which is continuously changing. It has the disadvantage
that it doesn't tell us the total number of items available, however
that wasn't information rclone uses.
2021-10-15 15:28:54 +01:00
Nick Craig-Wood
fc5d6c16b6
serve ftp: ensure modtime is passed as UTC always to fix timezone oddities
...
See: https://forum.rclone.org/t/ftp-server-reports-file-timestamps-in-utc/26274
2021-10-15 15:25:51 +01:00
Nick Craig-Wood
c821fbeddf
drive: add -o config
option to backend drives
to config for all shared drives
...
See: https://forum.rclone.org/t/bulk-create-remotes-to-existing-google-shared-drives/26837/
2021-10-15 15:22:14 +01:00
Nick Craig-Wood
93d85015af
sftp: fix timeout when doing MD5SUM of large file
...
Before this change we were timing out MD5SUMs after 1 minute because
rclone was closing the SSH session when there were sessions still
aftive.
This change counts sessions active for all SSH sessions now (Upload,
Download, Hashes and running commands).
See: https://forum.rclone.org/t/while-rclone-copying-large-files-md5sum-failed-with-exit-status/26845/
2021-10-15 15:19:22 +01:00
Nick Craig-Wood
a98e3ea6f1
build: replace the deprecated golint linter with revive
...
This fixes up a small number of new lint items also
2021-10-15 12:51:31 +01:00
Nick Craig-Wood
167406bc68
build: switch to using the golangci-lint action for better error reporting
...
The action reports errors to users in their pull requests which is
much easier to understand.
2021-10-15 12:50:22 +01:00
Nick Craig-Wood
036abde393
build: fix indentation in build.yml
2021-10-15 12:50:22 +01:00
Nick Craig-Wood
edf8978d15
operations: fix HashSum tests after removing ERROR and UNSUPPORTED
...
This was caused by
7a1cab57b6
cmd/hashsum: dont put ERROR or UNSUPPORTED in output
And was picked up in the integration tests.
This patch no longer calls the HashLister for unsupported hash types.
2021-10-15 10:51:08 +01:00
Nick Craig-Wood
f529c02446
lsjson: add --stat flag and operations/stat api
...
This enables information about single files to be efficiently
retrieved.
2021-10-14 17:15:50 +01:00
Nick Craig-Wood
3fbaa4c0b0
backends: make NewObject return fs.ErrorIsDir if possible
...
This changes the interface to NewObject so that if NewObject is called
on a directory then it should return fs.ErrorIsDir if possible without
doing any extra work, otherwise fs.ErrorObjectNotFound.
Tested on integration test server with:
go run integration-test.go -tests backend -run TestIntegration/FsMkdir/FsPutFiles/FsNewObjectDir -branch fix-stat -maxtries 1
2021-10-14 17:15:50 +01:00
Nick Craig-Wood
af732c5431
Add Logeshwaran to contributors
2021-10-14 17:15:48 +01:00
Nick Craig-Wood
14de0cfb43
Add Joda Stößer to contributors
2021-10-14 17:14:53 +01:00
albertony
c2597a4fa3
docs: cleanup header levels in backend docs ( #5698 )
2021-10-14 15:40:18 +02:00
Logeshwaran
ceaafe6620
s3: add support to use CDN URL to download the file
...
The egress charges while using a CloudFront CDN url is cheaper when
compared to accessing the file directly from S3. So added a download
URL advanced option, which when set downloads the file using it.
2021-10-14 11:19:38 +01:00
Joda Stößer
d41b9b46d4
docs: improve ordered list prefix for drive.md
2021-10-14 11:08:15 +01:00
Joda Stößer
98d9ba363f
.github: correct contribution link in pull request template
2021-10-14 11:07:25 +01:00
Ivan Andreev
16fb608bee
hashsum: treat hash values in sum file as case insensitive
...
Also warn duplicate file paths in sum files.
Fixes https://forum.rclone.org/t/rclone-check-sum/25566/45
2021-10-13 18:21:34 +03:00
Ivan Andreev
cf9b82b8db
chunker: md5all must create metadata if base hash is slow
...
Before this patch the md5all option would skip creating metadata with
hashsum if base filesystem provided md5, in hope to pass it through.
However, if base hash is slow (for example on local fs), chunker passed
slow md5 but never reported this fact in features.
This patch makes chunker snapshot base hashsum in metadata when md5all is
set and base hashsum is slow since chunker was intended to provide only
instant hashsums from the start.
Fixes #5508
2021-10-13 16:18:08 +03:00
albertony
7d66bfbb7c
docs: toc styling ( #5695 )
2021-10-13 15:04:11 +02:00
Nolan Woods
023e32de05
lib/http: Factor password hash salt into options with default
2021-10-13 11:33:38 +01:00
Nolan Woods
b1cb41f8da
lib/http: Fix bad username check in single auth secret provider
2021-10-13 11:33:38 +01:00
Nick Craig-Wood
1cb31e8cc7
crypt: fix uploads with --crypt-no-data-encryption
...
Before this change, when uploading to a crypt, the ObjectInfo
accidentally used the encrypted size, not the unencrypted size when
--crypt-no-data-encryption was set.
Fixes #5498
2021-10-12 17:12:41 +01:00
Ivan Andreev
1e7db7193e
docs: note minimum supported docker engine
2021-10-12 13:27:20 +03:00
Ivan Andreev
7190c058a7
crypt: return wrapped object even with no-data-encryption
...
In presence of no_data_encryption the Crypt's Put method used to over-optimize
and returned base object. This patch makes it return Crypt-wrapped object now.
Fixes #5498
2021-10-12 00:41:12 +03:00
albertony
85074f8f88
librclone: add RcloneFreeString function
...
See PR #5703
Based on initial work by Weng Haoyu (@wengh) in PR #5362
2021-10-11 19:10:07 +02:00
albertony
c7329d2ece
docs: add section in install documentation about portable install
...
See #5591
2021-10-11 15:08:35 +02:00
albertony
f3e71f129c
config: convert --cache-dir value to an absolute path
2021-10-11 15:08:35 +02:00
albertony
0ffdca42d5
docs: document --cache-dir flag
2021-10-11 15:08:35 +02:00
albertony
dbb6f94d95
config: make temporary directory user-configurable
...
See #5591
2021-10-11 15:08:35 +02:00
albertony
352f9bcd47
config: add paths command to show configured paths
...
See #5591
2021-10-11 15:08:35 +02:00
Nick Craig-Wood
d8886b37a6
serve sftp: update docs on host key generation
2021-10-11 10:43:16 +01:00