Nick Craig-Wood
75fc3fe389
fs: fix FixRangeOption so it doesn't add HTTPOptions in place of bad Ranges
...
Before this fix, FixRangeOption would substitute RangeOptions it
wanted to get rid of with with empty HTTPOption. This caused a problem
now that backends interpret HTTPOptions.
This fix subsitutes those with NullOptions which aren't interpreted as
HTTPOptions. This patch also improves the unit tests.
2020-04-24 12:32:09 +01:00
Xiaoxing Ye
c4572ebc91
rc: fix misplaced http server config - fixes #4130
2020-04-23 20:22:47 +01:00
David
e56976839a
jwtutil: Fix error handling
2020-04-23 17:52:14 +01:00
David
0c0ed2fe04
box: Remove unnecessary iat from jws claims
2020-04-23 17:52:14 +01:00
Nick Craig-Wood
ab6ed256e5
putio: add support for --header-upload and --header-download #59
2020-04-23 15:55:52 +01:00
Nick Craig-Wood
7c98ecd3ab
putio: make downloading files use the rclone http Client
...
This fixes `--download-header` and these transactions being missed from
`--dump bodies` or `--tpslimit`
2020-04-23 15:48:30 +01:00
Nick Craig-Wood
f6346a4d29
fs: add --header flag to add options to every HTTP transaction #59
2020-04-23 15:24:21 +01:00
Nick Craig-Wood
b502a74cff
gcs: add support for --header-upload and --header-download #59
2020-04-23 11:41:57 +01:00
Nick Craig-Wood
8e9c25063a
swift: add support for --header-upload and --header-download #59
2020-04-23 11:34:36 +01:00
Nick Craig-Wood
1dced3b3c4
rcat: add support for --header-upload #59
2020-04-23 11:34:31 +01:00
Nick Craig-Wood
087bf1d584
cat: add support for --header-download #59
2020-04-23 11:34:24 +01:00
Nick Craig-Wood
e051a34fc1
dbhashsum: deprecate: use rclone hashsum DropboxHash instead
2020-04-23 11:13:13 +01:00
Nick Craig-Wood
f5455d865b
accounting: check for max transfer in WriteTo
...
Before this change the max transfer tests were failing for remotes
which were using WriterTo.
2020-04-23 11:13:13 +01:00
Tim Gallant
b705ead3fd
docs: adds --header-download and --header-upload
2020-04-23 11:07:21 +01:00
Tim Gallant
c390fc8100
onedrive: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
14f6ce1e77
premiumizeme: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
385542e2f9
sharefile: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
fc946d0c44
fichier: pass options to rest.Opts for uploadFile
2020-04-23 11:07:21 +01:00
Tim Gallant
854c84d0ca
pcloud: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
90bd0eb44c
webdav: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
3130f870bb
sugarsync: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
51b617f601
yandex: pass options to rest.Opts for upload
2020-04-23 11:07:21 +01:00
Tim Gallant
011ca244b2
jottacloud: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
9ea1361044
googlephotos: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
776966e22c
opendrive: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
Tim Gallant
01cb256b84
box: pass options to rest.Opts for uploadPart
2020-04-23 11:07:21 +01:00
Tim Gallant
0b0163dde2
box: pass options to rest.Opts for upload
2020-04-23 11:07:21 +01:00
Tim Gallant
38123c70eb
b2: pass options to rest.Opts for Update
2020-04-23 11:07:21 +01:00
Tim Gallant
5cb7229a16
s3: add support for HTTPOption
2020-04-23 11:07:21 +01:00
Tim Gallant
9bf3d3da4c
fs: add UploadHeaders, DownloadHeaders to Update/Put/Open options
2020-04-23 11:07:21 +01:00
Tim Gallant
93caa459e3
fs/config: add header-download and header-upload flags
2020-04-23 11:07:21 +01:00
Nick Craig-Wood
f8039deb7c
s3: fix detection of BucketAlreadyOwnedByYou and BucketAlreadyExists error
...
This was being silently ignored until this commit
e2bf91452a
s3: report errors on bucket creation (mkdir) correctly
2020-04-22 18:14:03 +01:00
Nick Craig-Wood
86eaf43b00
vfs: fix tests for Statfs when running on backends with unknowns
...
This was broken in da41db4712
2020-04-22 18:14:03 +01:00
Nick Craig-Wood
8176202e6d
Add Sunil Patra to contributors
2020-04-22 18:14:03 +01:00
Nick Craig-Wood
1b74879b8b
Add David Bramwell to contributors
2020-04-22 18:14:03 +01:00
Sunil Patra
39319b4858
@Sunil-P
...
box: Added support for interchangeable root folder for Box backend - #3422
2020-04-22 17:00:13 +01:00
Sunil Patra
4af5c9aed7
pCloud: Added support for interchangeable root folder for pCloud backend - #3957
2020-04-22 16:58:01 +01:00
David Bramwell
8a3c4c6a7b
box: add token renew function for jwt auth - Fixes #4901
2020-04-22 16:53:03 +01:00
Nick Craig-Wood
d22e6f5a96
cryptcheck: remove duplicated debug OK message
2020-04-22 11:33:48 +01:00
Nick Craig-Wood
1648c1a0f3
crypt: calculate hashes for uploads from local disk
...
Before this change crypt would not calculate hashes for files it was
uploading. This is because, in the general case, they have to be
downloaded, encrypted and hashed which is too resource intensive.
However this causes backends which need the hash first before
uploading (eg s3/b2 when uploading chunked files) not to have a hash
of the file. This causes cryptcheck to complain about missing hashes
on large files uploaded via s3/b2.
This change calculates hashes for the upload if the upload is coming
from a local filesystem. It does this by encrypting and hashing the
local file re-using the code used by cryptcheck. For a local disk this
is not a lot more intensive than calculating the hash.
See: https://forum.rclone.org/t/strange-output-for-cryptcheck/15437
Fixes : #2809
2020-04-22 11:33:48 +01:00
Nick Craig-Wood
44b1a591a8
crypt: get rid of the unused Cipher interface as it obfuscated the code
2020-04-22 11:33:48 +01:00
Nick Craig-Wood
bbb6f94377
fstest: create AssertTimeEqualWithPrecision from CheckTimeEqualWithPrecision
2020-04-22 11:33:00 +01:00
Nick Craig-Wood
3f654dac37
mount: map more rclone errors into file systems errors
...
This improves the error reporting, in particular for
fs.ErrorPermissionDenied which was being reported as an IO error.
2020-04-21 16:31:43 +01:00
Nick Craig-Wood
eed9c5738d
vfs: factor the vfs cache into its own package
2020-04-20 10:42:33 +01:00
Nick Craig-Wood
fd39cbc193
vfstests: move functional tests from mountlib and make them work with VFS
...
The tests are now run for the mount commands and for the plain VFS.
This makes the tests much easier to debug when running with a VFS than
through a mount.
2020-04-20 10:42:33 +01:00
Nick Craig-Wood
b25f5eb0d1
serve sftp: use VFS utility functions instead of own copy
2020-04-19 15:40:55 +01:00
Nick Craig-Wood
0961763082
vfs: add utility methods to match os package
2020-04-19 15:40:55 +01:00
Nick Craig-Wood
49e5299a95
asyncreader: make ErrorStreamAbandoned public
2020-04-19 15:18:49 +01:00
Nick Craig-Wood
07908f3f54
vfs: bring open_tests.go generator back into line with the generated tests
...
In
54deb01f00
vfs: Make OpenFile and friends return EINVAL if O_RDONLY and O_TRUNC
The generated file open_test.go was edited directly without editing
the generator.
This commit brings the generator make_open_tests.go back into line
with that edit. It also makes it so `go generate` can be used to
regenerate the tests.
2020-04-19 15:18:49 +01:00
Nick Craig-Wood
fdada79ebf
accounting: support WriterTo for less memory copying
...
This should reduce memory copying when the async buffer is in use and
improve speeds.
2020-04-19 15:18:49 +01:00