0c0ed2fe04
box: Remove unnecessary iat from jws claims
2020-04-23 17:52:14 +01:00
ab6ed256e5
putio: add support for --header-upload and --header-download #59
2020-04-23 15:55:52 +01:00
7c98ecd3ab
putio: make downloading files use the rclone http Client
...
This fixes `--download-header` and these transactions being missed from
`--dump bodies` or `--tpslimit`
2020-04-23 15:48:30 +01:00
b502a74cff
gcs: add support for --header-upload and --header-download #59
2020-04-23 11:41:57 +01:00
8e9c25063a
swift: add support for --header-upload and --header-download #59
2020-04-23 11:34:36 +01:00
c390fc8100
onedrive: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
14f6ce1e77
premiumizeme: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
385542e2f9
sharefile: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
fc946d0c44
fichier: pass options to rest.Opts for uploadFile
2020-04-23 11:07:21 +01:00
854c84d0ca
pcloud: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
90bd0eb44c
webdav: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
3130f870bb
sugarsync: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
51b617f601
yandex: pass options to rest.Opts for upload
2020-04-23 11:07:21 +01:00
011ca244b2
jottacloud: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
9ea1361044
googlephotos: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
776966e22c
opendrive: pass options to rest.Opts for Put and Update
2020-04-23 11:07:21 +01:00
01cb256b84
box: pass options to rest.Opts for uploadPart
2020-04-23 11:07:21 +01:00
0b0163dde2
box: pass options to rest.Opts for upload
2020-04-23 11:07:21 +01:00
38123c70eb
b2: pass options to rest.Opts for Update
2020-04-23 11:07:21 +01:00
5cb7229a16
s3: add support for HTTPOption
2020-04-23 11:07:21 +01:00
f8039deb7c
s3: fix detection of BucketAlreadyOwnedByYou and BucketAlreadyExists error
...
This was being silently ignored until this commit
e2bf91452a
2020-04-22 18:14:03 +01:00
39319b4858
@Sunil-P
...
box: Added support for interchangeable root folder for Box backend - #3422
2020-04-22 17:00:13 +01:00
4af5c9aed7
pCloud: Added support for interchangeable root folder for pCloud backend - #3957
2020-04-22 16:58:01 +01:00
8a3c4c6a7b
box: add token renew function for jwt auth - Fixes #4901
2020-04-22 16:53:03 +01:00
1648c1a0f3
crypt: calculate hashes for uploads from local disk
...
Before this change crypt would not calculate hashes for files it was
uploading. This is because, in the general case, they have to be
downloaded, encrypted and hashed which is too resource intensive.
However this causes backends which need the hash first before
uploading (eg s3/b2 when uploading chunked files) not to have a hash
of the file. This causes cryptcheck to complain about missing hashes
on large files uploaded via s3/b2.
This change calculates hashes for the upload if the upload is coming
from a local filesystem. It does this by encrypting and hashing the
local file re-using the code used by cryptcheck. For a local disk this
is not a lot more intensive than calculating the hash.
See: https://forum.rclone.org/t/strange-output-for-cryptcheck/15437
Fixes : #2809
2020-04-22 11:33:48 +01:00
44b1a591a8
crypt: get rid of the unused Cipher interface as it obfuscated the code
2020-04-22 11:33:48 +01:00
bbb6f94377
fstest: create AssertTimeEqualWithPrecision from CheckTimeEqualWithPrecision
2020-04-22 11:33:00 +01:00
cd3c699f28
lib/readers: factor ErrorReader from multiple sources
2020-04-19 15:18:49 +01:00
36d2c46bcf
local: factor PreAllocate and SetSparse to lib/file
2020-04-19 15:18:49 +01:00
4c258787b5
googlephotos: make the start year configurable - fixes #3630
2020-04-15 18:08:07 +01:00
e2bf91452a
s3: report errors on bucket creation (mkdir) correctly
...
Before this fix errors on bucket creation were being silently
swallowed.
See: https://forum.rclone.org/t/rclone-with-brand-new-aws-account-for-s3/15590
2020-04-15 13:13:13 +01:00
6893ce0bbf
s3: do not resize buf on put to memBuf
...
This is handled by Pool implementation.
2020-04-11 16:35:48 +01:00
399cf18013
s3: use single memory pool
...
Previously we had a map of pools for different chunk sizes.
In practice the mapping is not very useful and requires a lock.
Pools of size other that ChunkSize can only happen when we have a huge file (over 10k * ChunkSize).
We need to have a bunch of identically sized huge files.
In such case most likely ChunkSize should be increased.
The mapping and its lock is replaced with a single initialised pool for ChunkSize, in other cases pool is allocated and freed on per file basis.
2020-04-11 16:34:05 +01:00
64b5105edd
jottacloud: implement cleanup
2020-04-11 16:42:25 +02:00
2c2f4a6a05
jottacloud: implement --jottacloud-trashed-only
2020-04-11 16:42:25 +02:00
815ae7df45
backend/s3: add SSE-C support for AWS, Ceph, and MinIO
2020-03-31 18:16:45 +01:00
ff0a299bfb
drive: don't delete files with multiple parents to avoid data loss
...
Rclone can't safely delete files with multiple parents without
PATCHing the parents list. This can be done, but since multiple
parents are going away to be replaced by drive shortcuts we return an
error for now.
See #4013
2020-03-31 17:28:32 +01:00
b5f78cd7b4
b2: ignore directory markers at the root also
...
See: https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/
2020-03-31 11:46:17 +01:00
ef99ca68aa
gcs: ignore directory markers at the root also
...
See: https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/
2020-03-31 11:46:10 +01:00
a5c2f2c138
s3: ignore directory markers at the root also
...
See: https://forum.rclone.org/t/issue-with-lsf-r-files-only-first-line-is-blank/15229/
2020-03-31 11:45:52 +01:00
d91a547d59
dropbox: make error insufficient space to be fatal
2020-03-26 16:19:50 +00:00
7d9ca3998e
drive: Extend --drive-stop-on-upload-limit to respond to teamDriveFileLimitExceeded.
...
Fixes #3979
2020-03-26 16:19:50 +00:00
9aa32bc269
onedrive: make error quotaLimitReached to be fatal - Fixes #4089
2020-03-26 16:19:50 +00:00
d9c8c47e02
onedrive: add missing drive on config - fixes #4068
...
Before this change we queries /me/drives for a list of the users
drives and asked the user to choose. Sometimes this does not return
the users main drive for reasons unknown.
After this change we query /me/drives first then /me/drive and add
that to the list of drives if it wasn't already there.
2020-03-24 08:44:10 +00:00
78a9e7440a
union: Implement multiple writable remotes
2020-03-21 18:11:24 +00:00
472d4799d1
qingstor: make rclone cleanup remove pending multipart uploads older than 24h
2020-03-18 12:49:21 +00:00
84caf1e158
qingstor: try harder to cancel failed multipart uploads
2020-03-18 12:49:21 +00:00
0f20f23651
cache: move methods used for testing into test file
2020-03-16 18:41:32 +00:00
a6a2eec392
backend/b2: remove unused largeUpload.clearUploadURL()
2020-03-16 17:11:19 +00:00
77e94be280
onedrive: implement --onedrive-server-side-across-configs - fixes #4058
2020-03-15 21:10:23 +00:00
