Nick Craig-Wood
c99412d11e
cryptcheck: make reading of nonce more efficient with RangeOption #1825
...
...also only calculate the required hash which will speed things up slightly.
2018-02-19 18:00:39 +00:00
Nick Craig-Wood
c929de9dc4
crypt: Implement RangeOption #1825
2018-02-19 15:45:24 +00:00
Victor
2f63a9f81c
onedrive: Overwrite object size value with real size when reading file.
...
Because of a bug in the Onedrive API it will sometime report the wrong
size. If the size is wrong other remotes that depend on the size might
fail. To fix this we overwrite the objects size with the real size
from ContentLength header.
2018-02-16 13:21:26 +00:00
Nick Craig-Wood
b1945d0094
swift: fix refresh of authentication token
...
Before this fix we were doing the token refresh but ignoring the new
tokens.
This bug was introduced in v1.39 by 4c0e2f9b3b
Fixes #2018
Fixes #2031
2018-02-15 19:22:45 +00:00
remusb
9a34fd984c
cache: fix dirmove with temp fs enabled
2018-02-14 23:47:45 +02:00
Nick Craig-Wood
644313a4b9
http: Fix handling of directories with & in
...
This was caused by inconsistent escaping of the URL in the prefix
check, so check the URL links back to the correct host and scheme
instead of the prefix check.
The decoded path check will catch any URLs which are outside of the
root.
2018-02-14 11:26:37 +00:00
remusb
54724a1362
cache: notify vfs when using temp fs - fixes #2051
2018-02-11 22:30:58 +02:00
remusb
b33e3f779c
cache: add support for polling
2018-02-10 22:01:05 +02:00
Nick Craig-Wood
8a25ca786c
drive: add --drive-impersonate for service accounts #1491
2018-02-09 16:58:35 +00:00
Fabian Möller
b183bd7f00
alias: add new backend to create aliases for remote names #1049
...
The alias backend is a wrapper for an existing remote.
It allows you to name a "remote:path" as an "alias:".
2018-02-06 18:23:47 +00:00
Nick Craig-Wood
5055b340da
swift: Fix extra HEAD transaction when uploading a new file - fixes #2053
...
Also don't keep the swift.Headers as a pointer to a map, just use the map
2018-02-06 14:43:21 +00:00
Nick Craig-Wood
82418c3021
box: improve accounting for chunked uploads
2018-02-02 15:14:41 +00:00
Nick Craig-Wood
bf6101cb6c
azureblob: improve accounting for chunked uploads
2018-02-02 15:14:41 +00:00
Nick Craig-Wood
5723d2dbff
pcloud: remove unused chunked upload flag and code
2018-02-02 15:14:41 +00:00
Nick Craig-Wood
d0d6b83a7a
fs/accounting: rework to enable accounting to work with crypt and b2
...
This removes the old system of part accounting and replaces it with a
system of popping off the accounting reader and wrapping up new ones
as necessary.
This makes it much easier to carry the context down the chain of
wrapped readers and get the limiting as near as possible to the
output. This makes the accounting more accurate and the bandwidth
limiting smoother.
Fixes #2029 and Fixes #1443
2018-02-02 15:14:41 +00:00
nbuchanan
9aa8815990
drive: add --drive-use-created-date to use created date as modified date
2018-02-02 14:20:11 +00:00
ishuah
4c1ffc7f54
copy/move: detect file size change during copy/move - fixes #1250
2018-02-02 13:49:11 +00:00
Nick Craig-Wood
a6227f34e2
drive: request the export formats only when required #320
...
If the listing has no google docs in or the user uses
`--drive-skip-gdocs` then we don't fetch the export formats which
saves a transaction to drive.
2018-02-01 12:05:00 +00:00
Nick Craig-Wood
2eb5cfb7ad
fs: Formalize the ObjectUnWrapper interface
2018-01-31 16:21:41 +00:00
remusb
b3d8b7e22e
cache: use atexit for cleanup
2018-01-30 22:35:53 +02:00
Nick Craig-Wood
11fe3fdc16
drive: update docs to clarify access to "Computers" tab #1773
2018-01-30 16:28:55 +00:00
Fabian Möller
cf6d522d2f
drive: fix upload to existing file ( #2032 )
...
This fixes uploads to existing files for Google Drive introduced by #2007 .
Instead of updating the old file a new "Untitled" file would be created
in the root folder.
2018-01-30 14:37:06 +01:00
Fabian Möller
29d428040c
cache: clean root path ( #2023 )
...
Trim "/" from the root path to fix "slice bounds out of range" panic
in cache.go:1272.
Fixes #1945
2018-01-30 14:35:40 +01:00
Fabian Möller
1aa482c333
drive: fix chunked upload ( #2030 )
2018-01-29 23:36:39 +01:00
remusb
40af98b0b3
cache: offline uploading
2018-01-30 00:05:04 +02:00
Nick Craig-Wood
1852a0e0c9
dropbox: Fix custom oauth client parameters - fixes #2028
2018-01-29 20:04:41 +00:00
Nick Craig-Wood
a4fe2455ed
drive: add scope configuration and root folder selection
...
This allows:
* appdata access - Fixes #1799
* access to backup and sync folders - Fixes #1773
* drives.file access - Fixes #2000
* read only access - Fixes #337
2018-01-29 14:40:10 +00:00
Fabian Möller
f622017539
drive: use contains for name matching in list
...
Use contains for name matching in list to work around #1675 .
2018-01-29 14:18:49 +00:00
Fabian Möller
07f20dd1fd
drive: migrate to api v3
2018-01-29 12:00:02 +00:00
Nick Craig-Wood
fe52502f19
fs: Adjust RangeOption.Decode to return -1 for read to end
...
A Range request can never request 0 bytes however this change was made
to make a clearer signal that the limit means read to the end.
Add test and more documentation and fixup uses
2018-01-27 14:31:29 +00:00
Fabian Möller
29286cc8b3
drive: fix single Drive Document as FS root
...
Allow using Drive Documents as FS root by doing a direcoty list during NewFS.
Fixes #1772
2018-01-26 09:59:36 +00:00
Fabian Möller
17dabf7a99
ftp: fix RangeOption support in Open #1825
2018-01-25 10:21:00 +00:00
Fabian Möller
9520992a54
sftp: fix RangeOption support in Open #1825
2018-01-25 10:20:43 +00:00
Fabian Möller
a3dd2c691e
amazonclouddrive: remove unnecessary notifies from DirChangeNotify
...
It is unnecessary to notify the node.Parents, because a cahnge event is
generated for all involved files and folders in a move from d1/f1 to
d2/f1. There will be a event for d1, d2 and f1.
Additionally a duplicate notification is resolved when them empty string
is in pathsToClear.
Related to #2006
2018-01-25 10:19:06 +00:00
Nick Craig-Wood
38f829842a
s3: fix server side copy and set modtime on files with + in - fixes #2001
...
This was broken in 64ea94c1a4
when
putting a work-around for Digital Ocean. PathEscape has now been
adjusted so it works with both providers.
2018-01-23 10:50:50 +00:00
Nick Craig-Wood
88e0770f2d
cache: Implement RangeOption #1825
2018-01-22 19:44:55 +00:00
Nick Craig-Wood
a6833b68ca
local: factor RangeOption code to Decode() method and readers.LimitedReadCloser #1825
2018-01-22 19:44:00 +00:00
Nick Craig-Wood
e44dc2b14d
box: fix RangeOption support in Open #1825
2018-01-22 17:05:47 +00:00
Nick Craig-Wood
d876392d15
onedrive: Factor code into fs.FixRangeOption
2018-01-22 17:05:00 +00:00
Fabian Möller
186f78d44f
local: fix RangeOption support in Open #1825
2018-01-21 19:50:26 +00:00
Nick Craig-Wood
c963c74fbe
onedrive: fix RangeOption support in Open #1825
2018-01-21 17:11:37 +00:00
Nick Craig-Wood
9c45125271
azureblob: fix RangeOption support in Open #1825
2018-01-21 17:11:32 +00:00
Nick Craig-Wood
8653944a6d
Make RangeOption manadatory for Open - #1825
...
Add an integration test to make sure all backends implement
RangeOption correctly.
2018-01-21 17:09:12 +00:00
Jon Fautley
71bc108ce6
sftp: performance: don't consult config file outside of Fs setup
2018-01-21 09:37:22 +00:00
Fabian Möller
115d24e1f7
amazonclouddrive: implement DirChangeNotify
...
Use the Changes API to invalidate cache entries.
The latest retrieved checkpoint is stored in the config file to allow
fast resumption after restart.
2018-01-20 18:48:52 +00:00
Nick Craig-Wood
25a41e1945
drive: fix missing error handler
2018-01-20 18:04:23 +00:00
Nick Craig-Wood
97c414f025
config/hash: rename more symbols after factoring into own package
2018-01-18 20:27:52 +00:00
Nick Craig-Wood
71722b5b95
config: factor Obscure and Reveal into its own package
2018-01-18 20:19:55 +00:00
Nick Craig-Wood
59a8108fc3
webdav: add a new time format #1952
2018-01-18 16:54:13 +00:00
Iakov Davydov
acd55a8f65
local, fs: --exclude-if-present ignores directories which it doesn't have permission for - fixes #1959
2018-01-16 20:00:16 +00:00
Nick Craig-Wood
4b0c5f79b5
qingstor: Only support on go1.7+
2018-01-16 17:05:26 +00:00
Nick Craig-Wood
1848e26183
dropbox: Only support on go1.7+
...
See https://github.com/dropbox/dropbox-sdk-go-unofficial/pull/40
2018-01-16 17:05:02 +00:00
Nick Craig-Wood
11da2a6c9b
Break the fs package up into smaller parts.
...
The purpose of this is to make it easier to maintain and eventually to
allow the rclone backends to be re-used in other projects without
having to use the rclone configuration system.
The new code layout is documented in CONTRIBUTING.
2018-01-15 17:51:14 +00:00
Nick Craig-Wood
92624bbbf1
Move all backends into backend directory
2018-01-12 20:27:08 +00:00
Nick Craig-Wood
60afda007b
Move dircache, oauthutil, rest and pacer modules into lib
2018-01-12 17:07:38 +00:00
Nick Craig-Wood
b8b620f5c2
Move all backends into backend directory
2018-01-12 17:07:38 +00:00