Nick Craig-Wood
eb91356e28
fs/asyncreader: optionally user mmap for memory allocation with --use-mmap #2200
...
This replaces the `sync.Pool` allocator with lib/pool. This
implements a pool of buffers of up to 64MB which can be re-used but is
flushed every 5 seconds.
If `--use-mmap` is set then rclone will use mmap for memory
allocations which is much better at returning memory to the OS.
2019-02-02 14:35:56 +00:00
Nick Craig-Wood
bed2971bf0
lib/pool: a buffer recycling library which can be optionally be used with mmap
2019-02-02 14:35:56 +00:00
Nick Craig-Wood
f0696dfe30
lib/mmap: library to do memory allocation with anonymous memory maps
2019-02-02 14:35:56 +00:00
Nick Craig-Wood
a43ed567ee
vfs: implement --vfs-cache-max-size to limit the total size of the cache
2019-02-02 12:30:10 +00:00
Nick Craig-Wood
fffdbb31f5
bin/get-github-release.go: Use GOPATH/bin by preference to place binary
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
cacefb9a82
bin/get-github-release.go: automatically choose the right os/arch
...
This fixes the install of golangci-lint on non Linux platforms
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
d966cef14c
build: fix problems found with unconvert
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
a551978a3f
build: fix problems found with structcheck linter
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
97752ca8fb
build: fix problems found with ineffasign linter
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
8d5d332daf
build: fix problems found with golint
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
6b3a9bf26a
build: fix problems found by the deadcode linter
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
c1d9a1e174
build: use golangci-lint for code quality checks
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
98120bb864
bin/get-github-release.go: enable extraction of binary not in root of tar
...
Also fix project name regexp to allow -
2019-02-02 11:34:51 +00:00
Nick Craig-Wood
f8ced557e3
mount: print more things in seek_speed test
2019-02-02 11:30:49 +00:00
Cnly
7b20139c6a
onedrive: return err instead of panic on unknown-sized uploads
2019-02-02 16:37:33 +08:00
Nick Craig-Wood
c496efe9a4
Add Wojciech Smigielski to contributors
2019-02-01 17:12:43 +00:00
Nick Craig-Wood
cf583e0237
Add Rémy Léone to contributors
2019-02-01 17:12:43 +00:00
Wojciech Smigielski
f09d0f5fef
b2: added disable sha1sum flag
2019-02-01 17:12:24 +00:00
Rémy Léone
1e6cbaa355
s3: Add Scaleway to s3 documentation
2019-02-01 17:09:57 +00:00
Nick Craig-Wood
be643ecfbc
sftp: don't error on dangling symlinks
2019-02-01 16:43:26 +00:00
Nick Craig-Wood
0c4ed35b9b
build: improve beta tidy script
2019-02-01 16:40:55 +00:00
Nick Craig-Wood
4e4feebf0a
drive: fix google docs in rclone mount in some circumstances #1732
...
Before this change any attempt to access a google doc in an rclone
mount would give the error "partial downloads are not supported while
exporting Google Documents" as the mount uses ranged requests to read
data.
This implements ranged requests for a limited number of scenarios,
just enough so that Google docs can be cat-ed from an rclone mount.
When they are cat-ed then they receive their correct size also.
2019-01-31 10:39:13 +00:00
Sebastian Bünger
291f270904
jottacloud: add support for 2-factor authentification fixes #2722
2019-01-30 08:13:46 +00:00
Nick Craig-Wood
f799be1d6a
local: fix symlink tests under Windows
2019-01-29 15:40:49 +00:00
Nick Craig-Wood
74297a0c55
local: make sure we close file handle in local tests
...
...as Windows can't remove a directory with an open file handle in
2019-01-29 15:23:42 +00:00
Nick Craig-Wood
7e13103ba2
Add kayrus to contributors
2019-01-29 14:43:25 +00:00
kayrus
34baf05d9d
Swift: introduce application credential auth support
2019-01-29 14:43:10 +00:00
kayrus
38c0018906
Bump github.com/ncw/swift to v1.0.44
2019-01-29 14:43:10 +00:00
Nick Craig-Wood
6f25e48cbb
ftp: fix docs to note ftp_proxy isn't supported
2019-01-29 14:38:26 +00:00
Nick Craig-Wood
7e99abb5da
Add Matt Robinson to contributors
2019-01-29 14:38:26 +00:00
Nick Craig-Wood
629019c3e4
Add yair@unicorn to contributors
2019-01-29 14:38:26 +00:00
Matt Robinson
1402fcb234
fix typo in rcd docs
2019-01-29 14:37:58 +00:00
Nick Craig-Wood
b26276b416
union: fix poll-interval not working - fixes #2837
...
Before this change the union remote was using whether the writable
union could poll for changes to decide whether the union mount could
poll for changes.
The fix causes the union backend to signal it can poll for changes if
**any** of the remotes can poll for changes.
2019-01-28 14:43:12 +00:00
Nick Craig-Wood
e317f04098
local: make using -l/--links with -L/--copy-links throw an error #1152
2019-01-28 13:47:27 +00:00
Nick Craig-Wood
65ff330602
local: add tests for -l feature #1152
2019-01-28 13:47:27 +00:00
Nick Craig-Wood
52763e1918
local: when using -l fix setting modification times of symlinks #1152
...
Before this change it was setting the modification times of the things
that the symlinks pointed to.
Note that this is only implemented for unix style OSes. Other OSes
will not attempt to set the modification time of a symlink.
2019-01-28 13:47:27 +00:00
yair@unicorn
23e06cedbd
local: Add support for '-l' (symbolic link translation) #1152
2019-01-28 13:47:27 +00:00
yair@unicorn
b369fcde28
local: add documentation for -l option #1152
2019-01-28 13:47:27 +00:00
Nick Craig-Wood
c294068780
webdav: support About - fixes #2937
...
This means that `rclone about` will work with Webdav backends and `df`
will be correct when using them in `rclone mount`.
2019-01-28 13:45:09 +00:00
Nick Craig-Wood
8a774a3dd4
webdav: support MD5 and SHA1 hashes with Owncloud and Nextcloud - fixes #2379
2019-01-28 13:45:09 +00:00
Nick Craig-Wood
53a8b5a275
vfs: Implement renaming of directories for backends without DirMove #2539
...
Previously to this change, backends without the optional interface
DirMove could not rename directories.
This change uses the new operations.DirMove call to implement renaming
directories which will fall back to Move/Copy as necessary.
2019-01-27 21:26:56 +00:00
Nick Craig-Wood
bbd03f49a4
operations: Implement DirMove for moving a directory #2539
...
This does the equivalent of sync.Move but is specialised for moving
files in one backend.
2019-01-27 21:26:56 +00:00
Nick Craig-Wood
e31578e03c
s3: Auto detect region for buckets on operation failure - fixes #2915
...
If an incorrect region error is returned while using a bucket then the
region is updated, the session is remade and the operation is retried.
2019-01-27 21:22:49 +00:00
Nick Craig-Wood
0855608bc1
drive: add --drive-pacer-burst config to control bursting of the rate limiter
2019-01-27 21:19:20 +00:00
Nick Craig-Wood
f8dbf8292a
pacer: control the minSleep with a rate limiter and allow burst
...
This will mean rclone tracks the minimum sleep values more precisely
when it isn't rate limiting.
Allowing burst is good for some backends (eg Google Drive).
2019-01-27 21:19:20 +00:00
Nick Craig-Wood
144daec800
drive: set default pacer to 100ms for 10 tps - fixes #2880
2019-01-27 21:19:20 +00:00
Nick Craig-Wood
6a832b7173
qingstor: default --qingstor-upload-concurrency to 1 to work around bug
...
If the upload concurrency is set > 1 then the hash becomes corrupted.
The upload is fine, and can be downloaded fine, however the hash is no
longer the md5sum of the object. It is not known whether this is
rclone's fault or a bug at QingStor.
2019-01-27 21:09:11 +00:00
Nick Craig-Wood
184a9c8da6
mountlib: clip blocks returned to 32 bit number for Windows 32 bit - fixes #2934
2019-01-27 12:04:56 +00:00
Sebastian Bünger
88592a1779
jottacloud: Use token auth for all API requests
...
Don't store password anymore
2019-01-27 11:32:11 +00:00
Sebastian Bünger
92fa30a787
jottacloud: resume/deduplication fixups
2019-01-27 11:32:11 +00:00
