2203766f77
Retry listing in tests to work around eventual consistency
2015-09-14 21:01:25 +01:00
235cbe0e57
amazon cloud drive: retry 409 errors too
2015-09-14 21:00:44 +01:00
f50f353b5d
local: always use UNC paths on Windows - fixes #124 , fixes #130 , fixes #90
...
* Convert all paths to UNC paths on Windows.
* Update local filesystem to always use UNC paths.
* Change tests, so they can work with Windows character replacements.
* Remove "/" suffix on paths.
* Always use path/filepath
2015-09-14 19:58:03 +01:00
00afe6cc96
ACD: Shorten minimum and maximum sleep.
2015-09-14 18:22:21 +01:00
dd48e62b7e
Limit concurrent directory listings.
...
Never run more than "fs.Config.Checkers" directory listings at once.
2015-09-14 18:11:59 +01:00
a1a780e847
Read folders in separate goroutines.
...
As proposed in the FIXME, read folders in parallel.
This appears to fix "Next token is expired" on very big directories.
The only downside is that this doesn't abort at once if an error is found.
I added some logging, so there is some output for "-v".
2015-09-14 18:11:59 +01:00
fa87077211
Retry if a timeout occurs.
...
This happens more rarely than 500, but can still be encountered.
2015-09-14 18:02:35 +01:00
6ac7145d2d
Retry when we get a "500 Internal server error".
...
It seems like this happens randomly, and retrying works fine for that.
2015-09-14 18:02:35 +01:00
f1226f19b2
drive, googlecloudstorage: optionally use auto config for the oauth token
2015-09-12 14:17:39 +01:00
3ecbf2af25
Fix missing link text.
2015-09-12 11:22:17 +02:00
79f2e95bf9
Add Klaus Post to Contributors
2015-09-11 20:20:28 +01:00
faee50b238
List multiple matched commands.
...
* When multiple commands match, list them all.
* Change example to an existing command.
2015-09-11 19:44:50 +01:00
807d4a3c00
Improve OAUTH2 usability - fixes #131
...
Shorten the URL to be used by the user and automatically use the
returned code by the server. The browser is opened on
`http://(bindaddress)/auth `, and redirected to the actual URL. When
the code is returned it is automatically inserted, instead of
requiring a copy+paste.
This is also a workaround for the "open" package, which escapes "&"
wrongly on Windows, so the opened URL's are invalid.
2015-09-11 19:44:50 +01:00
073d112204
Factor pacer module from Drive and use it in Amazon Cloud Drive for
...
smooth API pacing and retry logic.
2015-09-11 19:18:41 +01:00
14f814b806
acd: Retry on 429 errors with backoff and fix upload of 0 length files
2015-09-09 23:23:37 +01:00
a288c2b3a3
Make a retry error wrapper for a plain error
2015-09-09 23:22:41 +01:00
fec16b0ac8
acd: Skip test on FS which don't support ModifiedTime
2015-09-09 23:21:50 +01:00
dd8717797e
Implement --dump-headers and --dump-bodies debug flags
2015-09-08 21:02:48 +01:00
7e7c239f09
Through popular demand add a donations page
2015-09-08 21:02:48 +01:00
edd0e8abb1
Add Colin Nicholson to contributors
2015-09-08 21:02:48 +01:00
d2b537d9a1
Fix docs link typo for googlecloudstorage - fixes #120
2015-09-08 21:02:48 +01:00
8c3df224ef
Implement Amazon Cloud Drive - fixes #45
...
* Optional interfaces Copier, Mover, DirMover not done
2015-09-08 21:02:48 +01:00
967fd2a778
dircache: implement FindRootParent and unify locking
2015-09-06 10:27:15 +01:00
ea12e446ca
Factor DirCache from drive into its own module
2015-09-05 11:58:54 +01:00
c8cd2b510f
More notes
2015-09-02 19:17:33 +01:00
8b05a8322b
FAQ entry about bidirectional sync - see #118
2015-09-02 08:33:53 +01:00
c98a51b26c
Lightly obscure secrets
2015-09-01 22:33:34 +01:00
e2717a031e
Implement Mover and DirMover interfaces fixes #115
...
* unit tests
* local
* drive
* dropbox
2015-09-01 21:49:13 +01:00
8d33ce0154
Check for source and dest being the same in sync/copy/move
2015-09-01 21:49:13 +01:00
92745aa950
Add Root() to Fs interface
2015-09-01 21:49:13 +01:00
cbc6bf6a89
FAQ entry on partial transfers / binary diffs - fixes #113
2015-08-31 12:47:07 +01:00
f72575e75f
Remove support for go 1.2 now that go 1.5 is out
2015-08-29 18:58:48 +01:00
0168f55f3e
Switch to spf13 fork of pflag - fixes #116
...
This supports --long value as well as --long=value which is as
expected for a unix utility.
2015-08-29 18:14:24 +01:00
8b60ab86a1
dropbox: force use of our custom transport which makes timeouts work
2015-08-29 17:48:15 +01:00
7463a7a509
Use "golang.org/x/oauth2" as oauth libary of choice - fixes #102
...
* get rid of depreprecated "code.google.com/p/goauth2/oauth"
* store tokens in config file as before
* read old format tokens and write in new format seamlessly
* set our own transport to enforce timeouts etc
2015-08-29 17:47:23 +01:00
9ed2de3d6e
Version v1.19
2015-08-28 09:47:13 +01:00
4f35fb59c8
Build for plan9/amd64 and solaris/amd64 too
2015-08-28 09:40:46 +01:00
59ba8f28c8
Implement move command - fixes #35
...
* Define Mover interface to move a single object
* Define DirMover interface to move a directory
* Implement DirMove operation
* Add `rclone move` command
* Tests for Dir Move
To Do
* Implement Move, DirMover in local, drive, dropbox
* unit test for Mover
* unit test for DirMover
2015-08-28 08:49:16 +01:00
d298b578ab
s3: Fix after upstream API changes in aws-sdk-go/aws - fixes #114
2015-08-28 08:47:41 +01:00
fabbc035c4
Make a current version download with a fixed URL for scripting - fixes #106
2015-08-27 20:11:11 +01:00
6530b07cde
FAQ entry about copying the config file
2015-08-27 19:46:28 +01:00
f8b7eaec93
s3: Document cross region bucket limitations - fixes #105
2015-08-25 20:15:50 +01:00
5c226e91c0
Ignore rmdir in limited fs rather than throwing error - fixes #112
2015-08-25 19:16:25 +01:00
8e3d45d2dc
dropbox: increase chunk size to improve upload speeds - fixes #103
...
Chunks aren't buffered in memory, so chose 128M as the default size as
producing the maximum throughput. This takes the throughput from 78
kBytes/s to 4MBytes/s a 50x improvement!
2015-08-25 19:01:37 +01:00
a96b522958
Implement server side copies if possible - fixes #99
...
Add optional fs.Copier interface
Implemented for
* swift
* s3
* drive
* dropbox
* google cloud storage
2015-08-23 21:18:38 +01:00
fedf81c2b7
Add Name() to Fs interface to return name as passed to NewFs
2015-08-23 13:36:38 +01:00
0c6f816a49
Implement --retries flag - fixes #109
2015-08-20 21:07:00 +01:00
dfe771fb0c
Correct log messages for remotes which don't support modtime/md5sum
2015-08-20 20:48:58 +01:00
bc19e2d84b
dropbox: Issue an error message when trying to upload bad file name - fixes #108
2015-08-20 20:46:35 +01:00
8c4d91cff7
Add privacy policy to the website
2015-08-19 22:10:04 +01:00
