Nick Craig-Wood
38adb35abe
Make dedupe take an optional mode parameter
2016-08-04 21:47:14 +01:00
Nick Craig-Wood
520ded60e3
Add memtest command for debugging purposes
2016-08-04 21:47:14 +01:00
Nick Craig-Wood
ae56df7d4f
Add --dedupe-mode only to dedupe command
2016-08-04 21:47:14 +01:00
Nick Craig-Wood
412591dfaf
Make rclone use cobra for command line parsing
2016-08-03 17:16:27 +01:00
Nick Craig-Wood
57f8f1ec92
b2: set maximum backoff to 5 Minutes #597
2016-08-01 22:57:52 +01:00
Nick Craig-Wood
f0434789cf
Encourage using the latest version before submitting an issue.
2016-07-28 10:38:16 +01:00
Nick Craig-Wood
c2f6decb9c
swift: note that tenant isn't optional for > v1 auth - fixes #563
2016-07-15 18:25:59 +01:00
Nick Craig-Wood
9eeed25418
local: fix filenames with invalid UTF-8 not being uploaded #568
2016-07-15 14:18:09 +01:00
Nick Craig-Wood
67562081f7
Version v1.32
2016-07-13 17:32:39 +01:00
Nick Craig-Wood
41917eb1f2
b2: Fix upload of files large files not in root - fixes #582
2016-07-13 15:28:39 +01:00
Nick Craig-Wood
c3e996f10f
b2 doc fixes
2016-07-13 14:50:47 +01:00
Nick Craig-Wood
63f6827a0d
Version v1.31
2016-07-13 12:28:01 +01:00
Nick Craig-Wood
96e2271cce
Factor commands into Makefile
2016-07-13 12:25:19 +01:00
Nick Craig-Wood
ac3c83f966
Fix integration tests for drive
2016-07-12 21:38:15 +01:00
Nick Craig-Wood
b9c8e61d39
Explicitly check the state in tests after writing files
...
...otherwise Amazon Drive will fail.
2016-07-12 21:36:39 +01:00
Nick Craig-Wood
a6056408dd
Fix move command - stop it running for overlapping fses - fixes #577
...
* Make move command check for overlapping remotes and refuse to run
* Do copy/delete rather than all the copies then all the deletes
* Doesn't purge the source - this was unexpected behaviour see #512 and #416
* Add -list-retries flag to test suite to control retries
This changes the semantics of `move` slightly. However it now errs on
the side of not deleting stuff.
2016-07-12 10:49:37 +01:00
Nick Craig-Wood
b9479cf7ab
Implement --no-update-modtime flag - fixes #511
2016-07-12 10:46:45 +01:00
Nick Craig-Wood
452a5badc1
Add Stefan Weichinger to contributors
2016-07-11 15:32:58 +01:00
Stefan G. Weichinger
d645bf0966
Add basic info how to use ansible role for installation
2016-07-11 15:31:36 +01:00
Nick Craig-Wood
50addaa91e
Add Antonio Messina to contributors
2016-07-11 15:22:17 +01:00
Antonio Messina
02a3bbaa3d
swift: add support for non-default project domain.
...
With Keystone V3 both users and projects (a.k.a. tenants) can belong
to different domains. This change allow specifying different domains
for the user and the project.
2016-07-11 15:16:58 +01:00
Nick Craig-Wood
a20d80565b
Tidy stats output - fixes #541
2016-07-11 13:04:30 +01:00
Nick Craig-Wood
56adb52a21
Rename Amazon Cloud Drive to Amazon Drive - fixes #532
2016-07-11 12:42:44 +01:00
Nick Craig-Wood
8c2fc6daf8
s3: Add instructions on how to use rclone with minio
2016-07-11 12:12:28 +01:00
Nick Craig-Wood
4bd9932703
Fix wording in verbose copy logs - fixes #574
2016-07-09 10:11:57 +01:00
Nick Craig-Wood
2a1d4b7563
s3: Add ap-northeast-2 (Seoul) and ap-south-1 (Mumbai) regions - fixes #567
2016-07-06 11:14:59 +01:00
Nick Craig-Wood
b394431f18
Improve --files-from docs - fixes #547
2016-07-05 12:33:59 +01:00
Nick Craig-Wood
cc628717d8
b2: Add --b2-versions flag so old versions can be listed and retreived. #420
2016-07-05 11:27:04 +01:00
Nick Craig-Wood
f3e00133a0
dropbox: Don't retry 461 errors - fixes #551
...
461 errors from dropbox indicate some sort of copyright violation.
2016-07-04 13:45:53 +01:00
Nick Craig-Wood
606961f49d
b2: Treat 403 errors (eg cap exceeded) as fatal #420
2016-07-04 13:45:53 +01:00
Nick Craig-Wood
13591c7c00
Redo error handling for sync/copy/move
...
* Factor sync/copy/move into its own file
* Make fatal errors abort the sync
* Make Copy return errors
* Make Sync/Copy/Move return the last Copy error if there was one
* Prioritise returning Fatal errors
* NoRetry errors are returned if no other types of errors
2016-07-04 13:45:53 +01:00
Nick Craig-Wood
28f4061892
Add two more classes of error Fatal and NoRetry
...
These are for remotes to signal that they have a fatal error and don't
want to continue (eg cap exceeded) or that a particular file shouldn't
be retried for some reason.
2016-07-04 13:45:52 +01:00
Nick Craig-Wood
018fe80bcb
b2: cleanup old file versions - fixes #462
2016-07-02 17:03:08 +01:00
Nick Craig-Wood
0a43ff9c13
Modify interface for accounting to take a string not an fs.Object
2016-07-02 16:58:50 +01:00
Nick Craig-Wood
9aae143833
Implement cleanup command for emptying trash / removing old versions of files
2016-07-01 16:35:36 +01:00
Nick Craig-Wood
c8e2531c8b
b2: make error handling compliant
2016-07-01 16:23:23 +01:00
Nick Craig-Wood
9290004bb8
pacer: make sleep get-able and set-able
2016-07-01 16:22:51 +01:00
Nick Craig-Wood
cbebefebc4
b2: Fix handling of token expiry #420
...
Found with --b2-test-mode expire_some_account_authorization_tokens
2016-07-01 11:47:42 +01:00
Nick Craig-Wood
6f3897ce2c
b2: implement --b2-test-mode to set X-Bz-Test-Mode header #420
2016-07-01 11:30:09 +01:00
Nick Craig-Wood
ea5878f590
b2: set cutoff for chunked upload to 200MB #420
...
This is the value recommended in the b2 integration checklist:
https://www.backblaze.com/b2/docs/integration_checklist.html
2016-07-01 10:08:09 +01:00
Nick Craig-Wood
46f8e50614
b2: Make upload multi-threaded - fixes #531
2016-07-01 10:04:52 +01:00
Nick Craig-Wood
70dc97231e
Convert more tests to use assert/require
2016-06-30 15:45:30 +01:00
Nick Craig-Wood
f6a053df6e
Automatically set --no-traverse when copying a single file
2016-06-29 17:38:56 +01:00
Nick Craig-Wood
af4ef8ad8d
Implement --no-traverse flag to stop copy traversing the destination remote.
...
Refactor sync/copy/move
* Don't load the src listing unless doing a sync and --delete-before
* Don't load the dst listing if doing copy/move and --no-traverse is set
`rclone --no-traverse copy src dst` now won't load either of the
listings into memory so will use the minimum amount of memory.
This change will reduce the amount of memory rclone uses dramatically
too as in normal operations (copy without --notraverse or sync) as it
no longer loads the source file listing into memory at all.
Fixes #8
Fixes #544
Fixes #546
2016-06-29 17:38:50 +01:00
Nick Craig-Wood
13797a1fb8
Make retry logs be debug in main copy routine
2016-06-28 08:51:57 +01:00
Nick Craig-Wood
3ad8fb8634
Make DeleteFile and DeleteFiles return errors
2016-06-28 08:51:57 +01:00
Nick Craig-Wood
ab43005422
Make NewObject return an error
...
* make it return an error
* make a canonical error fs.ErrorNotFound
* make a test for it
* remove logs/debugs of error
2016-06-28 08:51:57 +01:00
Nick Craig-Wood
b1f131964e
Rename NewFsObject to NewObject
2016-06-28 08:51:57 +01:00
Nick Craig-Wood
1a87b69376
Get rid of LimitedFs - FIXME needs docs on copying single files
...
If remote:path points to a file make NewFs return a sentinel error
fs.ErrorIsFile and an Fs which points to the parent.
Use this to remove the LimitedFs and just add this file to the
--files-from list.
This means that server side operations can be used also.
Fixes #518
Fixes #545
2016-06-28 08:51:43 +01:00
Nick Craig-Wood
5a3b109e25
Fix issues identified by go vet -shadow - fixes #530
2016-06-21 21:17:52 +01:00
