cbebefebc4
b2: Fix handling of token expiry #420
...
Found with --b2-test-mode expire_some_account_authorization_tokens
2016-07-01 11:47:42 +01:00
6f3897ce2c
b2: implement --b2-test-mode to set X-Bz-Test-Mode header #420
2016-07-01 11:30:09 +01:00
ea5878f590
b2: set cutoff for chunked upload to 200MB #420
...
This is the value recommended in the b2 integration checklist:
https://www.backblaze.com/b2/docs/integration_checklist.html
2016-07-01 10:08:09 +01:00
46f8e50614
b2: Make upload multi-threaded - fixes #531
2016-07-01 10:04:52 +01:00
70dc97231e
Convert more tests to use assert/require
2016-06-30 15:45:30 +01:00
f6a053df6e
Automatically set --no-traverse when copying a single file
2016-06-29 17:38:56 +01:00
af4ef8ad8d
Implement --no-traverse flag to stop copy traversing the destination remote.
...
Refactor sync/copy/move
* Don't load the src listing unless doing a sync and --delete-before
* Don't load the dst listing if doing copy/move and --no-traverse is set
`rclone --no-traverse copy src dst` now won't load either of the
listings into memory so will use the minimum amount of memory.
This change will reduce the amount of memory rclone uses dramatically
too as in normal operations (copy without --notraverse or sync) as it
no longer loads the source file listing into memory at all.
Fixes #8
Fixes #544
Fixes #546
2016-06-29 17:38:50 +01:00
13797a1fb8
Make retry logs be debug in main copy routine
2016-06-28 08:51:57 +01:00
3ad8fb8634
Make DeleteFile and DeleteFiles return errors
2016-06-28 08:51:57 +01:00
ab43005422
Make NewObject return an error
...
* make it return an error
* make a canonical error fs.ErrorNotFound
* make a test for it
* remove logs/debugs of error
2016-06-28 08:51:57 +01:00
b1f131964e
Rename NewFsObject to NewObject
2016-06-28 08:51:57 +01:00
1a87b69376
Get rid of LimitedFs - FIXME needs docs on copying single files
...
If remote:path points to a file make NewFs return a sentinel error
fs.ErrorIsFile and an Fs which points to the parent.
Use this to remove the LimitedFs and just add this file to the
--files-from list.
This means that server side operations can be used also.
Fixes #518
Fixes #545
2016-06-28 08:51:43 +01:00
5a3b109e25
Fix issues identified by go vet -shadow - fixes #530
2016-06-21 21:17:52 +01:00
a67c7461ee
s3: skip SetModTime for objects > 5GB - fixes #534
2016-06-19 17:26:44 +01:00
e0aa4bb492
Fix incomplete local hashes.
...
Fixes #533
2016-06-19 16:51:49 +02:00
ab0947ee37
Fix typo in changelog
2016-06-18 16:58:37 +01:00
bd0227450e
Version v1.30
2016-06-18 16:41:46 +01:00
f438f1e9ef
Fix stats print
2016-06-18 16:41:46 +01:00
3f7b2c1ade
Add Justin R. Wilson to contributors
2016-06-18 14:31:17 +01:00
6e35a3b3ce
Add AES256 server-side encryption for s3 - Fixes #491
...
Add a configuration key and support for AES256 server-side encryption.
2016-06-18 14:28:38 +01:00
d3dd672640
Document recursion requirements for Fses
2016-06-18 14:12:47 +01:00
2a46be8cf3
b2: implement large file uploading - fixes #456
2016-06-18 13:38:05 +01:00
1b4370bde1
Rework retry logic when copying objects
...
* Fix off by one retry logic - fixes #406
* Retry any retriable errors
* Restructure code
2016-06-18 10:55:58 +01:00
cc6a776034
drive, acd: Tweak logging after changing Fs.Put so that it must cope with existing files
2016-06-18 10:54:42 +01:00
2cfb3834f2
Log errors with %v
2016-06-18 09:36:47 +01:00
46135d830e
Add --ignore-size flag - fixes #399
2016-06-17 17:20:08 +01:00
318e42e35b
Add a section on quoting in the shell to the docs - fixes #473
2016-06-17 16:28:50 +01:00
c7f04e24d3
Document that you can't repeat filter flags - fixes #506
2016-06-17 16:06:21 +01:00
e4650eff58
drive: fix retry of multipart uploads - fixes #520
...
Reset the reader on retry otherwise it is empty when read again.
2016-06-15 21:48:30 +01:00
869d91269d
Debug cause of low level retries
2016-06-15 21:48:14 +01:00
df1092ef33
Change Fs.Put so that it must cope with existing files
...
This should fix duplicate files on drive and 409 errors on
amazonclouddrive however it will slow down the upload slightly as
another roundtrip will be needed.
None of the other Fses needed adjusting.
Fixes #483
2016-06-13 19:29:10 +01:00
4c5b2833b3
Convert to using github.com/pkg/errors everywhere
2016-06-13 17:43:03 +01:00
7fe653c350
Unwrap errors properly for patform specific connection retry code.
...
Include more possible errors for Windows.
For #442
2016-06-10 13:48:41 +01:00
661715733a
Make sure we don't use conflicting content types on upload - fixes #513
2016-06-09 17:52:58 +01:00
f17cb1bf50
Fix retry of Windows wsaend errors #442
...
Make the test for wsaend error less specific
2016-06-09 15:34:13 +01:00
9ec06df79f
Be explicit about which arch we support which fixes failure to build with new gox
2016-06-09 15:33:26 +01:00
67d0375b98
Audit use of log.Print and change to Debug, Log, or ErrorLog as appropriate
2016-06-06 21:23:54 +01:00
4882b8ba67
Tweak website footer
2016-06-06 21:23:22 +01:00
108760e17b
Log -v output to stdout by default - fixes #228
2016-06-04 18:49:27 +01:00
f15e7e89d2
Add version string to debug startup message
2016-06-03 23:08:14 +01:00
e2788aa729
Display the transfer stats in more human readable form - fixes #428
2016-06-03 22:49:50 +01:00
772f99fd74
Make SizeSuffix output without b suffix for more useful printouts
2016-06-03 22:49:14 +01:00
9bbcdeefd0
Start the logger earlier so all messages go there - fixes #486
2016-06-03 22:08:27 +01:00
a21cc161de
Make 0 size files specifiable with --max-size 0b - fixes #450
2016-06-03 21:54:27 +01:00
e818b7c206
Represent -1 as "off" for SIZE values
2016-06-03 21:51:39 +01:00
5723d788a4
Add b suffix so we can specify bytes in --bwlimit, --min-size etc
...
Fixes #449
2016-06-03 21:16:48 +01:00
1d6698a754
Build tweaks - fixes #484
...
* disable CGO for static builds everywhere
* override Version in release build script
* don't output symbol table in release binaries
2016-06-03 20:34:19 +01:00
1fce83b936
swift: add auth version parameter - fixes #407
2016-06-03 17:52:24 +01:00
ccdd1ea6c4
Add --max-depth parameter
...
This will apply to ls/lsd/sync/copy etc
Fixes #412
Fixes #213
2016-06-03 17:05:39 +01:00
348734584b
Try OS X 10.11 to fix travis build
2016-05-30 20:32:35 +01:00
