Nick Craig-Wood
5df04cb763
swift: ignore directory marker objects where appropriate - fixes #190
...
* When creating a LimitedFs
* When calling List() to list files
* In the Storable() method
* Add a Purge() method to delete the directory marker objects too
This is a partial fix for #172
2015-11-07 15:32:11 +00:00
Nick Craig-Wood
ef54167a4a
Add goimports check to make check
2015-11-07 12:16:33 +00:00
Nick Craig-Wood
d42cb11b84
Fix tests to run all tests again and add onedrive
2015-11-07 11:21:15 +00:00
Nick Craig-Wood
b257de4aba
Be more constistent with naming in remotes
...
* External objects are called Fs and Object
* Object.fs always points to the Fs
2015-11-07 11:14:46 +00:00
Nick Craig-Wood
365b4babae
Make filter test files pass errcheck
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
6d48dffa2f
Add -dump-headers and -dump-bodies flags for remote tests
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
8f2999b6af
onedrive: implement Copy
2015-11-07 10:27:47 +00:00
Nick Craig-Wood
be6115fbfa
Fix nil pointer exception on test failure
2015-11-07 10:19:10 +00:00
Nick Craig-Wood
2fcb8f5db7
Add support for Microsoft One Drive - fixes #10
...
* Still to do
* Copy
* Move
* MoveDir
2015-11-07 10:19:10 +00:00
Nick Craig-Wood
0ab3f020ab
Fix Amazon icon in the docs
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
64c23c2f5b
Update font awesome to 4.4.0
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
ff16e0f6df
Factor common error handling into fs module
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
1a82ba196b
dircache: expose FoundRoot flag
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
ed72c678f8
Protect accounting from being closed twice
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
4ed8836a71
oauthutil: add RedirectPublicURL
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
5529978fa7
dircache: make separate mutex for the cache
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
66d84c9914
Document where to install root certificates - fixes #196
2015-11-05 18:09:56 +00:00
klauspost
b85ddc4e4f
Extend CI tests to include formatting checks.
...
CI tests now tests 'go vet', 'go fmt' (via goimports) and golint.
Adds Travis experimental OSX support.
2015-11-03 13:50:29 +01:00
klauspost
e4a9e27a55
Add proxy information to FAQ.
...
Fixes #160 .
2015-11-02 20:19:50 +00:00
Klaus Post
22645eea2e
Add AppVeyor Windows CI to tests
...
AppVeyor is free, and functions pretty much like Travis, only on Windows.
2015-11-02 20:11:06 +00:00
klauspost
345c98ed62
Update to AWS SDK 0.10.0
...
Tested with S3 and Dreamhost
Here is a link to the release notes:
http://aws.amazon.com/releasenotes/5476699172355228
2015-11-02 19:52:11 +00:00
klauspost
b872ff0237
Add option to disable server certificate verification.
...
The option name mirrors the 'wget' option (also `--no-check-certificate`). The cURL equivalent is called `--insecure`, which is a bit unclear.
Put in the "developers" section in documentation with proper warnings.
Fixes #168
2015-10-29 16:42:25 +01:00
Nick Craig-Wood
1b95718460
Fix typos in filter docs and unit test assertions
2015-10-20 09:16:47 +01:00
klauspost
6a3580c556
Show status of master branch, so it doesn't show the status of the last pushed branch,
2015-10-19 18:56:03 +01:00
klauspost
16c9fba5de
Fix tests failing on Windows.
...
* ":" is kept when part of a drive.
* Create tests.
* Fix test framework.
2015-10-19 17:36:15 +01:00
Nick Craig-Wood
4e952af614
Allow spaces in remotes and check remote names for validity at creation time - fixes #171
2015-10-12 17:54:09 +01:00
Klaus Post
6344c3051c
Add async readahead buffer
...
This adds an async read buffer of 4x4MB when copying files >10MB.
This fixes #164 and reduces the number of IO operations for copy/move.
2015-10-12 08:30:27 +01:00
klauspost
ab9f521cbd
Allow '&' and disallow ':' in Windows filenames.
...
Fixes #161
2015-10-05 11:04:25 +02:00
Nick Craig-Wood
3a900e5bb7
Version v1.23
2015-10-03 16:24:07 +01:00
Nick Craig-Wood
b4d7741611
Improve output of --dump-headers
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
95fd79faf9
swift: use Content-Length on uploads - fixes #125
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
b79dc01016
swift: stop chunked operations logging "Failed to read info: Object Not Found"
2015-10-03 16:04:51 +01:00
Nick Craig-Wood
bf562d7373
Tweak wording on client/secret ids in acd, gcs and drive - fixes #155
2015-10-03 16:04:45 +01:00
Nick Craig-Wood
2e9f2ea3d3
oauthutil: fix headless config for drive and gcs - fixes #158
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
177dbbc29a
Implement rclone size for measuring remotes - fixes #153
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
4712043e26
Fix race condition in pacer tests - fixes #156
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
852acd5e4e
oauthutil: tell the user they should try again if the webserver method failed
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
9f1daabb2c
s3: allow anonymous access to public repositories - fixes #154
...
When setting up the remote, leave both the access key and secret key
blank.
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
938dd24cc9
Fix typo
2015-09-28 22:51:33 +01:00
Nick Craig-Wood
57aad81b68
Version v1.22
2015-09-28 19:38:20 +01:00
Nick Craig-Wood
a91bcaaeb0
Implement rsync like include and exclude - fixes #27
...
* Implement include/exclude
* Implement rsync compatible file globbing
* Implement command line filtering flags
* --delete-excluded - Delete files on dest excluded from sync
* --filter - Add a file-filtering rule
* --filter-from - Read filtering patterns from a file
* --exclude - Exclude files matching pattern
* --exclude-from - Read exclude patterns from file
* --include - Include files matching pattern
* --include-from - Read include patterns from file
* --files-from - Read list of source-file nam
* --min-size - Don't transfer any file smaller than this in k or suffix k|M|G
* --max-size - Don't transfer any file larger than this in k or suffix k|M|G
* Document
2015-09-28 19:18:21 +01:00
Nick Craig-Wood
d04c21b198
Add Sergey Tolmachev to contributors
2015-09-28 19:12:35 +01:00
Nick Craig-Wood
4a0a42c2f1
swift: large file upload fixes
...
* Read metadata in file listing for 0 length files to fix syncs
* Ignore non-existent files in isManifestFile to fix errors on copy
* remove nsToSwiftFloatString - experiments with the swift program
indicate that it puts a variable number of points after the
decimal, so might as well use the one in the swift library.
* Make sure segments get deleted properly when move from segmented
to non segmented and vice versa
* Use internal list routine to detect errors on listing
* Remove the _segments container if possible
* Remove manifest first when deleting
2015-09-26 17:58:04 +01:00
Sergey Tolmachev
cc7b9af50e
swift: support files > 5GB - fixes #46
...
* Write segments to ..._segments container
* Choice of container and segment names compatible with swift tool
* See http://docs.openstack.org/developer/swift/overview_large_objects.html
* Controlled by command line flag --swift-chunk-size
* Segments removed on delete
2015-09-26 13:03:58 +01:00
Nick Craig-Wood
68fef49c55
swift: fetch headers as the only source of metadata
2015-09-26 13:03:58 +01:00
Nick Craig-Wood
5d4b149884
Version v1.21
2015-09-22 21:05:11 +01:00
Nick Craig-Wood
5f20ae707d
Make lsl output times in localtime and fix tests - fixes #141
2015-09-22 19:04:12 +01:00
Nick Craig-Wood
e9c915e6fe
Fix golint warnings
2015-09-22 18:47:16 +01:00
Nick Craig-Wood
2ed158aba3
Fixes from go vet and errcheck
2015-09-22 07:31:12 +01:00
Nick Craig-Wood
05050d53ad
Implement compliant pacing scheme for Amazon Cloud Drive
...
* Implement switchable pacing algorithm
* Add tests for pacer
2015-09-21 21:49:54 +01:00