Commit Graph

6100 Commits

Author SHA1 Message Date
74994a2ec1 Fix uploading big files which was causing timeouts or panics
The symtom was one of these two on upload of files only
  * panic: d.nx != 0 in crypto/md5.(*digest).checkSum
  * read tcp: i/o timeout

It turned out to be a combination of two upstream bugs

  * 5a2187309e
  * https://groups.google.com/forum/#!topic/golang-dev/0Nl6k5Sj6UU

This commit contains a work-around for the second problem, I've fixed
the first and had the change accepted upstream.
2015-06-09 17:32:45 +01:00
97dced6a0b Don't check md5sum after download with --size-only - fixes #75 2015-06-09 13:18:40 +01:00
e04acb09ce Version v1.15 v1.15 2015-06-06 15:45:00 +01:00
87ed7fc932 Document rclone's limitations with directories - fixes #69 2015-06-06 14:33:08 +01:00
90744301d3 Fix package docs so they appear in godoc correctly 2015-06-06 14:24:30 +01:00
bf4879f57f Expand docs and remove duplicated information 2015-06-06 14:17:14 +01:00
e22b445cff Implement --size-only flag to sync on size not checksum & modtime - fixes #75 2015-06-06 08:49:01 +01:00
5ab7970e18 dropbox: update docs about case insensitivity - see #53 2015-06-06 08:44:09 +01:00
e984eeedc4 Add Alex Couper to contributors 2015-06-05 20:12:56 +01:00
968b5a0984 Update notes 2015-06-05 20:00:36 +01:00
7af1282375 Add --checksum flag to only discard transfers by MD5SUM - fixes #61
Useful for copying between backends where checksum fetching is fast,
ie any of s3, swift, drive or googlecloudstorage.
2015-06-05 19:46:03 +01:00
d9fcc32f70 Version v1.14 v1.14 2015-05-21 20:13:40 +01:00
870a9fc3b2 local: fix encoding of non utf-8 file names - fixes #66 2015-05-21 18:40:16 +01:00
8e3703abeb drive: docs about rate limiting 2015-05-21 18:39:46 +01:00
ba81277bbe google cloud storage: Fix compile after API change in "google.golang.org/api/storage/v1"
The breaking change is: google-api-go-generator: remove underscores from identifiers.
2015-05-19 08:18:26 +01:00
88293a4b8a Version v1.13 v1.13 2015-05-10 12:39:06 +01:00
981104519e Revise documentation (especially sync) - fixes #39 2015-05-10 12:17:24 +01:00
1d254a3674 Implement --timeout and --conntimeout - fixes #54
NB dropbox still to do
2015-05-10 11:29:55 +01:00
f88d171afd s3: ignore etags from multipart uploads which aren't md5sums - fixes #56 2015-05-10 11:29:55 +01:00
ba2091725e Version v1.12 v1.12 2015-03-15 15:55:38 +00:00
7c120b8bc5 drive: add --drive-chunk-size and --drive-upload-cutoff parameters 2015-03-15 15:27:55 +00:00
5cc5429f99 drive: switch to insert from update when a failed copy deletes the upload 2015-03-15 15:27:55 +00:00
09d71239b6 Make file size render more neatly and prevent from being < 0 2015-03-15 15:27:55 +00:00
c643e4585e core: Log duplicate files if they are detected 2015-03-15 15:27:55 +00:00
873db29391 Log all objects more informatively 2015-03-15 15:27:55 +00:00
81a933ae38 drive: Use chunked upload for files - fixes #33 2015-03-15 15:27:55 +00:00
ecb3c7bcef drive, googlecloudstorage: remove SeekWrapper after googleapi fix 2015-03-04 20:47:59 +00:00
80000b904c Version v1.11 v1.11 2015-03-04 17:59:31 +00:00
c47c9cd440 swift: add region parameter - fixes #38 2015-03-04 17:09:53 +00:00
b4a0941d4c In remote paths, change native directory separators to / - fixes #37 2015-03-02 17:04:34 +00:00
c03d6a1ec3 drive: fix crash on failed to update remote mtime - fixes #36 2015-03-02 09:25:33 +00:00
46d39ebaf7 Factor Mime Type guessing into fs.MimeType() 2015-03-02 09:21:15 +00:00
fe68737268 Fix niggles found by go vet 2015-02-28 15:35:54 +00:00
2360bf907a Add synchronization to list output to stop corruptions - fixes #29 2015-02-28 15:30:40 +00:00
aa093e991e Ensure all stats/log messages to go stderr - fixes #30 2015-02-28 14:39:00 +00:00
a5974999eb Update docs - fixes #32 2015-02-28 14:15:47 +00:00
24a6ff54c2 Add --log-file flag to log everything (including panics) to file 2015-02-28 08:10:20 +00:00
e89ea3360e Make it possible to disable stats printing with --stats=0 2015-02-27 15:22:26 +00:00
85f8552c4d Tidy logging 2015-02-27 15:22:05 +00:00
a287e3ced7 Implement --bwlimit to limit data transfer bandwidth 2015-02-27 15:03:47 +00:00
8e4d8d13b8 drive: rename internal api 2015-02-20 09:51:07 +00:00
cf208ad21b Version v1.10 v1.10 2015-02-12 18:00:20 +00:00
0faed16899 s3: list an unlimited number of items - fixes #22 2015-02-10 17:58:29 +00:00
8d1c0ad07c Fix config loop - fixes #25 2015-02-10 16:48:04 +00:00
165e89c266 Version v1.09 v1.09 2015-02-07 22:44:23 +00:00
b4e19cfd62 windows: make tests work properly 2015-02-07 22:32:51 +00:00
20ad96f3cd windows: Stop drive letters (eg C:) getting mixed up with remotes (eg drive:)
This was done by stopping the user configuring single letter remotes
and making sure we don't treat single letter remotes as a remote name,
but as a drive letter.
2015-02-07 22:32:51 +00:00
d64a37772f local: Fix directory separators on Windows - fixes #24 2015-02-07 22:32:51 +00:00
5fb6f94579 drive: fix rate limit exceeded errors - fixes #20
This is done by pacing the requests to drive and backing them off
using an exponential increase.  Put and Modify operations can now be
retried also.
2015-02-07 22:32:51 +00:00
20535348db Update docs to remove obsolete bug - fixes #21 2015-02-07 22:32:51 +00:00