Commit Graph

20 Commits

Author SHA1 Message Date
Nick Craig-Wood
38ce4c3629 S3: Fix mkdir not to error if bucket exists and implement SetModTime 2013-01-08 22:31:16 +00:00
Nick Craig-Wood
b9e468ebbd Add initial S3 support
* Requires a patched goamz to enable metadata reading and writing
  * Still todo: updating metadata
  * EU region not working yet
2013-01-08 18:59:38 +00:00
Nick Craig-Wood
f7197c30d7 Implement stats counting and reporting and return errors in return code 2013-01-03 22:50:00 +00:00
Nick Craig-Wood
12015b0007 Run ls in parallel so can parallelise the slow ModTime operations 2013-01-02 15:34:25 +00:00
Nick Craig-Wood
ecb863dd4f Make ModTime fall back to LastModified header
Which means it no longer needs to report an error which simplifies the code
2013-01-02 15:21:55 +00:00
Nick Craig-Wood
90a2c86eb3 Implement check and help commands 2012-12-31 17:32:11 +00:00
Nick Craig-Wood
335667fdcb Implement sync, -dry-run and fix logging
* Implement sync command
  * Implement String() interface for Fs
  * Sort out logging of FsObject~s
  * Implement -dry-run, -verbose and -quiet
2012-12-31 16:40:34 +00:00
Nick Craig-Wood
c15ae179ee Detect Fs from path to make operations consistent everywhere 2012-12-29 11:35:41 +00:00
Nick Craig-Wood
c3671907cb Update notes 2012-12-23 17:46:03 +00:00
Nick Craig-Wood
19668ac18f Fix loss of precision for setting timestamps so roundtrip happens properly 2012-12-01 12:05:17 +00:00
Nick Craig-Wood
25a1b96537 Make download work properly skipping not changed files
Reorganise FsObject and factor more stuff into methods

Note that os.Chtimes() isn't setting the same precision (us) as we are
reading from os.Lstat() (ns) so the modification times don't roundtrip
properly yet.
2012-12-01 10:53:48 +00:00
Nick Craig-Wood
a3e28e6b97 Fix downloads - missing is the modified check so it downloads everything 2012-12-01 08:18:58 +00:00
Nick Craig-Wood
4d23e29274 Make checking and uploading run in parallel using channels
Runs much faster and uses much less memory (thanks to walking the
filesystem into a channel too).
2012-11-29 22:13:58 +00:00
Nick Craig-Wood
ba24b84396 Use ObjectsAll and ContainersAll to see everything 2012-11-28 23:40:09 +00:00
Nick Craig-Wood
a49b8ca0b6 Use filesystem walk ordering rather than hash order 2012-11-28 11:38:14 +00:00
Nick Craig-Wood
3e4f75b558 Fix relative vs absolute path confusion in logging 2012-11-28 11:32:04 +00:00
Nick Craig-Wood
e3096508dd If the remote object doesn't have mtime then check the md5sum to see if changed 2012-11-28 11:17:31 +00:00
Nick Craig-Wood
81b7f41dfb More notes 2012-11-28 10:47:35 +00:00
Nick Craig-Wood
08c3e9fd57 Basic set of listing and upload commands 2012-11-20 22:40:48 +00:00
Nick Craig-Wood
e9ae4f89a4 Initial commit - some small parts working 2012-11-18 17:32:31 +00:00