Commit Graph

38 Commits

Author SHA1 Message Date
Nick Craig-Wood
c1a245d1c8 Factor UserAgent to fs and move Version to fs 2014-07-13 19:19:58 +01:00
Nick Craig-Wood
dd6d7cad3a Notes about storage systems 2014-07-09 20:50:08 +01:00
Nick Craig-Wood
d4817399ff Fix release procedure 2014-07-03 22:01:25 +01:00
Nick Craig-Wood
99695d57ab Implement single file operations for all file systems 2014-05-05 22:17:57 +01:00
Nick Craig-Wood
365dc2ff59 Version v0.96 - automate the release process 2014-04-25 18:18:58 +01:00
Nick Craig-Wood
8fd59f2e7d drive: Use o.Update and fs.Put to optimise transfers 2014-04-18 17:49:01 +01:00
Nick Craig-Wood
86b77f3ca8 drive: Fix multiple files of same name being created
ModifiedDate seems to be set on Insert if set, so do that
2014-04-17 22:27:33 +01:00
Nick Craig-Wood
b4dd693d23 drive: Rework token aquisition into config framework and store token in config file 2014-03-27 16:52:39 +00:00
Nick Craig-Wood
dc0e9383a8 Update notes 2014-03-16 00:33:03 +00:00
Nick Craig-Wood
eefe789fc2 More notes 2013-10-25 12:05:37 +01:00
Nick Craig-Wood
90738f4081 More notes 2013-07-11 17:36:53 +01:00
Nick Craig-Wood
f5e60b6e37 Rename to rclone 2013-06-27 20:09:40 +01:00
Nick Craig-Wood
4cce906f8b Implement fs.ListDir / lsd command 2013-01-23 22:43:20 +00:00
Nick Craig-Wood
f8246b5a7e Implement Precision interface in all filesystems
* drive: add mime type on upload
  * drive: correct info on upload to fix crash
  * local: measure time precision by making a local file and using Chtimes
  * swift: move snet parameter here
  * core: add -modify-window and compute the optimum one
  * core: use modify window when checking times
2013-01-19 10:16:51 +00:00
Nick Craig-Wood
6e732f3dc0 Implement Purger interface and drive.Purge 2013-01-18 17:11:44 +00:00
Nick Craig-Wood
fdb1ec4d53 Implement Google Drive interface
* needs writeup of rather complicated api key setup
  * not implemented yet
    * fix for slow directory listing
    * mimetypes for files
2013-01-18 17:11:22 +00:00
Nick Craig-Wood
8b066ba77c Don't delete files if errors in copy phase of sync
Make check return errors on differences
2013-01-10 22:14:23 +00:00
Nick Craig-Wood
555ab5001e Factor Put() methods into generic Copy() function 2013-01-10 21:58:46 +00:00
Nick Craig-Wood
38ce4c3629 S3: Fix mkdir not to error if bucket exists and implement SetModTime 2013-01-08 22:31:16 +00:00
Nick Craig-Wood
b9e468ebbd Add initial S3 support
* Requires a patched goamz to enable metadata reading and writing
  * Still todo: updating metadata
  * EU region not working yet
2013-01-08 18:59:38 +00:00
Nick Craig-Wood
f7197c30d7 Implement stats counting and reporting and return errors in return code 2013-01-03 22:50:00 +00:00
Nick Craig-Wood
12015b0007 Run ls in parallel so can parallelise the slow ModTime operations 2013-01-02 15:34:25 +00:00
Nick Craig-Wood
ecb863dd4f Make ModTime fall back to LastModified header
Which means it no longer needs to report an error which simplifies the code
2013-01-02 15:21:55 +00:00
Nick Craig-Wood
90a2c86eb3 Implement check and help commands 2012-12-31 17:32:11 +00:00
Nick Craig-Wood
335667fdcb Implement sync, -dry-run and fix logging
* Implement sync command
  * Implement String() interface for Fs
  * Sort out logging of FsObject~s
  * Implement -dry-run, -verbose and -quiet
2012-12-31 16:40:34 +00:00
Nick Craig-Wood
c15ae179ee Detect Fs from path to make operations consistent everywhere 2012-12-29 11:35:41 +00:00
Nick Craig-Wood
c3671907cb Update notes 2012-12-23 17:46:03 +00:00
Nick Craig-Wood
19668ac18f Fix loss of precision for setting timestamps so roundtrip happens properly 2012-12-01 12:05:17 +00:00
Nick Craig-Wood
25a1b96537 Make download work properly skipping not changed files
Reorganise FsObject and factor more stuff into methods

Note that os.Chtimes() isn't setting the same precision (us) as we are
reading from os.Lstat() (ns) so the modification times don't roundtrip
properly yet.
2012-12-01 10:53:48 +00:00
Nick Craig-Wood
a3e28e6b97 Fix downloads - missing is the modified check so it downloads everything 2012-12-01 08:18:58 +00:00
Nick Craig-Wood
4d23e29274 Make checking and uploading run in parallel using channels
Runs much faster and uses much less memory (thanks to walking the
filesystem into a channel too).
2012-11-29 22:13:58 +00:00
Nick Craig-Wood
ba24b84396 Use ObjectsAll and ContainersAll to see everything 2012-11-28 23:40:09 +00:00
Nick Craig-Wood
a49b8ca0b6 Use filesystem walk ordering rather than hash order 2012-11-28 11:38:14 +00:00
Nick Craig-Wood
3e4f75b558 Fix relative vs absolute path confusion in logging 2012-11-28 11:32:04 +00:00
Nick Craig-Wood
e3096508dd If the remote object doesn't have mtime then check the md5sum to see if changed 2012-11-28 11:17:31 +00:00
Nick Craig-Wood
81b7f41dfb More notes 2012-11-28 10:47:35 +00:00
Nick Craig-Wood
08c3e9fd57 Basic set of listing and upload commands 2012-11-20 22:40:48 +00:00
Nick Craig-Wood
e9ae4f89a4 Initial commit - some small parts working 2012-11-18 17:32:31 +00:00