Commit Graph

1669 Commits

Author SHA1 Message Date
Nick Craig-Wood
0a108832e2 Remove filesystem flags and put in config file with editor 2014-03-15 16:06:11 +00:00
Nick Craig-Wood
8fd43a52e7 Remove custom nS precision Chtimes as now in Go >= 1.1 2014-03-08 16:30:58 +00:00
Nick Craig-Wood
eefe789fc2 More notes 2013-10-25 12:05:37 +01:00
Nick Craig-Wood
a34bf2ae5e Make imports absolute and use own copy of goamz pending patch inclusion 2013-07-11 17:37:33 +01:00
Nick Craig-Wood
90738f4081 More notes 2013-07-11 17:36:53 +01:00
Nick Craig-Wood
754c54b64f Fix differences print out on check 2013-07-02 08:33:17 +01:00
Nick Craig-Wood
7153b05342 Note that drive goroutine leak now fixed upstream (by my patch :-) 2013-06-29 21:13:30 +01:00
Nick Craig-Wood
43be26d1f8 Make local filesystem go last 2013-06-29 12:15:55 +01:00
Nick Craig-Wood
b98923a20f drive: Finish refactor 2013-06-29 12:15:31 +01:00
Nick Craig-Wood
025e5f3f0c Pass flags on to fs.Config 2013-06-29 10:43:52 +01:00
Nick Craig-Wood
37d59db94e Rename _junk directory so go build ./... doesn't see into it 2013-06-29 10:43:20 +01:00
Nick Craig-Wood
f1a08ad6bf Namespace the swift options 2013-06-28 18:24:06 +01:00
Nick Craig-Wood
b1f681b912 Rename fs.FsX to fs.X 2013-06-28 08:57:32 +01:00
Nick Craig-Wood
6085dc1b5a Refactor into sub filesystems 2013-06-27 22:17:51 +01:00
Nick Craig-Wood
2bca3a45bd Retire chtimes except for !go1.1 now it is in the standard library 2013-06-27 20:09:40 +01:00
Nick Craig-Wood
f5e60b6e37 Rename to rclone 2013-06-27 20:09:40 +01:00
Nick Craig-Wood
fce2af7934 go fmt 1.1 style 2013-06-27 20:06:44 +01:00
Nick Craig-Wood
b8c191b51c swift: Store root for later when we support directories 2013-06-27 19:49:35 +01:00
Nick Craig-Wood
717a0d268b Fix after goamz interface change 2013-06-27 19:46:31 +01:00
Nick Craig-Wood
4cda51b77a Update after API changes in goamz/s3 2013-02-06 23:31:42 +00:00
Nick Craig-Wood
4cce906f8b Implement fs.ListDir / lsd command 2013-01-23 22:43:20 +00:00
Nick Craig-Wood
8404290499 drive: add full directory listing option for speed
* Add -drive-full-list flag to choose between recursive and full directory list
  * Full list is the default - much quicker if there are lots of directories
2013-01-23 21:19:26 +00:00
Nick Craig-Wood
351829e9fe drive: refactor listDir to take a client function 2013-01-20 11:56:56 +00:00
Nick Craig-Wood
98108caac2 drive: remove files.Info from FsObjectDrive and copy data out to save memory 2013-01-19 10:16:51 +00:00
Nick Craig-Wood
f8246b5a7e Implement Precision interface in all filesystems
* drive: add mime type on upload
  * drive: correct info on upload to fix crash
  * local: measure time precision by making a local file and using Chtimes
  * swift: move snet parameter here
  * core: add -modify-window and compute the optimum one
  * core: use modify window when checking times
2013-01-19 10:16:51 +00:00
Nick Craig-Wood
b41367856b Update docs 2013-01-18 18:54:19 +00:00
Nick Craig-Wood
6e732f3dc0 Implement Purger interface and drive.Purge 2013-01-18 17:11:44 +00:00
Nick Craig-Wood
a0a789ff0f Fix after go vet 2013-01-18 17:11:44 +00:00
Nick Craig-Wood
fdb1ec4d53 Implement Google Drive interface
* needs writeup of rather complicated api key setup
  * not implemented yet
    * fix for slow directory listing
    * mimetypes for files
2013-01-18 17:11:22 +00:00
Nick Craig-Wood
90a397c533 Stop sync creating FsObjects unecessarily when they have been created by List already 2013-01-14 23:08:10 +00:00
Nick Craig-Wood
8b066ba77c Don't delete files if errors in copy phase of sync
Make check return errors on differences
2013-01-10 22:14:23 +00:00
Nick Craig-Wood
555ab5001e Factor Put() methods into generic Copy() function 2013-01-10 21:58:46 +00:00
Nick Craig-Wood
38ce4c3629 S3: Fix mkdir not to error if bucket exists and implement SetModTime 2013-01-08 22:31:16 +00:00
Nick Craig-Wood
b9e468ebbd Add initial S3 support
* Requires a patched goamz to enable metadata reading and writing
  * Still todo: updating metadata
  * EU region not working yet
2013-01-08 18:59:38 +00:00
Nick Craig-Wood
f7197c30d7 Implement stats counting and reporting and return errors in return code 2013-01-03 22:50:00 +00:00
Nick Craig-Wood
12015b0007 Run ls in parallel so can parallelise the slow ModTime operations 2013-01-02 15:34:25 +00:00
Nick Craig-Wood
ecb863dd4f Make ModTime fall back to LastModified header
Which means it no longer needs to report an error which simplifies the code
2013-01-02 15:21:55 +00:00
Nick Craig-Wood
90a2c86eb3 Implement check and help commands 2012-12-31 17:32:11 +00:00
Nick Craig-Wood
335667fdcb Implement sync, -dry-run and fix logging
* Implement sync command
  * Implement String() interface for Fs
  * Sort out logging of FsObject~s
  * Implement -dry-run, -verbose and -quiet
2012-12-31 16:40:34 +00:00
Nick Craig-Wood
c15ae179ee Detect Fs from path to make operations consistent everywhere 2012-12-29 11:35:41 +00:00
Nick Craig-Wood
4028a4192f Use swift.ObjectsWalk 2012-12-28 16:38:51 +00:00
Nick Craig-Wood
555e545b46 Fix after go vet 2012-12-26 12:27:26 +00:00
Nick Craig-Wood
3bf6348f57 Factor local filesystem and remote swift into Fs and FsObject interfaces
This will enable
  * local -> local and remote -> remote copies
  * a much more uniform style
  * could do s3 as well
2012-12-26 12:23:58 +00:00
Nick Craig-Wood
12658efef2 gofmt 2012-12-24 00:03:18 +00:00
Nick Craig-Wood
c3671907cb Update notes 2012-12-23 17:46:03 +00:00
Nick Craig-Wood
720d44f8e9 Delete many files at once with purge 2012-12-23 09:49:49 +00:00
Nick Craig-Wood
a5ecd66388 Remove commented out code 2012-12-23 09:34:29 +00:00
Nick Craig-Wood
9a066460f1 Make downloads work in parallel 2012-12-23 09:32:33 +00:00
Nick Craig-Wood
9fb8a1afa2 Implement purge and make upload make the container first 2012-12-04 00:09:22 +00:00
Nick Craig-Wood
664dbdc9e7 Make the commands data driven 2012-12-03 23:58:17 +00:00