rclone/notes.txt

Todo
  * Factor fses into own packages
  * FIXME: ls without an argument for buckets/containers?
  * FIXME: More -dry-run checks for object transfer
  * Might be quicker to check md5sums first? for swift <-> swift certainly, and maybe for small files
  * Ignoring the pseudo directories
    * if object.PseudoDirectory {
      * fmt.Printf("%9s %19s %s\n", "Directory", "-", fs.Remote())
  * Make Account wrapper
    * limit bandwidth for a pool of all individual connectinos
    * do timeouts by setting a limit, seeing whether io has happened
      and resetting it if it has
    * make Account do progress meter
  * Make logging controllable with flags (mostly done)
  * -timeout: Make all timeouts be settable with command line parameters
  * Check the locking in swift module!
  * Windows paths? Do we need to translate / and \?
  * Make a fs.Errorf and count errors and log them at a different level
  * add -modify-window flag - fs should keep knowledge of resolution
  * Add max object size to fs metadata - 5GB for swift, infinite for local, ? for s3

Ideas
  * could do encryption - put IV into metadata?
  * optimise remote copy container to another container using remote
    copy if local is same as remote
  * Allow subpaths container:/sub/path
  * look at auth from env in s3 module - add to swift?

Need to make directory objects otherwise can't upload an empty directory
  * Or could upload empty directories only?
  * Can't purge a local filesystem because it leaves the directories behind

s3
  * Can maybe set last modified?
    * https://forums.aws.amazon.com/message.jspa?messageID=214062
    * Otherwise can set metadata
  * Returns etag and last modified in bucket list
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00			`Todo`
Add initial S3 support * Requires a patched goamz to enable metadata reading and writing * Still todo: updating metadata * EU region not working yet 2013-01-08 19:53:35 +01:00			`* Factor fses into own packages`
			`* FIXME: ls without an argument for buckets/containers?`
Implement check and help commands 2012-12-31 18:31:19 +01:00			`* FIXME: More -dry-run checks for object transfer`
S3: Fix mkdir not to error if bucket exists and implement SetModTime 2013-01-08 23:31:16 +01:00			`* Might be quicker to check md5sums first? for swift <-> swift certainly, and maybe for small files`
Run ls in parallel so can parallelise the slow ModTime operations 2013-01-02 16:34:25 +01:00			`* Ignoring the pseudo directories`
			`* if object.PseudoDirectory {`
			`* fmt.Printf("%9s %19s %s\n", "Directory", "-", fs.Remote())`
Implement stats counting and reporting and return errors in return code 2013-01-03 23:50:00 +01:00			`* Make Account wrapper`
			`* limit bandwidth for a pool of all individual connectinos`
			`* do timeouts by setting a limit, seeing whether io has happened`
			`and resetting it if it has`
			`* make Account do progress meter`
Implement sync, -dry-run and fix logging * Implement sync command * Implement String() interface for Fs * Sort out logging of FsObject~s * Implement -dry-run, -verbose and -quiet 2012-12-31 17:40:34 +01:00			`* Make logging controllable with flags (mostly done)`
			`* -timeout: Make all timeouts be settable with command line parameters`
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00			`* Check the locking in swift module!`
			`* Windows paths? Do we need to translate / and \?`
			`* Make a fs.Errorf and count errors and log them at a different level`
Implement sync, -dry-run and fix logging * Implement sync command * Implement String() interface for Fs * Sort out logging of FsObject~s * Implement -dry-run, -verbose and -quiet 2012-12-31 17:40:34 +01:00			`* add -modify-window flag - fs should keep knowledge of resolution`
Add initial S3 support * Requires a patched goamz to enable metadata reading and writing * Still todo: updating metadata * EU region not working yet 2013-01-08 19:53:35 +01:00			`* Add max object size to fs metadata - 5GB for swift, infinite for local, ? for s3`
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00
Update notes 2012-12-23 18:46:03 +01:00			`Ideas`
Add initial S3 support * Requires a patched goamz to enable metadata reading and writing * Still todo: updating metadata * EU region not working yet 2013-01-08 19:53:35 +01:00			`* could do encryption - put IV into metadata?`
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00			`* optimise remote copy container to another container using remote`
			`copy if local is same as remote`
Update notes 2012-12-23 18:46:03 +01:00			`* Allow subpaths container:/sub/path`
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00			`* look at auth from env in s3 module - add to swift?`
Make checking and uploading run in parallel using channels Runs much faster and uses much less memory (thanks to walking the filesystem into a channel too). 2012-11-29 23:13:58 +01:00
Fix downloads - missing is the modified check so it downloads everything 2012-12-01 09:18:58 +01:00			`Need to make directory objects otherwise can't upload an empty directory`
			`* Or could upload empty directories only?`
Detect Fs from path to make operations consistent everywhere 2012-12-29 12:35:41 +01:00			`* Can't purge a local filesystem because it leaves the directories behind`

			`s3`
Implement stats counting and reporting and return errors in return code 2013-01-03 23:50:00 +01:00			`* Can maybe set last modified?`
			`* https://forums.aws.amazon.com/message.jspa?messageID=214062`
			`* Otherwise can set metadata`
			`* Returns etag and last modified in bucket list`