extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-11-23 00:43:49 +01:00
Code Issues Packages Projects Releases Wiki Activity
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
1,757 Commits 177 Branches 114 Tags 315 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
e53892f53b
Go to file
Nick Craig-Wood e53892f53b fs,drive,dropbox: Make and use new RepeatableReader variants to lower memory use 
RepeatableReaderSized has a pre-allocated buffer which should help
with memory usage - before it grew the buffer.  Since we know the size
of the chunks, pre-allocating it should be much more efficient.

RepeatableReaderBuffer uses the buffer passed in.

RepeatableLimit* are convenience funcitions for wrapping a reader in
an io.LimitReader and then a RepeatableReader with the same buffer
size.
2017-11-23 13:53:46 +00:00
.circleci Add android and IOS build to circleci 2017-10-11 13:40:02 +01:00
amazonclouddrive fstests: only test uploadswith indeterminate size on remotes that support it 2017-08-22 07:19:43 +02:00
azureblob fstests: only test uploadswith indeterminate size on remotes that support it 2017-08-22 07:19:43 +02:00
b2 b2: implement streaming upload of files with unknown length (see #1614) (closes #1686) 2017-09-16 22:43:48 +02:00
bin build: add in 64bit path for WinFSP headers 2017-11-20 12:46:24 +00:00
box rest: factor URLJoin and URLEscape from http remote 2017-10-09 16:19:37 +01:00
cache cache: catch signal interrupt for bolt handle cleanup 2017-11-22 18:32:36 +02:00
cmd mount: support truncate properly 2017-11-20 19:42:35 +00:00
crypt crypt: implement DirChangeNotify 2017-11-19 20:09:52 +00:00
dircache Change List interface and add ListR optional interface 2017-06-14 16:49:40 +01:00
docs Add David Minor to contributors 2017-11-23 08:57:34 +00:00
drive fs,drive,dropbox: Make and use new RepeatableReader variants to lower memory use 2017-11-23 13:53:46 +00:00
dropbox fs,drive,dropbox: Make and use new RepeatableReader variants to lower memory use 2017-11-23 13:53:46 +00:00
fs fs,drive,dropbox: Make and use new RepeatableReader variants to lower memory use 2017-11-23 13:53:46 +00:00
fstest move: fixed root source directories getting deleted after move - fixes #1849 2017-11-23 12:01:35 +03:00
ftp fstests: only test uploadswith indeterminate size on remotes that support it 2017-08-22 07:19:43 +02:00
googlecloudstorage googlecloudstorage: support streaming uploads (see #1614) (closes #1684) 2017-09-16 22:46:02 +02:00
graphics New graphics used by forum.rclone.org 2016-10-04 11:31:42 +01:00
http rest: factor URLJoin and URLEscape from http remote 2017-10-09 16:19:37 +01:00
hubic hubic: don't check the container exists before creating it 2017-08-30 15:54:49 +01:00
local local: add error message for cross file system moves 2017-11-20 12:46:24 +00:00
oauthutil oauthutil: make sure auth server always finishes even when things go wrong 2017-11-09 21:34:44 +00:00
onedrive onedrive: Add option to choose resourceURL during setup of OneDrive Business account if more than one is avauilable for user 2017-11-05 21:41:56 +00:00
pacer pacer: Factor TokenDispenser into pacer from box remote 2017-07-29 23:14:47 +01:00
pcloud pcloud: make compile with go1.6 2017-10-01 16:41:23 +01:00
qingstor qingstor: Support hash md5 for upload object 2017-08-31 16:41:08 +01:00
rest rest: Add SetUserPass to create Authorization header 2017-10-09 16:19:37 +01:00
s3 s3: add support for ECS task IAM roles 2017-11-23 08:56:56 +00:00
sftp fstests: only test uploadswith indeterminate size on remotes that support it 2017-08-22 07:19:43 +02:00
swift swift: add OS_TENANT_ID to config 2017-11-02 14:49:07 +00:00
vendor vendor: vfs add vendor/github.com/djherbis/times 2017-11-20 12:36:50 +00:00
vfs vfs: make sure write only handles never truncate files they shouldn't 2017-11-20 19:42:25 +00:00
webdav webdav: fix Copy, Move and DirMove to be more compatible 2017-10-25 22:59:22 +01:00
yandex drive, yandex: add missing CleanUpper interface check 2017-09-30 16:34:46 +01:00
.appveyor.yml Use build tags to control when and where cmount is built 2017-05-19 17:08:04 +01:00
.gitignore cache: first version 2017-11-15 15:23:21 +00:00
.pkgr.yml Updated .pkgr.yml file to use rclone as its own cli. 2017-03-29 17:48:53 +01:00
.travis.yml Update travis builds to go 1.9.2 and go 1.8.5 2017-10-26 22:30:53 +01:00
CONTRIBUTING.md Implement pcloud remote - #418 2017-10-01 11:37:35 +01:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Gopkg.lock vendor: vfs add vendor/github.com/djherbis/times 2017-11-20 12:36:50 +00:00
Gopkg.toml vendor: add github.com/okzk/sdnotify 2017-11-20 11:03:10 +00:00
ISSUE_TEMPLATE.md Update references from HTTP to HTTPS where possible 2017-03-29 05:38:34 -07:00
MAINTAINERS.md Update MAINTAINERS with our new maintainer Remus Bunduc 2017-11-21 17:32:07 +00:00
Makefile Makefile: clean some more files 2017-09-30 16:02:00 +01:00
MANUAL.html Version v1.38 2017-09-30 14:20:43 +01:00
MANUAL.md Version v1.38 2017-09-30 14:20:43 +01:00
MANUAL.txt Version v1.38 2017-09-30 14:20:43 +01:00
notes.txt Replace test_all.sh with test_all.go which is cross platform and parallel 2015-12-30 09:26:34 +00:00
rclone.1 Version v1.38 2017-09-30 14:20:43 +01:00
rclone.go Make sure high level retries show with -q - fixes #648 2016-09-12 17:50:19 +01:00
README.md Implement WebDAV remote #580 2017-10-09 16:19:37 +01:00
RELEASE.md Fix fetch_windows target in Makefile 2017-07-22 20:44:09 +01:00

README.md

Logo

Website | Documentation | Contributing | Changelog | Installation | Forum G+

Build Status Windows Build Status CircleCI GoDoc

Rclone is a command line program to sync files and directories to and from

  • Amazon Drive
  • Amazon S3 / Dreamhost / Ceph / Minio / Wasabi
  • Backblaze B2
  • Box
  • Dropbox
  • FTP
  • Google Cloud Storage
  • Google Drive
  • HTTP
  • Hubic
  • Microsoft Azure Blob Storage
  • Microsoft OneDrive
  • Openstack Swift / Rackspace cloud files / Memset Memstore / OVH / Oracle Cloud Storage
  • pCloud
  • QingStor
  • SFTP
  • Webdav / Owncloud / Nextcloud
  • Yandex Disk
  • The local filesystem

Features

  • MD5/SHA1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, eg two different cloud accounts
  • Optional encryption (Crypt)
  • Optional FUSE mount

See the home page for installation, usage, documentation, changelog and configuration walkthroughs.

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).