"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
Go to file
Ivan Andreev 59dba1de88 chunker: implementation + required fstest patch
Note: chunker implements many irrelevant methods (UserInfo, Disconnect etc),
but they are required by TestIntegration/FsCheckWrap and cannot be removed.

Dropped API methods: MergeDirs DirCacheFlush PublicLink UserInfo Disconnect OpenWriterAt

Meta formats:
- renamed old simplejson format to wdmrcompat.
- new simplejson format supports hash sums and verification of chunk size/count.

Change list:
- split-chunking overlay for mailru
- add to all
- fix linter errors
- fix integration tests
- support chunks without meta object
- fix package paths
- propagate context
- fix formatting
- implement new required wrapper interfaces
- also test large file uploads
- simplify options
- user friendly name pattern
- set default chunk size 2G
- fix building with golang 1.9
- fix ci/cd on a separate branch
- fix updated object name (SyncUTFNorm failed)
- fix panic in Box overlay
- workaround: Box rename failed if name taken
- enhance comments in unit test
- fix formatting
- embed wrapped remote rather than inherit
- require wrapped remote to support move (or copy)
- implement 3 (keep fstest)
- drop irrelevant file system interfaces
- factor out Object.mainChunk
- refactor TestLargeUpload as InternalTest
- add unit test for chunk name formats
- new improved simplejson meta format
- tricky case in test FsIsFile (fix+ignore)
- remove debugging print
- hide temporary objects from listings
- fix bugs in chunking reader:
  - return EOF immediately when all data is sent
  - handle case when wrapped remote puts by hash (bug detected by TestRcat)
- chunked file hashing (feature)
- server-side copy across configs (feature)
- robust cleanup of temporary chunks in Put
- linear download strategy (no read-ahead, feature)
- fix unexpected EOF in the box multipart uploader
- throw error if destination ignores data
2019-09-24 12:45:12 +01:00
.circleci build: fix circleci build to use billziss/xgo-cgofuse container 2019-09-12 21:59:50 +01:00
.github build: build rclone with github actions 2019-09-20 16:08:18 +01:00
backend chunker: implementation + required fstest patch 2019-09-24 12:45:12 +01:00
bin mailru: backend for mail.ru 2019-09-09 21:56:16 +01:00
cmd serve/httplib: Write the template to a buffer to catch render errors 2019-09-22 21:31:11 +01:00
contrib/docker Contrib: Add sample WebDAV server Docker Compose manifest. 2019-09-15 16:06:54 +01:00
docs Add Anthony Rusdi to contributors 2019-09-21 14:39:03 +01:00
fs log: add Stack() function for debugging who calls what 2019-09-20 11:53:08 +01:00
fstest chunker: implementation + required fstest patch 2019-09-24 12:45:12 +01:00
graphics graphics: update rclone logos to new design 2019-08-24 09:31:33 +01:00
lib jwtutil: functionality to get an access token via JWT authentication 2019-09-20 17:15:16 +01:00
vendor vendor: add pkcs8 helpers for decrypting encrypted private keys 2019-09-20 17:15:16 +01:00
vfs vfs: make objects of unknown size readable through the VFS 2019-09-14 13:09:07 +01:00
.appveyor.yml vfs: add flag --vfs-case-insensitive for windows/macOS mounts 2019-09-04 21:30:48 +01:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore chore: update .gitignore 2019-06-19 11:59:46 +01:00
.golangci.yml build: move linter build tags into Makefile to fix golangci-lint 2019-04-12 15:48:36 +01:00
.pkgr.yml Updated .pkgr.yml file to use rclone as its own cli. 2017-03-29 17:48:53 +01:00
.travis.yml build: update to use go1.13 for the build 2019-09-04 10:23:48 +01:00
CONTRIBUTING.md fstest: remove -subdir flag as it no longer tests anything useful #3421 2019-08-17 09:54:19 +01:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile Dockerfile fixes 2019-09-17 10:12:32 +01:00
go.mod vendor: add pkcs8 helpers for decrypting encrypted private keys 2019-09-20 17:15:16 +01:00
go.sum vendor: add pkcs8 helpers for decrypting encrypted private keys 2019-09-20 17:15:16 +01:00
MAINTAINERS.md build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
Makefile build: build rclone with github actions 2019-09-20 16:08:18 +01:00
MANUAL.html Version v1.49.0 2019-08-26 15:25:20 +01:00
MANUAL.md Version v1.49.0 2019-08-26 15:25:20 +01:00
MANUAL.txt Version v1.49.0 2019-08-26 15:25:20 +01:00
notes.txt Replace test_all.sh with test_all.go which is cross platform and parallel 2015-12-30 09:26:34 +00:00
rclone.1 Version v1.49.0 2019-08-26 15:25:20 +01:00
rclone.go build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
README.md mailru: backend for mail.ru 2019-09-09 21:56:16 +01:00
RELEASE.md Start v1.49.2-DEV development 2019-09-08 17:36:21 +01:00

rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Windows Build Status Build Status CircleCI Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional encryption (Crypt)
  • Optional cache (Cache)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).