extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-12-23 23:49:15 +01:00
Code Issues Packages Projects Releases Wiki Activity
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
6,829 Commits 182 Branches 114 Tags 334 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
e5a1bcb1ce
Go to file
Nick Craig-Wood e5a1bcb1ce s3: fix InvalidRequest copying to a locked bucket from a source with no MD5SUM 
Before this change, we would upload files as single part uploads even
if the source MD5SUM was not available.

AWS won't let you upload a file to a locket bucket without some sort
of hash protection of the upload which we don't have with no MD5SUM.

So we switch to multipart upload when the source does not have an
MD5SUM.

This means that if --s3-disable-checksum is set or we are copying from
a source with no MD5SUMs we will copy with multipart uploads.

This patch changes all uploads, not just those to locked buckets
because having no MD5SUM protection on uploads is undesirable.

Fixes #6846
2023-03-17 11:34:20 +00:00
.github build: run workflow even if tag/branch name contains slash 2023-03-16 17:07:07 +00:00
backend s3: fix InvalidRequest copying to a locked bucket from a source with no MD5SUM 2023-03-17 11:34:20 +00:00
bin Set Github release to draft while uploading binaries 2023-03-15 14:53:21 +00:00
cmd docs: note that rcat will retry chunks when multipart uploading 2023-03-17 10:52:21 +00:00
cmdtest test: replace defer cleanup with t.Cleanup 2022-12-09 14:38:05 +00:00
contrib docker volume plugin: add missing fuse3 dependency #6844 2023-03-15 15:57:53 +00:00
docs Add Thibault Coupin to contributors 2023-03-17 11:22:57 +00:00
fs fs: add size to JSON logs when moving or copying an object #6849 2023-03-17 11:22:57 +00:00
fstest webdav: add support for chunked uploads — fix #3666 2023-03-17 11:09:08 +00:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib rest: add optional GetBody function for HTTP call 2023-03-17 11:09:08 +00:00
librclone config: add config/setpath for setting config path via rc/librclone 2022-12-15 12:41:30 +00:00
vfs vfs: make uploaded files retain modtime with non-modtime backends 2023-03-10 15:00:01 +00:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore chunker: fix md5all test for no-meta test remotes 2021-10-18 18:04:07 +03:00
.golangci.yml build: fix lint option max-issues-per-linter 2022-09-14 12:11:54 +01:00
CONTRIBUTING.md all: fix spelling across the project 2022-08-30 11:16:26 +02:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile docker: add missing fuse3 dependency - fixes #6844 2023-03-15 10:54:30 +00:00
go.mod build: update dependencies 2023-03-10 11:15:07 +00:00
go.sum build: update dependencies 2023-03-10 11:15:07 +00:00
MAINTAINERS.md storj: rename tardigrade backend to storj backend #5616 2022-02-11 11:04:15 +00:00
Makefile Add compiletest target to compile all the tests only 2022-12-15 12:38:09 +00:00
MANUAL.html Version v1.62.0 2023-03-14 12:42:23 +00:00
MANUAL.md Version v1.62.0 2023-03-14 12:42:23 +00:00
MANUAL.txt Version v1.62.0 2023-03-14 12:42:23 +00:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 Version v1.62.0 2023-03-14 12:42:23 +00:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md webdav: add "fastmail" provider for Fastmail Files 2023-03-16 14:20:29 +00:00
RELEASE.md build: update release docs to be more careful with the tag 2023-03-15 14:53:21 +00:00
VERSION Start v1.63.0-DEV development 2023-03-14 15:18:54 +00:00

README.md

rclone logo rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDAV/FTP/SFTP/DLNA

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of the MIT license (check the COPYING file included in this package).