extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-12-22 23:22:08 +01:00
Code Issues Packages Projects Releases Wiki Activity
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
6,249 Commits 182 Branches 114 Tags 334 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
c85fbebce6
Go to file
Nick Craig-Wood c85fbebce6 s3: simplify PutObject code to use the Request.SetStreamingBody method 
In this commit

e5974ac4b0 s3: use PutObject from the aws SDK to upload single part objects

rclone was made to upload objects to s3 using PUT requests rather than
using signed uploads.

However this change missed the fact that there is a supported way to
do this in the SDK using the SetStreamingBody method on the Request.

This therefore reverts a lot of the previous commit to do with making
an unsigned connection and other complication and uses the SDK
facility.
2022-06-16 23:26:19 +01:00
.github build: add linux/arm/v6 to docker images - fixes #6192 2022-05-23 18:04:55 +01:00
backend s3: simplify PutObject code to use the Request.SetStreamingBody method 2022-06-16 23:26:19 +01:00
bin bin/make_backend_docs: allow generation of docs for just one backend 2022-06-16 15:45:32 +02:00
cmd serve ftp: check --passive-port arguments are correct 2022-06-16 22:13:50 +01:00
cmdtest test: use T.TempDir to create temporary test directory 2022-02-01 11:47:04 +00:00
contrib serve/docker: build docker plugin for multiple platforms #5668 2021-10-21 13:01:23 +03:00
docs Add Maciej Radzikowski to contributors 2022-06-16 23:26:19 +01:00
fs operations: speed up hash checking by aborting the other hash if first returns nothing 2022-06-16 22:13:50 +01:00
fstest Fix lint issues reported by staticcheck 2022-06-13 21:13:50 +02:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib Fix lint issues reported by staticcheck 2022-06-13 21:13:50 +02:00
librclone build: fix go mod tidy removing golang.org/x/mobile dependency 2022-05-01 13:28:20 +01:00
vfs mount: run tests in a subprocess to fix deadlock - fixes #3259 2022-06-16 16:48:09 +01:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore chunker: fix md5all test for no-meta test remotes 2021-10-18 18:04:07 +03:00
.golangci.yml build: increase timeout for golangci-lint to 10 minutes 2021-10-15 15:58:52 +01:00
CONTRIBUTING.md Remove github.com/pkg/errors and replace with std library version 2021-11-07 11:53:30 +00:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile build: add an rclone user to the Docker image but don't use it by default 2021-02-11 17:45:44 +00:00
go.mod build: update dependencies 2022-06-08 18:29:42 +01:00
go.sum build: update dependencies 2022-06-08 18:29:42 +01:00
MAINTAINERS.md storj: rename tardigrade backend to storj backend #5616 2022-02-11 11:04:15 +00:00
Makefile Configurable version suffix independent of version number 2022-05-17 12:10:01 +01:00
MANUAL.html netstorage: fix unescaped HTML in documentation 2022-03-18 14:40:12 +00:00
MANUAL.md netstorage: fix unescaped HTML in documentation 2022-03-18 14:40:12 +00:00
MANUAL.txt netstorage: fix unescaped HTML in documentation 2022-03-18 14:40:12 +00:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 netstorage: fix unescaped HTML in documentation 2022-03-18 14:40:12 +00:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md backend: add Huawei OBS to s3 provider list 2022-06-14 09:21:01 +01:00
RELEASE.md build: more docs on upgrading dependencies 2021-11-10 10:34:56 +00:00
VERSION Start v1.59.0-DEV development 2022-03-18 14:04:22 +00:00

README.md

rclone logo rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).