rclone/backend
Ivan Andreev 59dba1de88 chunker: implementation + required fstest patch
Note: chunker implements many irrelevant methods (UserInfo, Disconnect etc),
but they are required by TestIntegration/FsCheckWrap and cannot be removed.

Dropped API methods: MergeDirs DirCacheFlush PublicLink UserInfo Disconnect OpenWriterAt

Meta formats:
- renamed old simplejson format to wdmrcompat.
- new simplejson format supports hash sums and verification of chunk size/count.

Change list:
- split-chunking overlay for mailru
- add to all
- fix linter errors
- fix integration tests
- support chunks without meta object
- fix package paths
- propagate context
- fix formatting
- implement new required wrapper interfaces
- also test large file uploads
- simplify options
- user friendly name pattern
- set default chunk size 2G
- fix building with golang 1.9
- fix ci/cd on a separate branch
- fix updated object name (SyncUTFNorm failed)
- fix panic in Box overlay
- workaround: Box rename failed if name taken
- enhance comments in unit test
- fix formatting
- embed wrapped remote rather than inherit
- require wrapped remote to support move (or copy)
- implement 3 (keep fstest)
- drop irrelevant file system interfaces
- factor out Object.mainChunk
- refactor TestLargeUpload as InternalTest
- add unit test for chunk name formats
- new improved simplejson meta format
- tricky case in test FsIsFile (fix+ignore)
- remove debugging print
- hide temporary objects from listings
- fix bugs in chunking reader:
  - return EOF immediately when all data is sent
  - handle case when wrapped remote puts by hash (bug detected by TestRcat)
- chunked file hashing (feature)
- server-side copy across configs (feature)
- robust cleanup of temporary chunks in Put
- linear download strategy (no read-ahead, feature)
- fix unexpected EOF in the box multipart uploader
- throw error if destination ignores data
2019-09-24 12:45:12 +01:00
..
alias build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
all chunker: implementation + required fstest patch 2019-09-24 12:45:12 +01:00
amazonclouddrive build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
azureblob azureblob: add missing type assertions for GetTier/SetTier 2019-09-14 09:18:55 +01:00
b2 rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
box box: add options to get access token via JWT auth 2019-09-20 17:15:16 +01:00
cache fs: add optional features UserInfo and Disconnect 2019-08-12 13:49:23 +01:00
chunker chunker: implementation + required fstest patch 2019-09-24 12:45:12 +01:00
crypt build: apply gofmt from go1.13 to change case of number literals 2019-09-05 13:59:06 +01:00
drive drive: add context to SDK calls #3257 2019-09-09 23:27:07 +01:00
dropbox azureblob/b2/dropbox/gcs/koofr/qingstor/s3: fix 0 length files 2019-08-06 15:18:08 +01:00
fichier rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
ftp build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
googlecloudstorage gcs: add context to SDK calls #3257 2019-09-09 23:27:07 +01:00
googlephotos rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
http http: fix race introduced in 7982aaf151 2019-09-14 08:48:13 +01:00
hubic Add context to all http.NewRequest #3257 2019-09-09 23:27:07 +01:00
jottacloud rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
koofr azureblob/b2/dropbox/gcs/koofr/qingstor/s3: fix 0 length files 2019-08-06 15:18:08 +01:00
local backend/local: fadvise run syscall on a dedicated go routine 2019-08-14 21:01:39 +01:00
mailru mailru: skip extra http request if data fits in hash 2019-09-17 10:04:51 +01:00
mega build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
onedrive rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
opendrive rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
pcloud rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
premiumizeme rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00
putio Add context to all http.NewRequest #3257 2019-09-09 23:27:07 +01:00
qingstor s3,b2,googlecloudstorage,swift,qingstor,azureblob: fixes after code review #3421 2019-08-22 23:06:59 +01:00
s3 s3: fix signature v2_auth headers 2019-09-21 14:38:51 +01:00
sftp sftp: fix --sftp-ask-password trying to contact the ssh agent 2019-09-16 11:16:27 +01:00
swift s3,b2,googlecloudstorage,swift,qingstor,azureblob: fixes after code review #3421 2019-08-22 23:06:59 +01:00
union docs: make the config walkthroughs consistent for each backend 2019-08-26 10:47:17 +01:00
webdav Add context to all http.NewRequest #3257 2019-09-09 23:27:07 +01:00
yandex rest: add context propagation to rest library #3257 2019-09-09 23:27:07 +01:00