Nick Craig-Wood
16f797a7d7
filter: add --ignore-case flag - fixes #502
...
The --ignore-case flag causes the filtering of file names to be case
insensitive. The flag name comes from GNU tar.
2018-11-12 14:29:37 +00:00
Nick Craig-Wood
4ad08794c9
fserrors: add "server closed idle connection" to retriable errors
...
This seems to be related to this go issue: https://github.com/golang/go/issues/19943
See: https://forum.rclone.org/t/copy-from-dropbox-to-google-drive-yields-failed-to-copy-failed-to-open-source-object-server-closed-idle-connection-error/7460
2018-11-08 11:12:25 +00:00
Nick Craig-Wood
c6786eeb2d
move: don't create directories with --dry-run - fixes #2676
2018-11-06 13:34:15 +00:00
Nick Craig-Wood
57b85b8155
rc: fix job tests on Windows
2018-11-06 13:03:48 +00:00
Nick Craig-Wood
e6dd121f52
config: add rc operations for config
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
e600217666
config: create config directory on save if it is missing
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
bc17ca7ed9
rc: implement core/obscure
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
1916410316
rc: add core/version and put definitions next to implementations
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
dddfbec92a
cmd/version: factor version number parsing routines into fs/version
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
75a88de55c
rc/rcserver: with --rc-files if auth set, pass on to URL opened
...
If `--rc-user` or `--rc-pass` is set then the URL that is opened with
`--rc-files` will have the authorization in the URL in the
`http://user:pass@localhost/ ` style.
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
2466f4d152
sync: add rc commands for sync/copy/move
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
39283c8a35
operations: implement operations remote control commands
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
46c2f55545
copyurl: factor code into operations and write test
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
fc2afcbcbd
lsjson: factor internals of lsjson command into operations
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
fa0a9653d2
rc: methods marked as AuthRequired need auth unless --rc-no-auth
...
Methods which can read or mutate external storage will require
authorisation - enforce this. This can be overidden by `--rc-no-auth`.
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
75e8ea383c
rc: implement rc.PutCachedFs for prefilling the remote cache
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
8c8b58a7de
rc: expire remote cache and fix tests under race detector
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
b961e07c57
rc: ensure rclone fails to start up if the --rc port is in use already
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
89550e7121
rcserver: serve directories as well as files
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
b972dcb0ae
rc: implement options/blocks,get,set and register options
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
0bfa9811f7
rc: factor server code into rcserver and implement serving objects
...
If a GET or HEAD request is receivied with a URL parameter of fs then
it will be served from that remote.
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
75252e4a89
rc: add --rc-files flag to serve files on the rc http server
...
This enables building a browser based UI for rclone
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
2089405e1b
fs/rc: add more infrastructure to help writing rc functions
...
- Fs cache for rc commands
- Helper functions for parsing the input
- Reshape command for manipulating JSON blobs
- Background Job starting, control, query and expiry
2018-11-02 17:32:20 +00:00
ssaqua
3d81b75f44
dedupe: check for existing filename before renaming a dupe file
2018-11-02 16:51:52 +00:00
Nick Craig-Wood
948a5d25c2
operations: Fix Purge and Rmdirs when dir is not empty
...
Before this change, Purge on the fallback path would try to delete
directories starting from the root rather than the dir passed in.
Rmdirs would also attempt to delete the root.
2018-10-27 11:51:17 +01:00
Nick Craig-Wood
543e37f662
Require go1.8 for compilation
2018-10-25 17:06:33 +01:00
Nick Craig-Wood
c5ac96e9e7
Make --files-from only read the objects specified and don't scan directories
...
Before this change using --files-from would scan all the directories
that the files could possibly be in causing rclone to do more work
that was necessary.
After this change, rclone constructs an in memory tree using the
--fast-list mechanism but from all of the files in the --files-from
list and without scanning any directories.
Any objects that are not found in the --files-from list are ignored
silently.
This mechanism is used for sync/copy/move (march) and all of the
listing commands ls/lsf/md5sum/etc (walk).
2018-10-20 18:13:31 +01:00
Nick Craig-Wood
67703a73de
Start v1.44-DEV development
2018-10-15 12:33:27 +01:00
Nick Craig-Wood
f96ce5674b
Version v1.44
2018-10-15 11:03:08 +01:00
Nick Craig-Wood
ade252f13b
build: fixup code formatting after goimports change
2018-10-13 22:47:12 +01:00
Fabian Möller
57273d364b
fstests: add TestFsPutChunked
2018-10-11 14:47:58 +01:00
Fabian Möller
1a40bceb1d
backend: unify NewFs path handling for wrapping remotes
...
Use the same function to join the root paths for the wrapping remotes
alias, cache and crypt.
The new function fspath.JoinRootPath is equivalent to path.Join, but if
the first non empty element starts with "//", this is preserved to allow
Windows network path to be used in these remotes.
2018-10-10 17:50:27 +01:00
Nick Craig-Wood
6709084e2f
config: Show URL of backend help page when starting config
2018-10-06 11:47:46 +01:00
Nick Craig-Wood
6b1f915ebc
fs: Implement RegInfo.FileName to return the on disk filename for a backend
...
Use it in make_backend_docs.py
2018-10-06 11:47:46 +01:00
Nick Craig-Wood
1557287c64
fs: Make Option.GetValue() public #2541
2018-10-06 11:47:45 +01:00
Nick Craig-Wood
e7e467fb3a
cmd: factor FlagName into fs.Option #2541
2018-10-06 11:47:45 +01:00
Nick Craig-Wood
59e14c25df
vfs: enable rename for nearly all remotes using server side Move or Copy
...
Before this change remotes without server side Move (eg swift, s3,
gcs) would not be able to rename files.
After it means nearly all remotes will be able to rename files on
rclone mount with the notable exceptions of b2 and yandex.
This changes checks to see if the remote can do Move or Copy then
calls `operations.Move` to do the actual move. This will do a server
side Move or Copy but won't download and re-upload the file.
It also checks to see if the destination exists first which avoids
conflicts or duplicates.
Fixes #1965
Fixes #2569
2018-09-29 14:56:20 +01:00
Fabian Möller
1eec59e091
fs: update ChangeNotifier interface
...
This introduces a channel to the ChangeNotify function, which can be
used to update the poll-interval and cleanly exit the polling function.
2018-09-25 14:01:13 +02:00
ssaqua
ae63e4b4f0
list: change debug logs for excluded items
2018-09-24 17:08:35 +01:00
frenos
382a6863b5
rc: add support for OPTIONS and basic CORS - #2575
2018-09-24 17:04:47 +01:00
sandeepkru
e0c5f7ff1b
fs - Remove unreferenced ListTierer optional interface
2018-09-18 13:56:09 +01:00
Joanna Marek
e022ffce0f
accounting: change too long names cutting mechanism - fixes #2490
2018-09-18 10:27:23 +01:00
sandeepkru
7accd30da8
cmd and fs: Added new command settier which performs storage tier changes on
...
supported remotes
2018-09-12 21:09:08 +01:00
sandeepkru
5716a58413
fs: Added new optional interfaces SetTierer, GetTierer and ListTierer, these are to
...
perform object tier changes on supported remotes
2018-09-12 21:09:08 +01:00
Cédric Connes
1b95ca2852
stats: handle FatalError and NoRetryError when reported to stats
2018-09-07 14:44:50 +01:00
albertony
09d7bd2d40
config: don't create default config dir when user supplies --config
...
Avoid creating empty default configuration directory when user supplies path to config file.
Fixes #2514 .
2018-09-03 15:30:53 +01:00
dcpu
f4aaec9ce5
log: Add --log-format flag - fixes #2424
2018-09-02 18:11:09 +01:00
Nick Craig-Wood
543d75723b
Start v1.43-DEV development
2018-09-01 18:37:48 +01:00
Nick Craig-Wood
20c55a6829
Version v1.43
2018-09-01 12:58:00 +01:00
Nick Craig-Wood
7d74686698
fs/accounting: increase maximum burst size of token bucket
...
This stops occasional errors when using --bwlimit which look like this
Token bucket error: rate: Wait(n=2255475) exceeds limiter's burst 2097152
2018-08-30 17:24:08 +01:00
