Erik Swanson
fa0a1e7261
s3: fix role_arn, credential_source, ...
...
When the env_auth option is enabled, the AWS SDK's session constructor
now loads configuration from ~/.aws/config and environment variables,
and credentials per the selected (or default) AWS_PROFILE's settings.
This is accomplished by **NOT** including any Credential provider in the
aws.Config passed to the session constructor: If the Config.Credentials
is non-nil, that will always be used and the user's configuration re
role_arn, credential_source, source_profile, etc... from the shared
config will be completely ignored.
(The conditional creation and configuration of the stscreds Credential
provider is complicated enough that it is not worth re-creating that
logic.)
2018-11-08 12:58:23 +00:00
Nick Craig-Wood
4ad08794c9
fserrors: add "server closed idle connection" to retriable errors
...
This seems to be related to this go issue: https://github.com/golang/go/issues/19943
See: https://forum.rclone.org/t/copy-from-dropbox-to-google-drive-yields-failed-to-copy-failed-to-open-source-object-server-closed-idle-connection-error/7460
2018-11-08 11:12:25 +00:00
Nick Craig-Wood
c0f600764b
Add Scott Edlund to contributors
2018-11-07 14:27:06 +00:00
Scott Edlund
f139e07380
enable softfloat on MIPS arch
...
MIPS does not have a floating point unit. Enable softfloat to build binaries run on devices that do not have MIPS_FPU enabled in their kernel.
2018-11-07 14:26:48 +00:00
Nick Craig-Wood
c6786eeb2d
move: don't create directories with --dry-run - fixes #2676
2018-11-06 13:34:15 +00:00
Nick Craig-Wood
57b85b8155
rc: fix job tests on Windows
2018-11-06 13:03:48 +00:00
Nick Craig-Wood
2b1194c57e
rc: update docs with new methods
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
e6dd121f52
config: add rc operations for config
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
e600217666
config: create config directory on save if it is missing
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
bc17ca7ed9
rc: implement core/obscure
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
1916410316
rc: add core/version and put definitions next to implementations
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
dddfbec92a
cmd/version: factor version number parsing routines into fs/version
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
75a88de55c
rc/rcserver: with --rc-files if auth set, pass on to URL opened
...
If `--rc-user` or `--rc-pass` is set then the URL that is opened with
`--rc-files` will have the authorization in the URL in the
`http://user:pass@localhost/ ` style.
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
2466f4d152
sync: add rc commands for sync/copy/move
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
39283c8a35
operations: implement operations remote control commands
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
46c2f55545
copyurl: factor code into operations and write test
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
fc2afcbcbd
lsjson: factor internals of lsjson command into operations
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
fa0a9653d2
rc: methods marked as AuthRequired need auth unless --rc-no-auth
...
Methods which can read or mutate external storage will require
authorisation - enforce this. This can be overidden by `--rc-no-auth`.
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
181267e20e
cmd/rc: add --user and --pass flags and interpret --rc-user, --rc-pass, --rc-addr
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
75e8ea383c
rc: implement rc.PutCachedFs for prefilling the remote cache
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
8c8b58a7de
rc: expire remote cache and fix tests under race detector
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
b961e07c57
rc: ensure rclone fails to start up if the --rc port is in use already
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
0b80d1481a
cache: make tests not start an rc but use the internal framework
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
89550e7121
rcserver: serve directories as well as files
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
370c218c63
cmd/http: factor directory serving routines into httplib/serve and write tests
2018-11-04 12:46:44 +00:00
Nick Craig-Wood
b972dcb0ae
rc: implement options/blocks,get,set and register options
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
0bfa9811f7
rc: factor server code into rcserver and implement serving objects
...
If a GET or HEAD request is receivied with a URL parameter of fs then
it will be served from that remote.
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
aa9b2c31f4
serve/restic: factor object serving into cmd/httplib/serve
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
cff75db6a4
rcd: implement new command just to serve the remote control API
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
75252e4a89
rc: add --rc-files flag to serve files on the rc http server
...
This enables building a browser based UI for rclone
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
2089405e1b
fs/rc: add more infrastructure to help writing rc functions
...
- Fs cache for rc commands
- Helper functions for parsing the input
- Reshape command for manipulating JSON blobs
- Background Job starting, control, query and expiry
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
a379eec9d9
fstest/mockfs: create mock fs.Fs for testing
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
45d5339fcb
cmd/rc: add --json flag for structured JSON input
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
bb5637d46a
serve http, webdav, restic: ensure rclone exits if the port is in use
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
1f05d5bf4a
delete: clarify that it only deletes files not directories
2018-11-02 17:07:45 +00:00
HerrH
ff87da9c3b
Added some more links for easier finding
...
Expanded the Installation & Docs section with links to the website and added a link to the full list of storage providers and features.
2018-11-02 16:56:20 +00:00
ssaqua
3d81b75f44
dedupe: check for existing filename before renaming a dupe file
2018-11-02 16:51:52 +00:00
Nick Craig-Wood
baba6d67e6
s3: set ACL for server side copies to that provided by the user - fixes #2691
...
Before this change the ACL for objects which were server side copied
was left at the default "private" settings. S3 doesn't copy the ACL
from the source when you copy an object, you have to set it afresh
which is what this does.
2018-11-02 16:22:31 +00:00
Nick Craig-Wood
04c0564fe2
Add Ralf Hemberger to contributors
2018-11-02 09:53:23 +00:00
Ralf Hemberger
91cfdb81f5
change spaces to tab
2018-11-02 09:50:34 +00:00
Ralf Hemberger
deae7bf33c
WebDav - Add RFC3339 date format - fixes #2712
2018-11-02 09:50:34 +00:00
Henning Surmeier
04a0da1f92
ncdu: remove option ('d' key)
...
delete files by pressing 'd' in the ncdu listing
GUI Improvements:
Boxes now have a border around them
Boxes can ask questions and allow the selection of options. The
selected option will be given to the UI.boxMenuHandler function.
Fixes #2571
2018-10-28 20:44:03 +00:00
Henning Surmeier
9486df0226
ncdu/scan: remove option for memory representation
...
Remove files/directories from the in memory structs of the cloud
directory. Size and Count will be recalculated and populated upwards
to the parent directories.
2018-10-28 20:44:03 +00:00
Nick Craig-Wood
948a5d25c2
operations: Fix Purge and Rmdirs when dir is not empty
...
Before this change, Purge on the fallback path would try to delete
directories starting from the root rather than the dir passed in.
Rmdirs would also attempt to delete the root.
2018-10-27 11:51:17 +01:00
Nick Craig-Wood
f7c31cd210
Add Florian Gamboeck to contributors
2018-10-27 00:28:11 +01:00
Florian Gamboeck
696e7b2833
backend/cache: Print correct info about Cache Writes
2018-10-27 00:27:47 +01:00
Anagh Kumar Baranwal
e76cf1217f
Added docs to check for key generation on Mega
...
Signed-off-by: Anagh Kumar Baranwal <anaghk.dos@gmail.com>
2018-10-25 22:49:21 +01:00
Nick Craig-Wood
543e37f662
Require go1.8 for compilation
2018-10-25 17:06:33 +01:00
Nick Craig-Wood
c514cb752d
vendor: update to latest versions of everything
2018-10-25 17:06:33 +01:00
Nick Craig-Wood
c0ca93ae6f
opendrive: fix retries of upload chunks - fixes #2646
...
Before this change, upload chunks were being emptied on retry. This
change introduces a RepeatableReader to fix the problem.
2018-10-25 11:50:38 +01:00
