Nick Craig-Wood
9e6ba92a11
fstests: attempt to fix TestFsChangeNotify flakiness
...
This now uses testPut to upload the test files which will retry on
errors properly.
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
762561f88e
fstest: factor out retry logic from put code and make testPut return the object too
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
084fe38922
fstests: fixes the integration test errors running crypt over swift.
...
Skip tests involving errors creating or removing dirs on non root
bucket based fs
2018-11-15 18:39:28 +00:00
Fabian Möller
15ce0ae57c
fstests: fix maximum tested size in TestFsPutChunked
...
Before this it was possible hat maxChunkSize was incorrectly set to 200.
2018-10-16 11:50:47 +02:00
Nick Craig-Wood
c3a8eb1c10
fstests: make findObject() sleep a bit longer to fix b2 largePut tests
2018-10-14 14:45:23 +01:00
Nick Craig-Wood
eb8130f48a
fstests: update TestPublicLink comment to show how to run solo
2018-10-14 14:17:05 +01:00
Nick Craig-Wood
6fea75afde
fstests: fix upload offsets not being set and redownload test files
...
In chunked upload tests:
- Add ability to set upload offset
- Read back the uploaded file to check it is OK
2018-10-13 22:49:12 +01:00
Fabian Möller
57273d364b
fstests: add TestFsPutChunked
2018-10-11 14:47:58 +01:00
Fabian Möller
c00ec0cbe4
fstests: add ChunkedUploadConfig
2018-10-11 14:47:58 +01:00
Fabian Möller
1eec59e091
fs: update ChangeNotifier interface
...
This introduces a channel to the ChangeNotify function, which can be
used to update the poll-interval and cleanly exit the polling function.
2018-09-25 14:01:13 +02:00
sandeepkru
b94d87ae2d
azureblob and fstests - Modify integration tests to include new
...
optional setting to test SetTier on only few supported tiers.
Remove unused optional interface ListTiers and backend and internal tests
2018-09-18 13:56:09 +01:00
sandeepkru
9594fd0a0c
fstests: Added integration tests on SetTier operation
2018-09-12 21:09:08 +01:00
Nick Craig-Wood
e05ec2b77e
fstests: Allow object name and fs check to be skipped
2018-09-07 15:14:08 +01:00
Nick Craig-Wood
32ab4e9ac6
pcloud: delete half uploaded files on upload error
...
Sometimes pcloud will leave a half uploaded file when the transfer
actually failed. This patch deletes the file if it exists.
This problem was spotted by the integration tests.
2018-09-01 10:01:02 +01:00
Nick Craig-Wood
58339a5cb6
fstests: In TestFsPutError reliably provoke test failure
...
This change to go1.11 causes the TestFsPutError test to fail
https://go-review.googlesource.com/c/go/+/114316
This is because it now passes the half written file to the backend
whereas it didn't previously because of the buffering.
In this commit the size of the data written was increased to 5k from
50 bytes to provoke the test failure under go1.10 also.
2018-08-16 15:52:15 +01:00
Stefan
4009fb67c8
fs: calculate ModifyWindow each time on the fly instead of relying on global state - see #2319 , #2328
2018-06-03 20:45:34 +02:00
Nick Craig-Wood
ad02d1be3f
fstest: update comments on how to run individual tests
2018-05-11 14:04:36 +01:00
Nick Craig-Wood
f1ffe8e309
fstests: fix test crash if NewFs fails
2018-05-11 08:43:53 +01:00
Nick Craig-Wood
9fbc40c5b9
fstests: List missing dir must return ErrorDirNotFound for non bucket based remotes
...
List or ListR of an non existent directory must return
ErrorDirNotFound for non bucket based remotes. For bucket based
remotes it may return ErrorDirNotFound or it may return no error and
no entries.
2018-04-20 23:22:46 +01:00
Nick Craig-Wood
1ac6dacf0f
about: complete other providers and re-work internals
...
* Implement about for:
* local, crypt, cache, drive, swift, hubic, onedrive, pcloud, dropbox
* Implement `--json` and `---full` flag for `rclone about`
* change About interface to return a Usage structure
* Remove operations.About as it is too thin an interface
* Implement Integration test
Relates to #1138 and #1564
2018-04-17 21:53:27 +01:00
Nick Craig-Wood
3d5106e52b
drive: fix DirMove leaving a hardlinked directory behind #2245
...
This bug was introduced by the v3 API conversion in 07f20dd1fd
.
The problem was that dircache.FindPath doesn't work for the root directory.
This adds an internal error for dircache.FindPath being called with
the root directory. This makes a failing test, which the fix to the
drive backend fixes.
This also improves the DirCache integration test.
2018-04-15 10:12:21 +01:00
Nick Craig-Wood
29ce1c2747
fstest: fix CheckListingWithPrecision with non Windows safe chars
...
* Factor WinPath from fstest to fstests
* Use it to normalize the directory names while checking them
2018-04-15 10:12:20 +01:00
Antoine GIRARD
1f681e585b
fstests: fix typo
2018-04-13 13:23:08 +01:00
Nick Craig-Wood
0fa700b3cf
Make integration tests use go1.7+ nested tests #2154
...
* Removed generated code and code generator
* Updated docs on how to write integration tests
* Tidied up the actual integration tests
2018-04-08 15:04:14 +01:00
Nick Craig-Wood
be54fd8f70
Remove builds conditional on go1.7 since that is now guaranteed #2154
...
Old fallback code was deleted and the go1.7 style code inlined where
appropriate.
2018-04-07 11:42:55 +01:00
Nick Craig-Wood
32e02bd367
fstests: Fix TestObjectRemove failures
...
This was failing because TestPublicLink was causing the file to be
modified with Google drive.
2018-04-06 16:27:19 +01:00
Stefan
a8267d1628
link: allow creating public link to files and folders - closes #1562
2018-03-29 09:10:19 +02:00
Nick Craig-Wood
0bfbde8856
fstest: make ChangeNotify test clean up after itself and be more reliable
...
Previous to this fix old notifications could creep in and cause the
test to fail. It also left files around which upset the TestObjectRemove test.
Fixes #2177
2018-03-24 19:57:44 +00:00
Nick Craig-Wood
911a78ce6d
sftp: require go1.8+ after github.com/pkg/sftp update
2018-03-19 16:37:40 +00:00
Nick Craig-Wood
5981f9fab5
acd: disable integration tests
...
We no longer have any working keys for Amazon Cloud Drive so disable
the integration tests.
2018-03-14 22:44:46 +00:00
Remus Bunduc
70f07fd3ac
fs: add ChangeNotify and backend support for it ( #2094 )
...
* fs: rename DirChangeNotify to ChangeNotify
* cache: switch to ChangeNotify
* ChangeNotify: keep order of notifications
2018-03-08 22:03:34 +02:00
Fabian Möller
aeefa34f62
fstests: add TestInternal ( #2085 )
...
TestInternal allows to perform a custom test on the backend using the
optional InternalTester interface.
2018-02-25 10:58:06 +01:00
Nick Craig-Wood
9ffc3898b1
fstests: Allow RangeOption tests to run everywhere #1825
2018-02-19 18:00:39 +00:00
Nick Craig-Wood
fc8641809e
fstests: add name of remote to WARN message
2018-02-02 12:05:34 +00:00
Nick Craig-Wood
de35f1c165
Show WARN in integration tests if remote not configured
2018-02-02 09:50:58 +00:00
Nick Craig-Wood
f9806848fe
fstest: use the difficult file name for server side copy #2001
...
This should detect re-occurrence of #315
2018-01-23 09:37:33 +00:00
Nick Craig-Wood
c098e25552
fstest: Skip RangeOption test on Appveyor also
2018-01-22 11:10:29 +00:00
Nick Craig-Wood
ea69deaa4c
fstests: Skip RangeOption test in CI until all implemented
2018-01-21 18:09:16 +00:00
Nick Craig-Wood
8653944a6d
Make RangeOption manadatory for Open - #1825
...
Add an integration test to make sure all backends implement
RangeOption correctly.
2018-01-21 17:09:12 +00:00
Nick Craig-Wood
5ad226ab54
fs: Add dir option to fs.Purge #1891
...
Purge optional interface needs fixing too.
2018-01-19 11:45:50 +00:00
Nick Craig-Wood
4b0c5f79b5
qingstor: Only support on go1.7+
2018-01-16 17:05:26 +00:00
Nick Craig-Wood
1848e26183
dropbox: Only support on go1.7+
...
See https://github.com/dropbox/dropbox-sdk-go-unofficial/pull/40
2018-01-16 17:05:02 +00:00
Nick Craig-Wood
11da2a6c9b
Break the fs package up into smaller parts.
...
The purpose of this is to make it easier to maintain and eventually to
allow the rclone backends to be re-used in other projects without
having to use the rclone configuration system.
The new code layout is documented in CONTRIBUTING.
2018-01-15 17:51:14 +00:00
Nick Craig-Wood
b8b620f5c2
Move all backends into backend directory
2018-01-12 17:07:38 +00:00
remusb
b48b537325
cache: plex integration, refactor chunk storage and worker retries ( #1899 )
2017-12-09 23:54:26 +02:00
Remus Bunduc
016abf825e
cache: first version
2017-11-15 15:23:21 +00:00
Nick Craig-Wood
7f3dc9b5c4
Implement WebDAV remote #580
...
This has special knowledge of Owncloud and Nextcloud to enable more
functionality such as mod times.
2017-10-09 16:19:37 +01:00
Nick Craig-Wood
9e9297838f
Implement pcloud remote - #418
2017-10-01 11:37:35 +01:00
Nick Craig-Wood
87335de8a8
fs: fix filename normalization issues in the tests when running on OS X
2017-09-17 15:31:22 +01:00
Stefan Breunig
4e189fe6e7
fstests: only test uploadswith indeterminate size on remotes that support it
2017-08-22 07:19:43 +02:00