Nick Craig-Wood
ac7e1dbf62
test_all: add the vfs tests to the integration tests
...
Fix failing tests for some remotes
2019-03-17 14:56:17 +00:00
Nick Craig-Wood
7267d19ad8
fstest: Use walk.ListR for listing
2019-03-16 17:41:12 +00:00
Nick Craig-Wood
efd720b533
walk: Implement walk.ListR which will use ListR if at all possible
...
It otherwise has the nearly the same interface as walk.Walk which it
will fall back to if it can't use ListR.
Using walk.ListR will speed up file system operations by default and
use much less memory and start immediately compared to if --fast-list
had been supplied.
2019-03-16 17:41:12 +00:00
jaKa
118a8b949e
koofr: implemented a backend for Koofr cloud storage service.
...
Implemented a Koofr REST API backend.
Added said backend to tests.
Added documentation for said backend.
2019-03-06 13:41:43 +00:00
Nick Craig-Wood
578d00666c
test_all: make -clean not give up on the first error
2019-02-07 11:29:52 +00:00
Nick Craig-Wood
a838add230
fstests: skip chunked uploading tests with -short
2019-02-03 12:28:44 +00:00
Cnly
cd46ce916b
fstests: ensure Fs.Put and Object.Update don't panic on unknown-sized uploads
2019-02-03 11:47:57 +00:00
Nick Craig-Wood
6b3a9bf26a
build: fix problems found by the deadcode linter
2019-02-02 11:45:07 +00:00
Nick Craig-Wood
1318c6aec8
s3: Add Alibaba OSS to integration tests and fix storage classes
2019-01-12 20:41:47 +00:00
Nick Craig-Wood
f29757de3b
test_all: make a way of ignoring integration test failures
...
Use this to ignore known failures
2019-01-12 20:18:05 +00:00
Nick Craig-Wood
f397c35935
fstest/test_all: add alternate s3 and swift providers to the integration tests
2019-01-12 18:33:31 +00:00
Nick Craig-Wood
2e6ef4f6ec
test_all: fix run with -remotes that aren't in the config file
2019-01-10 10:59:32 +00:00
Cnly
3220acc729
fstests: fix TestFsName fails when using remote:with/path
2018-12-29 09:34:04 +00:00
Nick Craig-Wood
26b5f55cba
Update after goimports change
2018-12-04 10:11:57 +00:00
Nick Craig-Wood
bb10a51b39
test_all: limit to go1.11 so the template used is supported
2018-11-23 17:17:19 +00:00
Nick Craig-Wood
df01f7a4eb
test_all: fix regexp for retrying nested tests
2018-11-23 17:17:19 +00:00
Nick Craig-Wood
31e2ce03c3
fstests: re-arrange backend integration tests so they can be retried
...
Before this change backend integration tests depended on each other,
so tests could not be retried.
After this change we nest tests to ensure that tests are provided with
the starting state they expect.
Tell the integration test runner that it can retry backend tests also.
This also includes bin/test_independence.go which runs each test
individually for a backend to prove that they are independent.
2018-11-22 20:12:12 +00:00
Nick Craig-Wood
141c133818
fstest: Wait for longer if neccessary in TestFsChangeNotify
2018-11-16 07:45:24 +00:00
Nick Craig-Wood
0f03e55cd1
fstests: ignore main directory creation in TestFsChangeNotify
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
9e6ba92a11
fstests: attempt to fix TestFsChangeNotify flakiness
...
This now uses testPut to upload the test files which will retry on
errors properly.
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
762561f88e
fstest: factor out retry logic from put code and make testPut return the object too
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
084fe38922
fstests: fixes the integration test errors running crypt over swift.
...
Skip tests involving errors creating or removing dirs on non root
bucket based fs
2018-11-15 18:39:28 +00:00
Nick Craig-Wood
f92beb4e14
fstest: Fix TestPurge causing errors with subsequent tests on azure
...
Before this change TestPurge would remove a container and subsequent
tests would fail because the container was still being deleted so
couldn't be created.
This was fixed by introducing an fstest.NewRunIndividual() test runner
for TestPurge which causes the test to be run on a new container.
2018-11-14 17:14:02 +00:00
Nick Craig-Wood
a379eec9d9
fstest/mockfs: create mock fs.Fs for testing
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
38a89d49ae
fstest/test_all: tidy HTML report
...
- link test number to online copy
- style links
- attempt to make a nicer colour scheme
2018-10-25 11:33:17 +01:00
Nick Craig-Wood
b0db08fd2b
fstest/test_all: constrain to go1.10 and above
2018-10-24 21:33:42 +01:00
Nick Craig-Wood
07addf74fd
fstest/test_all: upload a copy of the report to "current"
2018-10-24 12:21:07 +01:00
Nick Craig-Wood
52c7c738ca
fstest/test_all: limit concurrency and run tests in random order
2018-10-24 10:46:58 +01:00
Nick Craig-Wood
5c32b32011
fstest/test_all: fix directories that tests are run in
...
- Don't build a binary for backend tests
- Run tests in their relevant directories
2018-10-23 17:31:11 +01:00
Nick Craig-Wood
fbab1e55bb
fstest/test_all: adapt to nested test definitions
2018-10-23 16:56:35 +01:00
Nick Craig-Wood
1bfd07567e
fstest/test_all: add oneonly flag to only run one test per backend if required
2018-10-23 14:07:48 +01:00
Nick Craig-Wood
f97c4c8d9d
fstest/test_all: rework integration tests to improve output
...
- Make integration tests use a config file
- Output individual logs for each test
- Make HTML report and open browser
- Optionally email and upload results
2018-10-23 14:07:48 +01:00
Fabian Möller
15ce0ae57c
fstests: fix maximum tested size in TestFsPutChunked
...
Before this it was possible hat maxChunkSize was incorrectly set to 200.
2018-10-16 11:50:47 +02:00
Nick Craig-Wood
c3a8eb1c10
fstests: make findObject() sleep a bit longer to fix b2 largePut tests
2018-10-14 14:45:23 +01:00
Nick Craig-Wood
eb8130f48a
fstests: update TestPublicLink comment to show how to run solo
2018-10-14 14:17:05 +01:00
Nick Craig-Wood
6fea75afde
fstests: fix upload offsets not being set and redownload test files
...
In chunked upload tests:
- Add ability to set upload offset
- Read back the uploaded file to check it is OK
2018-10-13 22:49:12 +01:00
Fabian Möller
57273d364b
fstests: add TestFsPutChunked
2018-10-11 14:47:58 +01:00
Fabian Möller
c00ec0cbe4
fstests: add ChunkedUploadConfig
2018-10-11 14:47:58 +01:00
Fabian Möller
1eec59e091
fs: update ChangeNotifier interface
...
This introduces a channel to the ChangeNotify function, which can be
used to update the poll-interval and cleanly exit the polling function.
2018-09-25 14:01:13 +02:00
sandeepkru
b94d87ae2d
azureblob and fstests - Modify integration tests to include new
...
optional setting to test SetTier on only few supported tiers.
Remove unused optional interface ListTiers and backend and internal tests
2018-09-18 13:56:09 +01:00
sandeepkru
9594fd0a0c
fstests: Added integration tests on SetTier operation
2018-09-12 21:09:08 +01:00
Nick Craig-Wood
e05ec2b77e
fstests: Allow object name and fs check to be skipped
2018-09-07 15:14:08 +01:00
Felix Brucker
9e3ea3c6ac
union: Implement union backend which reads from multiple backends
2018-09-07 15:14:08 +01:00
albertony
3fccce625c
jottacloud: add --fast-list support - fixes #2532
2018-09-07 12:49:39 +01:00
Nick Craig-Wood
32ab4e9ac6
pcloud: delete half uploaded files on upload error
...
Sometimes pcloud will leave a half uploaded file when the transfer
actually failed. This patch deletes the file if it exists.
This problem was spotted by the integration tests.
2018-09-01 10:01:02 +01:00
Nick Craig-Wood
58339a5cb6
fstests: In TestFsPutError reliably provoke test failure
...
This change to go1.11 causes the TestFsPutError test to fail
https://go-review.googlesource.com/c/go/+/114316
This is because it now passes the half written file to the backend
whereas it didn't previously because of the buffering.
In this commit the size of the data written was increased to 5k from
50 bytes to provoke the test failure under go1.10 also.
2018-08-16 15:52:15 +01:00
Sebastian Bünger
10ed455777
New backend: Jottacloud
2018-08-10 11:14:34 +01:00
Nick Craig-Wood
f7c0b2407d
drive: add docs for --fast-list and add to integration tests
2018-08-06 21:38:50 +01:00
Oleg Kovalov
06c9f76cd2
all: fix go-critic linter suggestions
2018-08-06 21:14:03 +01:00
Stefan
4009fb67c8
fs: calculate ModifyWindow each time on the fly instead of relying on global state - see #2319 , #2328
2018-06-03 20:45:34 +02:00