extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-12-25 16:38:59 +01:00
Code Issues Packages Projects Releases Wiki Activity
ccfefedb47
rclone/fstest/test_all/config.yaml

316 lines
8.1 KiB
YAML
Raw Normal View History

fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
tests:
- path: backend
fstest/test_all: fix directories that tests are run in - Don't build a binary for backend tests - Run tests in their relevant directories
2018-10-23 18:31:11 +02:00
addbackend: true
nobinary: true
allow usage of -short in the testing framework
2019-08-29 07:10:10 +02:00
short: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- path: fs/operations
fastlist: true
- path: fs/sync
fastlist: true
test_all: add the vfs tests to the integration tests Fix failing tests for some remotes
2019-02-27 18:14:32 +01:00
- path: vfs
test_all: run restic integration tests against local backend
2019-05-01 12:46:42 +02:00
- path: cmd/serve/restic
localonly: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
backends:
# - backend: "amazonclouddrive"
# remote: "TestAmazonCloudDrive:"
# fastlist: false
test_all: run restic integration tests against local backend
2019-05-01 12:46:42 +02:00
- backend: "local"
remote: ""
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "b2"
remote: "TestB2:"
fastlist: true
test: add ListRetries config parameter to integration tests Occasionally the b2 tests fail because the integration tests don't retry hard enough with their new setting of -list-retries 3. Override this setting to 5 for the b2 tests only.
2020-10-25 17:15:41 +01:00
listretries: 5
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "crypt"
remote: "TestCryptDrive:"
fastlist: true
- backend: "crypt"
remote: "TestCryptSwift:"
fastlist: false
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 19:49:47 +02:00
## chunker
- backend: "chunker"
remote: "TestChunkerLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerNometaLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk3bLocal:"
fastlist: true
maxfile: 6k
- backend: "chunker"
remote: "TestChunkerChunk3bNometaLocal:"
fastlist: true
maxfile: 6k
mailru: re-enable fixed chunker tests This reverts commit 9d3d397f50fe94df0f723a571507e2ce72428ab6.
2020-09-17 21:44:03 +02:00
- backend: "chunker"
remote: "TestChunkerMailru:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk50bMailru:"
fastlist: true
maxfile: 10k
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 19:49:47 +02:00
- backend: "chunker"
remote: "TestChunkerChunk50bYandex:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bBox:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerS3:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk50bS3:"
fastlist: true
maxfile: 1k
chunker: finish meta-format before release changes: - chunker: remove GetTier and SetTier - remove wdmrcompat metaformat - remove fastopen strategy - make hash_type option non-advanced - adverise hash support when possible - add metadata field "ver", run strict checks - describe internal behavior in comments - improve documentation note: wdmrcompat used to write file name in the metadata, so maximum metadata size was 1K; removing it allows to cap size by 200 bytes now.
2019-09-25 01:18:30 +02:00
- backend: "chunker"
remote: "TestChunkerChunk50bMD5HashS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1HashS3:"
fastlist: true
maxfile: 1k
Merge pull request #4608 from ivandeex/pr-chunker-crypt chunker: fix upload over crypt (fixes #4570)
2020-09-18 16:58:44 +02:00
- backend: "chunker"
remote: "TestChunkerOverCrypt:"
fastlist: true
maxfile: 6k
chunker: finish meta-format before release changes: - chunker: remove GetTier and SetTier - remove wdmrcompat metaformat - remove fastopen strategy - make hash_type option non-advanced - adverise hash support when possible - add metadata field "ver", run strict checks - describe internal behavior in comments - improve documentation note: wdmrcompat used to write file name in the metadata, so maximum metadata size was 1K; removing it allows to cap size by 200 bytes now.
2019-09-25 01:18:30 +02:00
- backend: "chunker"
remote: "TestChunkerChunk50bMD5QuickS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1QuickS3:"
fastlist: true
maxfile: 1k
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 19:49:47 +02:00
## end chunker
compress: improve testing
2021-01-17 02:21:33 +01:00
## begin compress
compress: add integration tests
2020-11-23 19:00:42 +01:00
- backend: "compress"
remote: "TestCompress:"
fastlist: false
compress: improve testing
2021-01-17 02:21:33 +01:00
- backend: "compress"
remote: "TestCompressSwift:"
fastlist: false
- backend: "compress"
remote: "TestCompressDrive:"
fastlist: false
- backend: "compress"
remote: "TestCompressS3:"
fastlist: false
## end compress
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "drive"
remote: "TestDrive:"
fastlist: true
- backend: "dropbox"
remote: "TestDropbox:"
fastlist: false
filefabric: Implement the Enterprise File Fabric backend Missing features - M-Stream support - Oauth-like flow (soon being changed to oauth)
2020-08-11 16:09:00 +02:00
- backend: "filefabric"
remote: "TestFileFabric:"
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "googlecloudstorage"
remote: "TestGoogleCloudStorage:"
fastlist: true
googlephotos: Backend for accessing Google Photos #369
2019-06-17 18:50:58 +02:00
- backend: "googlephotos"
remote: "TestGooglePhotos:"
tests:
- backend
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "hubic"
remote: "TestHubic:"
fastlist: false
- backend: "jottacloud"
remote: "TestJottacloud:"
fastlist: true
The memory backend This is a bucket based remote
2018-05-03 17:31:06 +02:00
- backend: "memory"
remote: ":memory:"
fastlist: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "onedrive"
remote: "TestOneDrive:"
fastlist: false
- backend: "s3"
remote: "TestS3:"
fastlist: true
fstest/test_all: add alternate s3 and swift providers to the integration tests
2019-01-12 19:33:31 +01:00
- backend: "s3"
remote: "TestS3Minio:"
fastlist: true
test_all: add ignores for tests which will never pass - s3 backends which don't support SetTier - mega which makes a duplicate for TestDirRename
2019-09-15 14:16:15 +02:00
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
test_all: mark expected failures for minio, wasabi and FTP
2019-10-01 16:40:32 +02:00
- TestIntegration/FsMkdir/FsEncoding/control_chars
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/leading_VT
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/trailing_LF
- TestIntegration/FsMkdir/FsEncoding/trailing_VT
test: add TestS3MinioEdge to test leading edge minio too #3934
2020-02-13 11:55:05 +01:00
- backend: "s3"
remote: "TestS3MinioEdge:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
fstest/test_all: add alternate s3 and swift providers to the integration tests
2019-01-12 19:33:31 +01:00
- backend: "s3"
remote: "TestS3Wasabi:"
fastlist: true
test_all: mark expected failures for minio, wasabi and FTP
2019-10-01 16:40:32 +02:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/leading_CR
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/leading_HT
- TestIntegration/FsMkdir/FsEncoding/leading_VT
test_all: ignore TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0 on wasabi This has been reported to Wasabi and they've confirmed as a known issue that multipart uploads can't be 0 sized even though that is incompatible with AWS S3.
2020-01-13 10:47:11 +01:00
- TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0
test_all: remove Digital Ocean s3 integration tests due to excessive rate limiting This is what I wrote to Digital Ocean support on July 10, 2020 - alas it didn't result in the rate limits dropping, so reluctantly I'm going to remove DO from the integration tests since they never pass and have no hope of ever passing while this rate limit is in effect. ---- Somewhere towards the end of June 2020 or the start of July 2020 my integration tests between rclone ( https://rclone.org ) and Digital Ocean started failing. I tried moving the tests to different regions (currently they are using AMS1 because I'm in Europe) with no improvement. Rclone seems to be hitting this rate limit as documented here: https://www.digitalocean.com/docs/spaces/#limits - 2 COPYs per 5 minutes on any individual object in a Space Rclone creates small objects about 100 bytes in size and renames them a few times - this involves using the COPY call as S3 does not have a rename API. The tests do this more than twice per object so hit the 5 minute timeout I think. Rclone does exponential backoff and fails after 10 retries not having reached 5 minutes delay after 10 retries. Having a 5 minute lockout on an S3 compatible API is surprising! Rclone integration tests with about 30 other providers, none of which have a rate limit like this. I understand the need for a COPY rate limit as server side copying large files can be resource intensive. However a 5 minute lockout for copying 100 byte files seems excessive! Might I humbly suggest that you reduce or eliminate this rate limit for small files? ---- This was the reply Unfortunately it is not possible to raise this limit or remove it currently on our platform. I do see how this would interfere with type of applications that need to copy many small files and will be happy to take the feedback to our engineering team to see how we can improve the spaces system in the future
2020-08-20 13:43:43 +02:00
# Disabled due to excessive rate limiting at DO which cause the tests never to pass
# This hits the rate limit as documented here: https://www.digitalocean.com/docs/spaces/#limits
# 2 COPYs per 5 minutes on any individual object in a Space
# - backend: "s3"
# remote: "TestS3DigitalOcean:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
# - TestIntegration/FsMkdir/FsPutFiles/SetTier
test: remove TestS3Ceph: and TestSwiftCeph: from integration tests Unfortunately we don't have access to this server any more
2020-10-25 09:48:23 +01:00
# - backend: "s3"
# remote: "TestS3Ceph:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
# - TestIntegration/FsMkdir/FsPutFiles/SetTier
s3: Add Alibaba OSS to integration tests and fix storage classes
2019-01-12 21:41:47 +01:00
- backend: "s3"
remote: "TestS3Alibaba:"
fastlist: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "sftp"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
remote: "TestSFTPOpenssh:"
fastlist: false
- backend: "sftp"
remote: "TestSFTPRclone:"
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
fastlist: false
sugarsync: new backend - fixes #622
2019-10-24 13:35:50 +02:00
- backend: "sugarsync"
remote: "TestSugarSync:Test"
fastlist: false
ignore:
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
- backend: "swift"
remote: "TestSwiftAIO:"
fastlist: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "swift"
remote: "TestSwift:"
fastlist: true
test: remove TestS3Ceph: and TestSwiftCeph: from integration tests Unfortunately we don't have access to this server any more
2020-10-25 09:48:23 +01:00
# - backend: "swift"
# remote: "TestSwiftCeph:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "yandex"
remote: "TestYandex:"
fastlist: false
- backend: "ftp"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
remote: "TestFTPProftpd:"
test_all: mark expected failures for minio, wasabi and FTP
2019-10-01 16:40:32 +02:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
fastlist: false
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
# - backend: "ftp"
# remote: "TestFTPVsftpd:"
# ignore:
# - TestIntegration/FsMkdir/FsEncoding/punctuation
# fastlist: false
- backend: "ftp"
remote: "TestFTPPureftpd:"
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
fastlist: false
- backend: "ftp"
remote: "TestFTPRclone:"
ignore:
- "TestMultithreadCopy/{size:131071_streams:2}"
- "TestMultithreadCopy/{size:131072_streams:2}"
- "TestMultithreadCopy/{size:131073_streams:2}"
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "box"
remote: "TestBox:"
fastlist: false
fichier: 1fichier support - fixes #2908 This was started by Fionera, finished off by Laura with fixes and more docs from Nick. Co-authored-by: Fionera <fionera@fionera.de> Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2019-06-26 20:39:01 +02:00
- backend: "fichier"
remote: "TestFichier:"
fastlist: false
test_all: only run the backend tests for 1fichier Running all the tests for 1fichier takes too long due to the directory reading rate limiter. The backend tests do complete in a reasonable time (21 mins).
2020-09-01 17:13:47 +02:00
tests:
- backend
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "qingstor"
remote: "TestQingStor:"
fastlist: false
fstest/test_all: add oneonly flag to only run one test per backend if required
2018-10-23 12:44:56 +02:00
oneonly: true
test_all: optionally run Cleanup before cleaning a remote Add this to the QingStor remote to stop it running out of buckets
2020-03-31 16:56:58 +02:00
cleanup: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "azureblob"
remote: "TestAzureBlob:"
fastlist: true
- backend: "pcloud"
remote: "TestPcloud:"
fastlist: false
- backend: "webdav"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
remote: "TestWebdavNextcloud:"
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
fastlist: false
- backend: "webdav"
remote: "TestWebdavOwncloud:"
test_all: ignore some encoding tests with nextcloud integration test
2019-10-02 12:33:53 +02:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 17:51:07 +02:00
- TestIntegration/FsMkdir/FsPutFiles/FsCopy
- TestCopyFileCopyDest
- TestServerSideCopy
- TestSyncCopyDest
fastlist: false
- backend: "webdav"
remote: "TestWebdavRclone:"
ignore:
- TestFileReadAtZeroLength
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
fastlist: false
- backend: "cache"
remote: "TestCache:"
fastlist: false
- backend: "mega"
remote: "TestMega:"
fastlist: false
test_all: make a way of ignoring integration test failures Use this to ignore known failures
2019-01-12 21:18:05 +01:00
ignore:
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
test_all: add ignores for tests which will never pass - s3 backends which don't support SetTier - mega which makes a duplicate for TestDirRename
2019-09-15 14:16:15 +02:00
- TestDirRename
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 15:48:29 +02:00
- backend: "opendrive"
remote: "TestOpenDrive:"
fastlist: false
- backend: "union"
remote: "TestUnion:"
fastlist: false
koofr: implemented a backend for Koofr cloud storage service. Implemented a Koofr REST API backend. Added said backend to tests. Added documentation for said backend.
2019-02-22 16:50:04 +01:00
- backend: "koofr"
remote: "TestKoofr:"
fastlist: false
premiumizeme: new backend for premiumize.me - Fixes #3063
2019-07-06 01:16:57 +02:00
- backend: "premiumizeme"
remote: "TestPremiumizeMe:"
fastlist: false
putio: add new backend
2019-08-06 14:47:52 +02:00
- backend: "putio"
remote: "TestPutio:"
New backend for Citrix Sharefile - Fixes #1543 Many thanks to Bob Droog for organizing a test account and extensive testing.
2019-08-27 23:50:07 +02:00
fastlist: false
- backend: "sharefile"
remote: "TestSharefile:"
putio: add new backend
2019-08-06 14:47:52 +02:00
fastlist: false
mailru: backend for mail.ru
2019-09-09 22:56:16 +02:00
- backend: "mailru"
remote: "TestMailru:"
subdir: false
fastlist: false
seafile: New backend for seafile server
2020-04-25 19:55:18 +02:00
- backend: "seafile"
remote: "TestSeafileV6:"
fastlist: false
ignore:
- TestIntegration/FsMkdir/FsPutFiles/FsDirMove
- backend: "seafile"
remote: "TestSeafile:"
fastlist: true
- backend: "seafile"
remote: "TestSeafileEncrypted:"
fastlist: true
Tardigrade Backend
2020-05-11 20:56:41 +02:00
- backend: "tardigrade"
remote: "TestTardigrade:"
fastlist: true
new backend: zoho workdrive - fixes #4533
2020-10-08 00:17:50 +02:00
- backend: "zoho"
remote: "TestZoho:"
fastlist: false
HDFS (Hadoop Distributed File System) implementation - #42 This includes an HDFS docker image to use with the integration tests. Co-authored-by: Ivan Andreev <ivandeex@gmail.com> Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2020-09-28 19:29:44 +02:00
- backend: "hdfs"
remote: "TestHdfs:"
fastlist: false
ignore:
- TestSyncUTFNorm
Reference in New Issue Copy Permalink