19 Commits

Author	SHA1	Message	Date
database64128	a7a8372976	🧪 fstest: fix time tests on Windows and add convenience methods to check local and remote fs with precision ... Previously only the fs being checked on gets passed to GetModifyWindow(). However, in most tests, the test files are generated in the local fs and transferred to the remote fs. So the local fs time precision has to be taken into account. This meant that on Windows the time tests failed because the local fs has a time precision of 100ns. Checking remote items uploaded from local fs on Windows also requires a modify window of 100ns.	2021-11-09 11:43:36 +00:00
albertony	fbc7f2e61b	lib/file: improve error message when attempting to create dir on nonexistent drive on windows ... This replaces built-in os.MkdirAll with a patched version that stops the recursion when reaching the volume part of the path. The original version would continue recursion, and for extended length paths end up with \\? as the top-level directory, and the error message would then be something like: mkdir \\?: The filename, directory name, or volume label syntax is incorrect.	2021-10-01 23:18:39 +02:00
Nick Craig-Wood	e3fe31f7cb	fs: add context.Context to fs.GetModifyWindow #3257 #4685	2020-11-09 18:05:54 +00:00
Nick Craig-Wood	d846210978	fs: Add context to NewFs #3257 #4685 ... This adds a context.Context parameter to NewFs and related calls. This is necessary as part of reading config from the context - backends need to be able to read the global config.	2020-11-09 18:05:54 +00:00
Josh Soref	d0888edc0a	Spelling fixes ... Fix spelling of: above, already, anonymous, associated, authentication, bandwidth, because, between, blocks, calculate, candidates, cautious, changelog, cleaner, clipboard, command, completely, concurrently, considered, constructs, corrupt, current, daemon, dependencies, deprecated, directory, dispatcher, download, eligible, ellipsis, encrypter, endpoint, entrieslist, essentially, existing writers, existing, expires, filesystem, flushing, frequently, hierarchy, however, implementation, implements, inaccurate, individually, insensitive, longer, maximum, metadata, modified, multipart, namedirfirst, nextcloud, obscured, opened, optional, owncloud, pacific, passphrase, password, permanently, persimmon, positive, potato, protocol, quota, receiving, recommends, referring, requires, revisited, satisfied, satisfies, satisfy, semver, serialized, session, storage, strategies, stringlist, successful, supported, surprise, temporarily, temporary, transactions, unneeded, update, uploads, wrapped Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>	2020-10-14 15:21:31 +01:00
Nick Craig-Wood	66347aff2a	fstest: calculate hashes for uploaded test files to fix minio integration tests ... Before this change we didn't calculate any hashes for test files created in the Run framework. This means that files were uploaded to S3 without a `Content-MD5` header. This in turn caused minio to disengage `--compat` mode which in turn caused the `TestSyncAfterChangingModtimeOnlyWithNoUpdateModTime` test to fail in `fs/sync`. After this change we supply all hashes supported by the destination Fs on the upload object. This means that the `Content-MD5` is set and minio engages `--compat` mode to fix the problem. Using `--compat` on the command line also fixes the problem. This much better replicates how objects are actually uploaded with operations.Copy so should improve the integration tests.	2019-09-16 10:59:01 +01:00
Nick Craig-Wood	941dde6940	fstest: clear the fs cache between test runs ... The fs cache makes test runs no longer independent and this can cause a problem with some tests. Clearing the fs cache between tests runs fixes the problem. This was spotted by @cenkalti as part of merging #3469	2019-08-22 11:57:35 +01:00
Nick Craig-Wood	af3c47d282	fstest: remove -subdir flag as it no longer tests anything useful #3421	2019-08-17 09:54:19 +01:00
Nick Craig-Wood	57d5de6fba	build: fix up package paths after repo move ... git grep -l github.com/ncw/rclone | xargs -d'\n' perl -i~ -lpe 's|github.com/ncw/rclone|github.com/rclone/rclone|g' goimports -w `find . -name \*.go`	2019-07-28 18:47:38 +01:00
Aleksandar Jankovic	f78cd1e043	Add context propagation to rclone ... - Change rclone/fs interfaces to accept context.Context - Update interface implementations to use context.Context - Change top level usage to propagate context to lover level functions Context propagation is needed for stopping transfers and passing other request-scoped values.	2019-06-19 11:59:46 +01:00
Nick Craig-Wood	7267d19ad8	fstest: Use walk.ListR for listing	2019-03-16 17:41:12 +00:00
Nick Craig-Wood	f92beb4e14	fstest: Fix TestPurge causing errors with subsequent tests on azure ... Before this change TestPurge would remove a container and subsequent tests would fail because the container was still being deleted so couldn't be created. This was fixed by introducing an fstest.NewRunIndividual() test runner for TestPurge which causes the test to be run on a new container.	2018-11-14 17:14:02 +00:00
Stefan	4009fb67c8	fs: calculate ModifyWindow each time on the fly instead of relying on global state - see #2319, #2328	2018-06-03 20:45:34 +02:00
Nick Craig-Wood	4b5ff33125	fstest: retry cleaning the integration test directory if necessary	2018-04-11 20:51:13 +01:00
Nick Craig-Wood	d016438243	fstest: Fix CheckWithDuplicates after code reshuffle to not use operations	2018-01-25 12:03:39 +00:00
Nick Craig-Wood	11da2a6c9b	Break the fs package up into smaller parts. ... The purpose of this is to make it easier to maintain and eventually to allow the rclone backends to be re-used in other projects without having to use the rclone configuration system. The new code layout is documented in CONTRIBUTING.	2018-01-15 17:51:14 +00:00
Nick Craig-Wood	ebd7780188	fstest: don't error out if the target was not found at end of run	2017-12-04 15:58:29 +00:00
Nick Craig-Wood	014aa3d157	fstest: check no files or directories between runs	2017-11-03 12:59:58 +00:00
Nick Craig-Wood	cc7ed13b9b	fs: factor test running code into fstest/run.go	2017-11-03 12:59:58 +00:00