Commit Graph

72 Commits

Author SHA1 Message Date
David Dworken
b27fde71c9
Run integration tests in parallel to speed up testing (#175)
* Remove a few direct DB insertions to prepare for parallel tests

* Revert "Remove a few direct DB insertions to prepare for parallel tests"

This reverts commit f8a3552ad8.

* Add rudimentary experiment of splitting tests into two chunks to make them faster

* Add missing tag

* Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks

* Lay out the framework for checking goldens being used across all test runs

* Fix missing brace

* Revert "Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks"

This reverts commit 06cc3eedbc.

* Add initial work towards checking that all goldens are used

* Delete incorrect and unreferenced matrix

* Upgrade actions/upload-artifact to see if that makes the download in the next job work

* Alternatively, try downloading the artifact by name

* Update golden checker to read all the golden artifacts

* Swap to using glob to enumerate all golden files, rather than hardcoding them

* Remove debugging commands

* Remove goldens that are actually used

* Remove another golden that is actually used

* Add more comprehensive support for test sharding

* Fix references to test shards and increase shard count

* Shard the fuzz test

* Add debug prints

* Mark additional tests for sharding

* Fix logic error that broke test sharding

* Remove debug print

* Fix incorrect logic with skipping the fuzz test

* Move sharding functions to testutils and add some comments

* Upgrade all setup-go actions to enable caching of deps

* Remove goldens that don't exist

* Remove new line

* Reduce delay

* Correct stage name

* Remove incorrect skip code from the first version of sharding

* Remove unused import

* Reduce number of test shards to match GitHub's limit of 5 concurrent macos jobs

* Use cask for installing homebrew to speed up github actions

* More cleanup for unused goldens
2024-02-11 11:54:27 -08:00
David Dworken
95743a6a07
Add 'make local-install' for #165 2024-02-03 18:11:20 -08:00
David Dworken
c10abc645b
Add 'make help' for #165 2024-02-03 18:09:53 -08:00
David Dworken
17b158d4b3
Swap to checking golden usage post-tests so that it covers all golden usages, and not just per-package 2023-12-22 08:04:10 -08:00
David Dworken
88f1c0168e
Move test goldens to testdata/ directory to be more idiomatic, and add assertion that they're all actively being used by the tests (#154)
* Move golden files to testdata dir

* Add assertion that requires that all goldens are used

* Add map init so the map is non-nil

* Add print to confirm that tests finished running

* Remove colon so that this doesn't match against gotestsum looking for the substring "panic:", which can happen depending on how stdout is buffer

* Revert "Remove colon so that this doesn't match against gotestsum looking for the substring "panic:", which can happen depending on how stdout is buffer"

This reverts commit b44e53a17b.
2023-12-21 17:06:46 -08:00
David Dworken
9cbd6d8598
Increase test timeout since MacOS tests sometimes take more than 60 minutes 2023-12-20 20:02:06 -08:00
David Dworken
bf01cf534f
Change make ftest to not retry or export tests, since ftest is used for local testing 2023-11-22 20:48:02 -08:00
David Dworken
595ddec235
Add integration to report flaky tests to datadog 2023-10-21 16:28:28 -07:00
David Dworken
1d29bb25e9
Increase timeout since the control-r test is extremely slow 2023-10-21 16:21:52 -07:00
David Dworken
8805e57c6f
Change order of gotestsum arguments 2023-10-21 15:52:32 -07:00
David Dworken
df9c6e8786
Swap to using gotestsum for retrying flaky tests 2023-10-21 15:41:32 -07:00
David Dworken
55a45fe8bd
Increase test timeout since macos tests sometimes just barely go over 45 minutes for the whole test suite--and yes... that is very slow :( 2023-09-22 20:04:40 -07:00
Sergio Moura
a3e6d5a940 docker improvements:
* use alpine for small docker images
* use docker compose to wait for the database to be ready
* use a single Dockerfile with parameters to determine the correct GOARCH
* update makefile to account for the new GOARCH parameter on the Dockerfile
* remove native-arch-Dockerfile
2023-09-07 11:06:32 -04:00
David Dworken
adbd87a81e
Clear out ~/.hishtory/ between test retries to ensure state is cleared for a fresh run 2023-09-04 21:16:22 -07:00
David Dworken
22abfbc733
Add overall test retries for all tests to make github action tests even more reliable 2023-09-04 19:30:38 -07:00
David Dworken
25eae144d8
Revert all tmpfs related commits, since running in a tmpfs doesn't seem to meaningfully improve test reliability 2023-09-04 18:03:46 -07:00
David Dworken
6950215427
Increase test timeout to account for copies being slower than renames 2023-09-02 19:47:59 -07:00
David Dworken
069705ef41
Move setting of TZ variable into Makefile so it is always set even if doing local development in a different timezone 2023-09-02 18:28:37 -07:00
David Dworken
9fdd676ed5
Increase test timeout since github actions tests are slow on macos 2023-08-30 11:13:18 -07:00
David Dworken
f9da1bf8b6
Rewrite makefile for deploy-static to work from my arm macbook. The docker compose rm is needed because hishtory-static has a volume that was getting reused 2023-02-28 21:22:35 -08:00
David Dworken
f502cbee1d
Fix memory leak caused by not closing resp.Body (#62) and also fix the server to work when the DD integration is disabled 2022-12-23 17:17:44 -08:00
David Dworken
63a9f67771
Rm the hishtory binary before docker build to avoid wasting time transferring it 2022-12-17 21:26:18 -08:00
David Dworken
1e7f5d9119
Add clean for the test cache for make ftest target 2022-12-16 21:18:37 -08:00
David Dworken
53a417296e
Improve backup and restore env function + fix makefile with quotes + remove the zdotdir created file 2022-11-13 16:53:37 -08:00
David Dworken
072a0d0a18
Add ftest command for filter testing 2022-11-13 06:34:41 -08:00
David Dworken
5cd403a22b
Add HISHTORY_SKIP_INIT_IMPORT to makefile to see if that fixes github action tests 2022-11-12 07:42:27 -08:00
David Dworken
6f53fdd41e
Better handling for control-c with control-r search in the shell + update bubbletea 2022-11-11 16:42:07 -08:00
David Dworken
e520b23858
Improve history importing to not double import HISTFILE + improve tests 2022-11-11 18:12:23 -05:00
David Dworken
21a7a48afb
Migrate to logrus so we can auto-rotate the log file 2022-11-09 16:14:44 -08:00
David Dworken
fadc8ad70e
go test -v to make it so I can monitor github actions 2022-11-05 23:57:16 -07:00
David Dworken
e46221f893
Revert all the windows+freebsd commits since they seem to be hopelessly broken 2022-11-04 23:14:34 -07:00
David Dworken
02b093c56d
Increase test timeout for windows tests 2022-11-04 23:09:48 -07:00
David Dworken
18e7580b71
Add ssh command to finish the deploy-static make command 2022-11-03 18:17:43 -07:00
David Dworken
c4a66bb428 Remove -v from make test for shorter output 2022-10-23 15:07:28 -07:00
David Dworken
f3758dc376 Add fix for the weird zsh bug + disable tmate 2022-10-23 00:36:23 -07:00
David Dworken
f2d5026282 Add docker compose integration to the makefile 2022-10-18 14:45:17 -07:00
David Dworken
ad809efef6 Migrate hishtory from k8s to docker compose 2022-10-18 11:53:35 -07:00
David Dworken
8e6a55237c Try running all tests in github actions with a longer timeout 2022-10-09 19:04:03 -07:00
David Dworken
e91e6ab237 Add longer timeout for running tests because github actions on macos are slow 2022-09-27 22:02:55 -07:00
David Dworken
9895a5c677 Improve copy function error checking + delete make fuzz because of https://github.com/golang/go/issues/52569 2022-09-22 23:20:21 -07:00
David Dworken
4e4caef10f Add initial implementation of fuzz testing that fuzzes multiple devices and multiple users 2022-09-22 23:06:28 -07:00
David Dworken
55f0f97d29 Fix tests for importing so they pass on github actions 2022-09-17 21:56:39 -07:00
David Dworken
8d93d08f80 Update make release command for new release system 2022-06-04 20:35:01 -07:00
David Dworken
1da703e9c2 Working update code for macos 2022-05-26 23:45:08 -07:00
David Dworken
93e59f37ec Fix downloading the xattr file 2022-04-25 22:21:17 -07:00
David Dworken
d214395dfd Tag the commit containing the xattrs 2022-04-25 20:59:12 -07:00
David Dworken
10ee085d4c Remove unnecessary set -m calls, speed up the local make acttest command, embed ReleaseVersion into the test server to fix the test failures on macos, and update install to be resistant to bashrc and zshrc not existing 2022-04-19 21:05:54 -07:00
David Dworken
15bec30315 Add fake event with head_commit to restore the ability to run the github action test locally 2022-04-17 21:47:49 -07:00
David Dworken
be6ccbbcc6 Add untested update operation that works with the new releases 2022-04-17 12:30:46 -07:00
David Dworken
e98783d30f Add server-side code to handle updates for non-linux 2022-04-17 12:02:56 -07:00