Commit Graph

281 Commits

Author SHA1 Message Date
David Dworken
33bc582d8b
Run integration tests in parallel to speed up testing (#175)
* Remove a few direct DB insertions to prepare for parallel tests

* Revert "Remove a few direct DB insertions to prepare for parallel tests"

This reverts commit f8a3552ad8.

* Add rudimentary experiment of splitting tests into two chunks to make them faster

* Add missing tag

* Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks

* Lay out the framework for checking goldens being used across all test runs

* Fix missing brace

* Revert "Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks"

This reverts commit 06cc3eedbc.

* Add initial work towards checking that all goldens are used

* Delete incorrect and unreferenced matrix

* Upgrade actions/upload-artifact to see if that makes the download in the next job work

* Alternatively, try downloading the artifact by name

* Update golden checker to read all the golden artifacts

* Swap to using glob to enumerate all golden files, rather than hardcoding them

* Remove debugging commands

* Remove goldens that are actually used

* Remove another golden that is actually used

* Add more comprehensive support for test sharding

* Fix references to test shards and increase shard count

* Shard the fuzz test

* Add debug prints

* Mark additional tests for sharding

* Fix logic error that broke test sharding

* Remove debug print

* Fix incorrect logic with skipping the fuzz test

* Move sharding functions to testutils and add some comments

* Upgrade all setup-go actions to enable caching of deps

* Remove goldens that don't exist

* Remove new line

* Reduce delay

* Correct stage name

* Remove incorrect skip code from the first version of sharding

* Remove unused import

* Reduce number of test shards to match GitHub's limit of 5 concurrent macos jobs

* Use cask for installing homebrew to speed up github actions

* More cleanup for unused goldens
2024-08-11 12:29:36 -07:00
David Dworken
1c963bed8a
Update go action to enable caching of dependencies 2024-08-11 12:29:36 -07:00
David Dworken
4744bb7317
Add another dep for arch 2024-08-11 12:29:36 -07:00
David Dworken
c8892fd331
Remove OpenSUSE since their package repos are currently returning 500 errors 2024-08-11 12:29:36 -07:00
David Dworken
46ad008b76
Update arch install command 2024-08-11 12:29:36 -07:00
David Dworken
64860f5028
More tweaks to install commands 2024-08-11 12:29:36 -07:00
David Dworken
078514439d
Update install commands for OpenSUSE and Arch 2024-08-11 12:29:36 -07:00
David Dworken
fee074b14c
Drop sudo for OpenSUSE 2024-08-11 12:29:36 -07:00
David Dworken
902fb45f6f
Remove sudo since the arch container runs as root 2024-08-11 12:29:36 -07:00
David Dworken
c517bf00e5
Update distro-smoke-test.yml 2024-08-11 12:29:36 -07:00
David Dworken
eea467a973
Add smoke tests for arch 2024-08-11 12:29:36 -07:00
David Dworken
f8e425b985
Add two more distros for smoke testing 2024-08-11 12:29:36 -07:00
David Dworken
f7e6c962be
Install killall command 2024-08-11 12:29:36 -07:00
David Dworken
2b86d9dabf
Add cgo deps 2024-08-11 12:29:36 -07:00
David Dworken
b4fb00ab96
Dependencies for smoke testing 2024-08-11 12:29:36 -07:00
David Dworken
e177b823dc
Skip setting the hostname for smoke tests since we don't need it 2024-08-11 12:29:36 -07:00
David Dworken
0649d0c9d2
More tweaks for smoke testing 2024-08-11 12:29:36 -07:00
David Dworken
a5249cec3f
Fix quotes on container names 2024-08-11 12:29:36 -07:00
David Dworken
b9813ddcd4
Add basic smoke test to provide test coverage for other distros (#174) 2024-08-11 12:29:36 -07:00
David Dworken
a6333ea995
Skip DD integration for m1 mac since it seems to fail for mysterious beta-related reasons 2024-08-11 12:29:36 -07:00
David Dworken
212c24c30c
Add tests running on macos-14 with m1 (#169)
* Add tests running on macos-14 with m1

* Run macos setup steps on macos-14 with m1
2024-02-04 10:55:11 -08:00
David Dworken
d8eb079e5f
Add .zip file extension for go tests artifact 2023-12-28 19:32:09 -08:00
David Dworken
aa4afcfa29
Add OS to testlog output to separate macos and linux test logs 2023-12-21 18:27:46 -08:00
David Dworken
2b327f965a
Update to latest version of gotestsum from main rather than from my fork, now that my patch has been merged 2023-12-20 19:57:02 -08:00
David Dworken
81081073a3
Add test log as an exported file from github actions 2023-12-20 15:02:16 -08:00
David Dworken
0a81799609
Remove PR trigger for SLSA releaser, since it purposefully can't run on non-master branches 2023-12-09 15:53:05 -08:00
David Dworken
f88e1d5b3b
Add dollar sign to fix github actions templating for outputs 2023-12-03 16:58:13 -08:00
David Dworken
bdaf0f8a65
Make TUI always take exactly the full width of the terminal through more precise calculations of the overhead used for the table (#136)
* Make TUI always take exactly the full width of the terminal through more precise calculations of the overhead used for the table

* Update TUI goldens for more accurate TUI sizing

* More golden updates for wider table sizing

* Include failed test goldens as artifacts for easier test fixing on github actions
2023-12-03 13:15:38 -08:00
David Dworken
5f694da421
Enable SLSA release tests for pull requests to detect issues like 3005ad8fe9 before they're merged 2023-11-25 08:24:16 -08:00
David Dworken
1a450c0817 Add basic sanity test to confirm that our interactions with the OpenAI API are correct 2023-11-12 02:57:23 -08:00
David Dworken
5cebea00af
Run SLSA validation with the production release of hishtory too 2023-11-10 18:10:46 -08:00
David Dworken
42a7b80579
Update slsa releaser to run with write permissions so it can release the hishtory-release-validation-completed file 2023-11-08 19:51:49 -08:00
David Dworken
5ab1cb61a3
Update validation to release an artifact to certify that validation passed, this will then be used by the backend server to only publish releases that passed validation 2023-11-08 19:03:30 -08:00
David Dworken
c802537cb7
Shorten delay and remove tmate 2023-11-08 18:58:34 -08:00
David Dworken
f7b662e7f4
Update go version in pre-commit.yml to match the version used for hishtory 2023-11-08 18:57:42 -08:00
David Dworken
a93002f045
Attempt to swap back to using the download-artifact action, but with a sleep to see if that helps it find the artifact 2023-11-07 23:11:52 -08:00
David Dworken
cdd58d0191
Add tmate debugging for macos signing 2023-11-07 23:03:40 -08:00
David Dworken
465f7812ef
Update slsa-releaser.yml 2023-11-06 22:38:45 -08:00
David Dworken
4e699ff349
Update slsa-releaser.yml 2023-11-06 22:38:07 -08:00
David Dworken
90c0b787d9
Increase delay to account for GitHub artifacts being slow to publish 2023-11-06 22:05:59 -08:00
David Dworken
606ed6ccb0
Download the artifact from this specific run to ensure we aren't getting outdated hishtory binaries 2023-11-06 21:47:14 -08:00
David Dworken
eaccc7b638
Skip installing dedicated package for sha1sum since coreutils includes it 2023-11-06 21:25:52 -08:00
David Dworken
8567b4cbdf
Run sha256sum in macos signer too for debuging purposes 2023-11-06 21:17:09 -08:00
David Dworken
72be3ee0c7
Update slsa-releaser.yml 2023-11-05 20:08:54 -08:00
David Dworken
a10913f188
Update slsa-releaser.yml to run tmate even if tests pass 2023-11-05 18:38:40 -08:00
David Dworken
222340a97c
Add tmate for debugging darwin attestation failures 2023-11-05 18:25:27 -08:00
David Dworken
19ee1816be Revert "Add SLSA attestation validation with latest released hishtory binary too" because the released binary doesn't support the validate-binary subcommand yet
This reverts commit 259f6b7858.
2023-11-05 18:05:20 -08:00
David Dworken
259f6b7858
Add SLSA attestation validation with latest released hishtory binary too 2023-11-05 17:20:53 -08:00
David Dworken
1264388ea9
Swap post-release validation to happen in a dedicated python script 2023-11-05 12:57:58 -08:00
David Dworken
9834c6f492
Add validation of macos signatures 2023-11-05 12:42:00 -08:00