Commit Graph

296 Commits

Author SHA1 Message Date
3af25fca32 Revert "Add additional test for smoke tests to cover syncing"
This reverts commit 514d95ba4e.
2024-04-14 22:41:31 -07:00
f19e31978b Move extra delay to a separate job to avoid wasting GH action quota by sleeping in duplicated jobs 2024-04-14 18:31:28 -07:00
514d95ba4e Add additional test for smoke tests to cover syncing 2024-04-14 18:23:46 -07:00
c616dd7862 Continue-on-error for the DD setup since it will also fail if colima fails 2024-04-05 16:05:37 -07:00
cef2633675 Remove tmate session for debugging 2024-03-25 20:03:10 -07:00
e666881dc6 Set up tmate session to debug slsa releaser 2024-03-25 19:43:21 -07:00
35f9ad28a8 Add SLSA validation with current binary built by SLSA 2024-03-24 21:48:01 -07:00
25e982603a Disable validation with local build since it seems to fail for some reason 2024-03-24 21:45:28 -07:00
17f0c5720f Re-enable SLSA verification now that we've updated the SLSA version throughout the repo 2024-03-24 20:54:48 -07:00
e7c2cf1883 Fully disable validation to allow an emergency release due to SLSA breakage 2024-03-24 14:50:00 -07:00
6626567814 Disable validation so we can push out a working binary even though SLSA is broken 2024-03-24 14:41:04 -07:00
c8d1b2caff Upgrade SLSA releaser due to github.com/slsa-framework/slsa-github-generator/issues/3350 2024-03-24 10:26:55 -07:00
e91eeb1f04 Swap away from brew cask since it appears to be slower 2024-02-11 11:57:18 -08:00
b27fde71c9 Run integration tests in parallel to speed up testing (#175)
* Remove a few direct DB insertions to prepare for parallel tests

* Revert "Remove a few direct DB insertions to prepare for parallel tests"

This reverts commit f8a3552ad8.

* Add rudimentary experiment of splitting tests into two chunks to make them faster

* Add missing tag

* Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks

* Lay out the framework for checking goldens being used across all test runs

* Fix missing brace

* Revert "Remove code that enforces that all goldens are used, since it is incompatible with how tests are currently split into chunks"

This reverts commit 06cc3eedbc.

* Add initial work towards checking that all goldens are used

* Delete incorrect and unreferenced matrix

* Upgrade actions/upload-artifact to see if that makes the download in the next job work

* Alternatively, try downloading the artifact by name

* Update golden checker to read all the golden artifacts

* Swap to using glob to enumerate all golden files, rather than hardcoding them

* Remove debugging commands

* Remove goldens that are actually used

* Remove another golden that is actually used

* Add more comprehensive support for test sharding

* Fix references to test shards and increase shard count

* Shard the fuzz test

* Add debug prints

* Mark additional tests for sharding

* Fix logic error that broke test sharding

* Remove debug print

* Fix incorrect logic with skipping the fuzz test

* Move sharding functions to testutils and add some comments

* Upgrade all setup-go actions to enable caching of deps

* Remove goldens that don't exist

* Remove new line

* Reduce delay

* Correct stage name

* Remove incorrect skip code from the first version of sharding

* Remove unused import

* Reduce number of test shards to match GitHub's limit of 5 concurrent macos jobs

* Use cask for installing homebrew to speed up github actions

* More cleanup for unused goldens
2024-02-11 11:54:27 -08:00
b95f049c27 Update go action to enable caching of dependencies 2024-02-10 21:59:27 -08:00
a2633e0c5a Add another dep for arch 2024-02-09 19:14:13 -08:00
62700605d7 Remove OpenSUSE since their package repos are currently returning 500 errors 2024-02-09 19:06:19 -08:00
4d0faabff0 Update arch install command 2024-02-09 19:05:58 -08:00
df24ba1b93 More tweaks to install commands 2024-02-09 19:04:02 -08:00
ae789879c6 Update install commands for OpenSUSE and Arch 2024-02-09 19:02:12 -08:00
826cfd237a Drop sudo for OpenSUSE 2024-02-09 18:58:45 -08:00
d9d13e8329 Remove sudo since the arch container runs as root 2024-02-09 18:57:24 -08:00
4be3372fff Update distro-smoke-test.yml 2024-02-09 18:56:49 -08:00
1f7c3ab24e Add smoke tests for arch 2024-02-09 18:55:24 -08:00
266d5ff01b Add two more distros for smoke testing 2024-02-09 18:52:38 -08:00
8e716c9404 Install killall command 2024-02-09 18:43:42 -08:00
b4860d3192 Add cgo deps 2024-02-09 18:37:35 -08:00
950db890ea Dependencies for smoke testing 2024-02-09 18:31:37 -08:00
a99c8c24d3 Skip setting the hostname for smoke tests since we don't need it 2024-02-09 18:29:03 -08:00
7c55c95f1d More tweaks for smoke testing 2024-02-09 18:27:26 -08:00
9892255657 Fix quotes on container names 2024-02-09 18:25:41 -08:00
4ca37c3851 Add basic smoke test to provide test coverage for other distros (#174) 2024-02-09 18:19:17 -08:00
a38f7e0bfe Skip DD integration for m1 mac since it seems to fail for mysterious beta-related reasons 2024-02-04 22:29:04 -08:00
212c24c30c Add tests running on macos-14 with m1 (#169)
* Add tests running on macos-14 with m1

* Run macos setup steps on macos-14 with m1
2024-02-04 10:55:11 -08:00
d8eb079e5f Add .zip file extension for go tests artifact 2023-12-28 19:32:09 -08:00
aa4afcfa29 Add OS to testlog output to separate macos and linux test logs 2023-12-21 18:27:46 -08:00
2b327f965a Update to latest version of gotestsum from main rather than from my fork, now that my patch has been merged 2023-12-20 19:57:02 -08:00
81081073a3 Add test log as an exported file from github actions 2023-12-20 15:02:16 -08:00
0a81799609 Remove PR trigger for SLSA releaser, since it purposefully can't run on non-master branches 2023-12-09 15:53:05 -08:00
f88e1d5b3b Add dollar sign to fix github actions templating for outputs 2023-12-03 16:58:13 -08:00
bdaf0f8a65 Make TUI always take exactly the full width of the terminal through more precise calculations of the overhead used for the table (#136)
* Make TUI always take exactly the full width of the terminal through more precise calculations of the overhead used for the table

* Update TUI goldens for more accurate TUI sizing

* More golden updates for wider table sizing

* Include failed test goldens as artifacts for easier test fixing on github actions
2023-12-03 13:15:38 -08:00
5f694da421 Enable SLSA release tests for pull requests to detect issues like 3005ad8fe9 before they're merged 2023-11-25 08:24:16 -08:00
1a450c0817 Add basic sanity test to confirm that our interactions with the OpenAI API are correct 2023-11-12 02:57:23 -08:00
5cebea00af Run SLSA validation with the production release of hishtory too 2023-11-10 18:10:46 -08:00
42a7b80579 Update slsa releaser to run with write permissions so it can release the hishtory-release-validation-completed file 2023-11-08 19:51:49 -08:00
5ab1cb61a3 Update validation to release an artifact to certify that validation passed, this will then be used by the backend server to only publish releases that passed validation 2023-11-08 19:03:30 -08:00
c802537cb7 Shorten delay and remove tmate 2023-11-08 18:58:34 -08:00
f7b662e7f4 Update go version in pre-commit.yml to match the version used for hishtory 2023-11-08 18:57:42 -08:00
a93002f045 Attempt to swap back to using the download-artifact action, but with a sleep to see if that helps it find the artifact 2023-11-07 23:11:52 -08:00
cdd58d0191 Add tmate debugging for macos signing 2023-11-07 23:03:40 -08:00