Hi!
How can I run performance tests in Github actions in a reproducible way?
How do I ensure it’s run on comparable hardware?
My workflow: hop/.github/workflows/k6-load-test.yml at main · kaihendry/hop · GitHub
Thank you in advance!
Hi @kaihendry,
I don’t think there is a good answer to this.
If you are running something relatively light (on k6) it likely wouldn’t matter as k6 would not use most of hte available resources.
Otherwise I will argue this is a question for github on how to get reliable performance off their runners.
If you run on your own runners that will also likely help, but I would argue you will need to monitor those as well.
Hope this helps you!
Just to add some more context, I was wondering if there was a service offering to run a performance test in a known controlled VM, but I don’t see any good “commercially offered” solutions for this.
@kaihendry grafana offers (among other stuff) running k6 tests in a controlled matter
and the github action you have linked does have a direct integration with it.