Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Use only free runners #1131

Merged
merged 3 commits into from
Nov 7, 2023

Conversation

julienduchesne
Copy link
Member

@julienduchesne julienduchesne commented Nov 7, 2023

Built on top of #1127

Rather than smashing a single Grafana instance with lots of parallel tests, make an effort to split up the load between multiple runners. This should help with flakiness. Also, with this approach, we can use the free GHA runners

Here's a quick split:

  • Basic tests (Basic resource functionality, CRUD)
  • Other tests (Advanced features of resources + bug fixes)
  • Long tests (Manually identified tests that take a long time to run, only a handful)

Copy link

github-actions bot commented Nov 7, 2023

In order to lower resource usage and have a faster runtime, PRs will not run Cloud tests automatically.
To do so, a Grafana Labs employee must trigger the cloud acceptance tests workflow manually.

@julienduchesne julienduchesne force-pushed the julienduchesne/use-only-free-runners branch 3 times, most recently from f256e50 to 2269a85 Compare November 7, 2023 03:58
@julienduchesne julienduchesne changed the base branch from master to julienduchesne/run-subpath-tests November 7, 2023 04:04
@julienduchesne julienduchesne changed the title use only free runners CI: Use only free runners Nov 7, 2023
@julienduchesne julienduchesne force-pushed the julienduchesne/use-only-free-runners branch from 2269a85 to ed9477d Compare November 7, 2023 04:10
@julienduchesne julienduchesne marked this pull request as ready for review November 7, 2023 04:18
@julienduchesne julienduchesne requested a review from a team as a code owner November 7, 2023 04:18
Base automatically changed from julienduchesne/run-subpath-tests to master November 7, 2023 13:55
Instead of running on big agents, split up the work into multiple pipelines:
- Basic tests
- Other tests
- Long tests

This allows fanning out the work to a swarm of agents. Also, it should lead to less failures due to less parallelism
@julienduchesne julienduchesne force-pushed the julienduchesne/use-only-free-runners branch from ed9477d to bd57951 Compare November 7, 2023 15:32
@julienduchesne julienduchesne merged commit a8b847f into master Nov 7, 2023
23 checks passed
@julienduchesne julienduchesne deleted the julienduchesne/use-only-free-runners branch November 7, 2023 15:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants