Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e test GHA workflow + unit test reporter #1278

Merged
merged 7 commits into from
Jan 14, 2022
Merged

e2e test GHA workflow + unit test reporter #1278

merged 7 commits into from
Jan 14, 2022

Conversation

megahirt
Copy link
Collaborator

@megahirt megahirt commented Jan 13, 2022

Description

This PR adds a separate workflow for e2e test runs. The e2e tests could have been included in the existing unit-test workflow, however I chose to split it out into a separate workflow so that it can be reported as a separate line item in the PR checks.

This PR also makes the following minor changes:

  • adds a unit test reporter to display test results in a PR comment
  • adds the protractor-fail-fast capability for e2e tests (stop test runner after first failure).

This is advantageous for E2E tests since they take a long time to run, and often the first failing test is where the problem lies.
This should save time when running flaky E2E tests. We should be able to re-run the e2e tests quicker with fail-fast turned on.

Fixes #1276
Fixes #1269

Type of Change

Only keep lines below that describe this change, then delete the rest.

  • Engineering change

Testing on your branch

  • E2E tests running on PR branches
  • Unit tests reporting results to the PR as a comment

Checklist

  • I have performed a self-review of my own code
  • I have reviewed the title/description of this PR which will be used as the squashed PR commit message
  • I have commented my code, particularly in hard-to-understand areas

qa.languageforge.org testing

Reviewers: add/replace your name below and check the box to sign-off/attest the feature works as expected on qa.languageforge.org

  • Reviewer1 (YYYY-MM-DD HH:MM)
  • Reviewer2 (YYYY-MM-DD HH:MM)

@github-actions
Copy link

github-actions bot commented Jan 13, 2022

Unit Test Results

    1 files      1 suites   9s ⏱️
373 tests 373 ✔️ 0 💤 0

Results for commit d5ebbd6.

♻️ This comment has been updated with latest results.

@megahirt megahirt force-pushed the feature/e2eGHA branch 2 times, most recently from 9d16f1c to 65f8714 Compare January 13, 2022 16:36
This change publishes the unit test results to the PR as a comment
Run e2e tests in a separate workflow
This causes the E2E test runner to stop running on the first failed test.  This is advantageous for E2E tests since they take a long time to run, and often the first failing test is where the problem lies.

This should save time when running flaky E2E tests.  We should be able to re-run the tests quicker with fail-fast turned on.
add a separate make target unit-tests-ci
will trigger on push to develop for the continuous deployment workflow
@megahirt megahirt changed the title e2e test GHA workflow e2e test GHA workflow + unit test reporter Jan 14, 2022
@megahirt megahirt merged commit 63fba00 into develop Jan 14, 2022
@megahirt megahirt deleted the feature/e2eGHA branch January 14, 2022 02:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: fail E2E tests on first failure (saving CI time) GHA unit test reporter
2 participants