This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
End to End Tests #5989
Annotations
10 errors, 5 warnings, and 1 notice
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
1) [Legacy Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
1) [Legacy Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto-retry1/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto-retry1/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
1) [Legacy Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto-retry2/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Legacy-Crypto-retry2/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/register.spec.ts#L56
2) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/terms-prompt-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto/terms-prompt-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto/terms-prompt-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
54 |
55 | await expect(page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy")).toBeVisible();
> 56 | await expect(page).toMatchScreenshot("terms-prompt.png", screenshotOptions);
| ^
57 | await checkA11y();
58 |
59 | const termsPolicy = page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy");
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:56:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/register.spec.ts#L56
2) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/terms-prompt-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto-retry1/terms-prompt-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto-retry1/terms-prompt-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
54 |
55 | await expect(page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy")).toBeVisible();
> 56 | await expect(page).toMatchScreenshot("terms-prompt.png", screenshotOptions);
| ^
57 | await checkA11y();
58 |
59 | const termsPolicy = page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy");
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:56:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/register.spec.ts#L56
2) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/terms-prompt-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto-retry2/terms-prompt-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Legacy-Crypto-retry2/terms-prompt-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
54 |
55 | await expect(page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy")).toBeVisible();
> 56 | await expect(page).toMatchScreenshot("terms-prompt.png", screenshotOptions);
| ^
57 | await checkA11y();
58 |
59 | const termsPolicy = page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy");
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:56:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
3) [Rust Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
3) [Rust Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto-retry1/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto-retry1/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L74
3) [Rust Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/email.spec.ts/registration-check-your-email-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto-retry2/registration-check-your-email-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-email-Email-Registration-registers-an-account-and-lands-on-the-use-case-selection-screen-Rust-Crypto-retry2/registration-check-your-email-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
72 |
73 | await expect(page.getByText("Check your email to continue")).toBeVisible();
> 74 | await expect(page).toMatchScreenshot("registration_check_your_email.png", screenshotOptions);
| ^
75 | await checkA11y();
76 |
77 | await expect(page.getByText("An error was encountered when sending the email")).not.toBeVisible();
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:74:28
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/register.spec.ts#L56
4) [Rust Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
Error: Screenshot comparison failed:
11 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/terms-prompt-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Rust-Crypto/terms-prompt-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registration-registers-an-account-and-lands-on-the-home-screen-Rust-Crypto/terms-prompt-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 11 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 11 pixels (ratio 0.01 of all image pixels) are different.
54 |
55 | await expect(page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy")).toBeVisible();
> 56 | await expect(page).toMatchScreenshot("terms-prompt.png", screenshotOptions);
| ^
57 | await checkA11y();
58 |
59 | const termsPolicy = page.locator(".mx_InteractiveAuthEntryComponents_termsPolicy");
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:56:28
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.6m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/editing-messages.spec.ts#L1
[Rust Crypto] › read-receipts/editing-messages.spec.ts took 3.4m
|
Merge into HTML Report:
[Legacy Crypto] › read-receipts/editing-messages.spec.ts#L1
[Legacy Crypto] › read-receipts/editing-messages.spec.ts took 3.1m
|
Merge into HTML Report:
[Legacy Crypto] › read-receipts/new-messages.spec.ts#L1
[Legacy Crypto] › read-receipts/new-messages.spec.ts took 3.1m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 2.7m
|
Merge into HTML Report
4 failed
[Legacy Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
[Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
[Rust Crypto] › register/email.spec.ts:57:9 › Email Registration › registers an account and lands on the use case selection screen
[Rust Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen
155 skipped
331 passed (9.5m)
|
The logs for this run have expired and are no longer available.
Loading