Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual test run on macOS (arm64) for 1.40.x - Release #23498

Closed
71 tasks done
kjozwiak opened this issue Jun 16, 2022 · 1 comment
Closed
71 tasks done

Manual test run on macOS (arm64) for 1.40.x - Release #23498

kjozwiak opened this issue Jun 16, 2022 · 1 comment

Comments

@kjozwiak
Copy link
Member

kjozwiak commented Jun 16, 2022

Installer

  • Ensured that the following executables work as expected
    • Brave-Browser-arm64.dmg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-arm64.pkg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-x64.dmg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-x64.pkg
      • Check executable size, should be ~290mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-universal.dmg
      • Check executable size, should be ~500mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
    • Brave-Browser-universal.pkg
      • Check executable size, should be ~500mb
      • Check signature: If OS Run spctl --assess --verbose for the installed version and make sure it returns accepted.
  • Visited brave://version and ensure the following:
    • arm64 is being displayed when installing via arm64 and universal binaries on M1 mac
    • x86_64 translated is being displayed when installing via x64 binary on M1 mac using Rosetta

Widevine

  • Using universal build:
    • Verify Widevine Notification is shown when you visit Netflix for the first time
    • Test that you can stream on Netflix on a fresh profile after installing Widevine
  • Using arm64 build:
    • Verify Widevine Notification is shown when you visit Netflix for the first time
    • Test that you can stream on Netflix on a fresh profile after installing Widevine

Components

  • Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components

Upgrade - Brave-Browser-arm64.dmg

  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Installed extensions are retained and work correctly
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained
    • Rewards
      • BAT balance is retained
      • Auto-contribute list is retained
      • Both Tips and Monthly Contributions are retained
      • Panel transactions list is retained
      • Changes to rewards settings are retained
      • Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
    • Ads
      • Both Estimated pending rewards & Ad notifications received this month are retained
      • Changes to ads settings are retained
      • Ensure that ads are not being enabled when upgrading to a new version if they were disabled
      • Ensure that ads are not disabled when upgrading to a new version if they were enabled

Upgrade - Brave-Browser-x64.dmg

  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained

Upgrade - Brave-Browser-universal.dmg

Pre-requisite: Make sure that the previous version is installed using the universal build

  • Make sure that after upgrade, the universal build is upgraded to the appropriate architecture specific version
  • Confirm that the .app file size has decreased as a result of the upgrade
  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained
@kjozwiak kjozwiak modified the milestones: 1.39.x - Release #6, 1.40.x - Release Jun 16, 2022
@kjozwiak kjozwiak changed the title Manual test run on macOS (arm64) for 1.39.x - Release #6 Manual test run on macOS (arm64) for 1.40.x - Release Jun 16, 2022
@stephendonner stephendonner self-assigned this Jun 18, 2022
@stephendonner
Copy link

Brave-Browser-arm64.dmg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (arm64)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)`

Brave-Browser-arm64.pkg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (arm64)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)

Brave-Browser-x64.dmg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (x86_64 translated)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)

Brave-Browser-x64.pkg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (x86_64 translated)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)

Brave-Browser-universal.dmg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (arm64)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)

Brave-Browser-universal.pkg:

Brave 1.40.103 Chromium: 103.0.5060.53 (Official Build) (arm64)
Revision a1711811edd74ff1cf2150f36ffa3b0dae40b17f-refs/branch-heads/5060@{#853}
OS macOS Version 11.6.6 (Build 20G624)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants