Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual test run on OS X for 0.68.x - Release Hotfix 1 #5805

Closed
77 of 78 tasks
kjozwiak opened this issue Aug 26, 2019 · 2 comments
Closed
77 of 78 tasks

Manual test run on OS X for 0.68.x - Release Hotfix 1 #5805

kjozwiak opened this issue Aug 26, 2019 · 2 comments

Comments

@kjozwiak
Copy link
Member

kjozwiak commented Aug 26, 2019

Per release specialty tests

Installer

  • Check signature: If OS Run spctl --assess --verbose /Applications/Brave-Browser-Beta.app/ and make sure it returns accepted. If Windows right click on the brave_installer-x64.exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window

Data(Upgrade from previous release)

  • Make sure that data from the last version appears in the new version OK
  • With data from the last version, verify that
    • bookmarks on the bookmark toolbar and bookmark folders can be opened
    • cookies are preserved
    • installed extensions are retained and work correctly
    • opened tabs can be reloaded
    • stored passwords are preserved
    • unpinned tabs can be pinned

Extensions/Plugins tests

  • Verify one item from Brave Update server is installable (Example: Ad-block DAT file on fresh extension)
  • Verify one item from Google Update server is installable (Example: Extensions from CWS)
  • Verify PDFJS, Torrent viewer extensions are installed automatically on fresh profile and cannot be disabled
  • Verify magnet links and .torrent files loads Torrent viewer page and able to download torrent

CWS

  • Verify installing ABP from CWS shows warning message NOT A RECOMMENDED BRAVE EXTENSION! but still allows to install the extension
  • Verify installing LastPass from CWS doesn't show any warning message

PDF

Widevine

  • Verify Widevine Notification is shown when you visit Netflix for the first time
  • Test that you can stream on Netflix on a fresh profile after installing Widevine

Bravery settings

Fingerprint Tests

Rewards

  • Verify wallet is auto created after enabling rewards
  • Verify account balance shows correct BAT and USD value
  • Verify you are able to restore a wallet
  • Verify wallet address matches the QR code that is generated under Add funds
  • Verify actions taken (claiming grant, tipping, auto-contribute) display in wallet panel
  • Verify adding funds via any of the currencies flows into wallet after specified amount of time
  • Verify adding funds to an existing wallet with amount, adjusts the BAT value appropriately
  • Verify monthly budget shows correct BAT and USD value
  • Verify you are able to exclude a publisher from the auto-contribute table by clicking on the x in auto-contribute table and popup list of sites
  • Verify you are able to exclude a publisher by using the toggle on the Rewards Panel
  • Verify when you click on the BR panel while on a site, the panel displays site specific information (site favicon, domain, attention %)
  • Verify when you click on Send a tip, the custom tip banner displays
  • Verify you are able to make one-time tip and they display in tips panel
  • Verify you are able to make recurring tip and they display in tips panel
  • Verify you can tip a verified publisher
  • Verify you can tip a verified YouTube creator
  • Verify tip panel shows a verified checkmark for a verified publisher/verified YouTube creator
  • Verify tip panel shows a message about unverified publisher
  • Verify BR panel shows message about an unverified publisher
  • Verify you are able to perform a contribution
  • Verify if you disable auto-contribute you are still able to tip regular sites and YouTube creators
  • Verify that disabling Rewards and enabling it again does not lose state
  • Verify that disabling auto-contribute and enabling it again does not lose state
  • Adjust min visit/time in settings. Visit some sites and YouTube channels to verify they are added to the table after the specified settings
  • Upgrade from older version
    • Verify the wallet balance is retained and wallet backup code isn't corrupted
    • Verify auto-contribute list is not lost after upgrade
    • Verify tips list is not lost after upgrade
    • Verify wallet panel transactions list is not lost after upgrade

Ads Upgrade Tests:

  • Install 0.62.51 and enable Rewards (Ads are not available on this version). Update on test channel to latest 0.68.x version. Verify Ads are off by default, should get a BAT logo notification to alert you that Ads are available.
  • Install 0.65.121 and enable Rewards. Ads are on by default. View an Ad. Update on test channel to latest 0.68.x version. Verify Ads are still on after update, Ads panel information was not lost after upgrade, no BAT logo notification.
  • Install 0.65.121 and enable Rewards. Disable Ads. Update on test channel to latest 0.68.x version. Verify Ads are still off after update, no BAT logo notification.
  • Install 0.66.101 and enable Rewards. Ads are on by default. View an ad. Update on test channel to latest 0.68.x version. Verify Ads are still on after update, Ads panel information was not lost after upgrade, no BAT logo notification.
  • install 0.66.101 and enable Rewards. Disable Ads. Update on test channel to latest 0.68.x version. Verify Ads are still off after update, no BAT logo notification.
  • Install 0.67.123 and enable Rewards. Ads are on by default. View an ad. Update on test channel to latest 0.68.x version. Verify Ads are still on after update, Ads panel information was not lost after upgrade, no BAT logo notification.
  • install 0.67.123 and enable Rewards. Disable Ads. Update on test channel to latest 0.68.x version. Verify Ads are still off after update, no BAT logo notification.

Tor Tabs

Session storage

  • Temporarily move away your browser profile and test that a new profile is created when browser is launched
    • macOS - ~/Library/Application\ Support/BraveSoftware/
    • Windows - %userprofile%\appdata\Local\BraveSoftware\
    • Linux(Ubuntu) - ~/.config/BraveSoftware/
  • Test that windows and tabs restore when closed, including active tab
  • Ensure that the tabs in the above session are being lazy loaded when the session is restored

Update tests

  • Verify visiting brave://settings/help triggers update check
  • Verify once update is downloaded, prompts to Relaunch to install update

Chromium upgrade tests

  • Verify brave://gpu on Brave and chrome://gpu on Chrome are similar for the same Chromium version on both browsers

Adblock

  • Verify referrer blocking works properly for TLD+1. Visit https://technology.slashdot.org/ and verify adblock works properly similar to https://slashdot.org/

Components

  • Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components
@LaurenWags
Copy link
Member

LaurenWags commented Aug 28, 2019

Also ran the following tests which passed:

  • Install 0.68.131 and enable Rewards. Ads are on by default. View an ad. Update on test channel to latest 0.68.x version. Verify Ads are still on after update, Ads panel information was not lost after upgrade, no BAT logo notification.
  • install 0.68.131 and enable Rewards. Disable Ads. Update on test channel to latest 0.68.x version. Verify Ads are still off after update, no BAT logo notification.

@LaurenWags
Copy link
Member

LaurenWags commented Aug 28, 2019

Tests were as expected. Used the following version:

Brave 0.68.132 Chromium: 76.0.3809.132 (Official Build) (64-bit)
Revision fd1acc410994a7a68ac25bc77513d443f3130860-refs/branch-heads/3809@{#1035}
OS Mac OS X

Thanks for the help with this one @kjozwiak!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants