Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

P3A - Click on Skip welcome tour isn't giving correct response value #7262

Closed
GeetaSarvadnya opened this issue Dec 7, 2019 · 6 comments
Closed

Comments

@GeetaSarvadnya
Copy link

Description

Found while testing #6285
P3A - Click on Skip welcome tour isn't giving correct response value

Q3: Did you follow the on-boarding process
(Brave.Welcome.InteractionStatus)

  1. Did not click within welcome screen
  2. Clicked once
  3. Clicked twice or more but did not make it to the end
  4. Made it to end of on-boarding flow

Steps to Reproduce

  1. clean profile 1.1.18
  2. click on skip welcome tour in on-boarding page
  3. reload the local-state file
  4. response value is displayed as 0 instead of 1 (Clicked once)

Actual result:

response value is displayed as 0 instead of 1 (Clicked once)

Expected result:

the response value should be displayed correctly

Reproduces how often:

Always

Brave version (brave://version info)

Brave 1.1.18 Chromium: 79.0.3945.56 (Official Build) (64-bit)
Revision 73cc6bf591f792b99f8fc7cdfb8addedbd084bf8-refs/branch-heads/3945@{#788}
OS Windows 10 OS Version 1803 (Build 17134.1006)

Version/Channel Information:

  • Can you reproduce this issue with the current release? NA
  • Can you reproduce this issue with the beta channel? Yes
  • Can you reproduce this issue with the dev channel? Yes
  • Can you reproduce this issue with the nightly channel? Yes

Other Additional Information:

  • Does the issue resolve itself when disabling Brave Shields? NA
  • Does the issue resolve itself when disabling Brave Rewards? NA
  • Is the issue reproducible on the latest version of Chrome? NA

Miscellaneous Information:

cc: @brave/legacy_qa @iefremov @bsclifton @rebron

@LaurenWags
Copy link
Member

Reproduces on macOS

Brave 1.1.18 Chromium: 79.0.3945.56 (Official Build) (64-bit)
Revision 73cc6bf591f792b99f8fc7cdfb8addedbd084bf8-refs/branch-heads/3945@{#788}
OS macOS Version 10.13.6 (Build 17G5019)

@iefremov
Copy link
Contributor

I think this is probably something expected since the aim of this metric is to understand whether users go through the onboarding process. So skipping the welcome tour means that they are not interested in scrolling through different screens. @davidtemkin could you please take a look at the issue?

@rebron
Copy link
Collaborator

rebron commented Feb 7, 2020

@davidtemkin re-ping. cc: @mattmcalister I think this is right where clicking skip is 0 instead of 1. We want to measure interaction of flowing through welcome flow and skipping should mean 0.

@mattmcalister
Copy link

The question could be much more precise. I suggest we leave the question as is for now, as we can deduce what we need to know from the data we're currently collecting.

@iefremov
Copy link
Contributor

iefremov commented Mar 3, 2020

The question could be much more precise. I suggest we leave the question as is for now, as we can deduce what we need to know from the data we're currently collecting.

@mattmcalister Can we just close this for now?

@bsclifton
Copy link
Member

Closing as I see a thumbs up emoji response from @mattmcalister 😄

@bbondy bbondy added this to the Closed / Invalid milestone Jun 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants