Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start of the stat utilities. #2449

Merged
merged 1 commit into from
Dec 11, 2012
Merged

Conversation

brendandahl
Copy link
Contributor

Still somewhat of a work in progress, but it is far enough now that it is useful for testing locally.

@yurydelendik
Copy link
Contributor

/botio-windows lint

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_lint from @yurydelendik received. Current queue size: 0

Live output at: http://107.22.172.223:8877/acfe6f145c72dd9/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://107.22.172.223:8877/acfe6f145c72dd9/output.txt

Total script time: 1.20 mins

  • Lint: Passed

@yurydelendik
Copy link
Contributor

IRC "docs":

<bdahl> to run: python test.py --browserManifestFile=resources/browser_manifests/browser_manifest.json --statsFile=stats/results/baseline.json
<bdahl> then with your changes applied create another stats file
<bdahl> then compare python stats/statcmp.py stats/results/baseline.json stats/results/current.json
<bdahl> 30 rounds seems to be good
<bdahl> and as a sanity check you should run the stats twice with the same code and compare the results and make sure your p values are > 0.05

@yurydelendik
Copy link
Contributor

/botio test

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_test from @yurydelendik received. Current queue size: 0

Live output at: http://107.22.172.223:8877/7c902e135346b60/output.txt

@pdfjsbot
Copy link

From: Bot.io (Linux)


Received

Command cmd_test from @yurydelendik received. Current queue size: 0

Live output at: http://107.21.233.14:8877/bf95d6a64d3ae7e/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://107.22.172.223:8877/7c902e135346b60/output.txt

Total script time: 14.20 mins

  • Lint: Passed
  • Font tests: Passed
  • Unit tests: Passed
  • Regression tests: Passed

@pdfjsbot
Copy link

From: Bot.io (Linux)


Success

Full output at http://107.21.233.14:8877/bf95d6a64d3ae7e/output.txt

Total script time: 19.88 mins

  • Lint: Passed
  • Font tests: Passed
  • Unit tests: Passed
  • Regression tests: Passed

yurydelendik added a commit that referenced this pull request Dec 11, 2012
@yurydelendik yurydelendik merged commit 9583cb7 into mozilla:master Dec 11, 2012
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants