Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove xunit-performance dependency in tests #60711

Merged
merged 2 commits into from
Oct 22, 2021

Conversation

BruceForstall
Copy link
Member

@BruceForstall BruceForstall commented Oct 21, 2021

The use of xunit-performance is deprecated; benchmarking now happens in the dotnet/performance repo using BenchmarkDotNet. Remove all the usage of xunit-performance in the runtime tests. This means removing all the [Benchmark] cases in the JIT benchmarks. Note that most or all of the JIT benchmarks in the runtime tree also have very similar copies in the dotnet/performance tree. The ones in the runtime tree are used for both correctness validation as well as easy of debugging.

The second commit makes the runtime copies compare more easily with the dotnet/performance copies; it makes them more similar. Note that there are still significant differences in a few of the implementations, notably Span/Indexer, Bytemark, and regex-redux.

@dotnet-issue-labeler dotnet-issue-labeler bot added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Oct 21, 2021
@ghost
Copy link

ghost commented Oct 21, 2021

Tagging subscribers to this area: @JulieLeeMSFT
See info in area-owners.md if you want to be subscribed.

Issue Details

null

Author: BruceForstall
Assignees: -
Labels:

area-CodeGen-coreclr

Milestone: -

@BruceForstall BruceForstall marked this pull request as draft October 21, 2021 07:40
We use BenchmarkDotNet in the dotnet/performance repo for
benchmarking now. These copies of the benchmarks are for
correctness testing, and for ease of debugging.
@BruceForstall BruceForstall marked this pull request as ready for review October 21, 2021 18:09
@BruceForstall BruceForstall changed the title Remove xunit performance tags Remove xunit-performance dependency in tests Oct 21, 2021
@BruceForstall
Copy link
Member Author

@dotnet/jit-contrib PTAL

@BruceForstall
Copy link
Member Author

Anyone?

The test failures are all unrelated.

@BruceForstall BruceForstall merged commit a75ea8b into dotnet:main Oct 22, 2021
@BruceForstall BruceForstall deleted the RemoveXunitPerformanceTags branch October 22, 2021 18:47
@ghost ghost locked as resolved and limited conversation to collaborators Nov 21, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants