Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.NET 8 per-preview performance overview #77490

Closed
naricc opened this issue Oct 26, 2022 · 7 comments
Closed

.NET 8 per-preview performance overview #77490

naricc opened this issue Oct 26, 2022 · 7 comments
Assignees
Labels
area-VM-meta-mono tenet-performance Performance related issue tracking This issue is tracking the completion of other related issues.
Milestone

Comments

@naricc
Copy link
Member

naricc commented Oct 26, 2022

Description

This issue provides an overview of the all performance regressions from microbenchmark automated runs in WASM, Mono AOT, and Interpreter during the timeframe of .NET 8 preview releases. WASM regressions are tracked separately at dotnet/perf-autofiling-issues#9652.

List of queries for autofilling issues:

Mono AOT

Within the .NET 8 timeframe about 100 microbenchmarks regressed more than 10%. Summary of the most impactful issues to be resolved:

Details

RC2

Issue Status
dotnet/perf-autofiling-issues#22179 Resolved
dotnet/perf-autofiling-issues#21818, dotnet/perf-autofiling-issues#21820 Resolved
dotnet/perf-autofiling-issues#22174 Resolved

RC 1

Issue Status
#91361, dotnet/perf-autofiling-issues#20290 Resolved
dotnet/perf-autofiling-issues#20971 Resolved

Preview 7

Issue Status
dotnet/perf-autofiling-issues#19469, dotnet/perf-autofiling-issues#19517 Resolved

Preview 6

Issue Status

Preview 5

Issue Status
dotnet/perf-autofiling-issues#17874, dotnet/perf-autofiling-issues#17870 Resolved
dotnet/perf-autofiling-issues#17202, dotnet/perf-autofiling-issues#17311 Resolved
dotnet/perf-autofiling-issues#18385, dotnet/perf-autofiling-issues#18384 Resolved
dotnet/perf-autofiling-issues#18023 Resolved
dotnet/perf-autofiling-issues#17208, dotnet/perf-autofiling-issues#17312 Resolved
dotnet/perf-autofiling-issues#17505, dotnet/perf-autofiling-issues#17553 Resolved
dotnet/perf-autofiling-issues#17201, dotnet/perf-autofiling-issues#17310 Resolved
dotnet/perf-autofiling-issues#17200 Resolved

Preview 4

Issue Status
dotnet/perf-autofiling-issues#17004, dotnet/perf-autofiling-issues#16946, dotnet/perf-autofiling-issues#16945, dotnet/perf-autofiling-issues#16604 Resolved
dotnet/perf-autofiling-issues#16359 Resolved
dotnet/perf-autofiling-issues#16481 Resolved
dotnet/perf-autofiling-issues#16361 Resolved
dotnet/perf-autofiling-issues#14907 Resolved
dotnet/perf-autofiling-issues#14523 Resolved
dotnet/perf-autofiling-issues#15689, dotnet/perf-autofiling-issues#15694, dotnet/perf-autofiling-issues#15769, dotnet/perf-autofiling-issues#15794, dotnet/perf-autofiling-issues#15764, dotnet/perf-autofiling-issues#15659 Resolved
dotnet/perf-autofiling-issues#16943, dotnet/perf-autofiling-issues#16433, dotnet/perf-autofiling-issues#16603 Resolved
dotnet/perf-autofiling-issues#15660 Resolved
dotnet/perf-autofiling-issues#17003, dotnet/perf-autofiling-issues#15697, dotnet/perf-autofiling-issues#15795, dotnet/perf-autofiling-issues#15774, dotnet/perf-autofiling-issues#15798 Resolved

Preview 3

Issue Status
dotnet/perf-autofiling-issues#13978 Resolved
dotnet/perf-autofiling-issues#12060 Resolved
dotnet/perf-autofiling-issues#14017, dotnet/perf-autofiling-issues#13977, dotnet/perf-autofiling-issues#14016, dotnet/perf-autofiling-issues#13992 Resolved
dotnet/perf-autofiling-issues#14569 Resolved
dotnet/perf-autofiling-issues#14286 Resolved
dotnet/perf-autofiling-issues#14570 Resolved
dotnet/perf-autofiling-issues#14520 Resolved

Preview 2

Issue Status
dotnet/perf-autofiling-issues#12660 Resolved
dotnet/perf-autofiling-issues#12546 Resolved
#80569 Resolved
dotnet/perf-autofiling-issues#12957 Resolved
dotnet/perf-autofiling-issues#13187 Resolved
dotnet/perf-autofiling-issues#13500 Resolved
dotnet/perf-autofiling-issues#13770 Resolved

.NET 7 / Preview 1

Issue Status
dotnet/perf-autofiling-issues#14015 Resolved
dotnet/perf-autofiling-issues#11536 Resolved
dotnet/perf-autofiling-issues#11539 Resolved
dotnet/perf-autofiling-issues#13980 Resolved
dotnet/perf-autofiling-issues#13774 Resolved
dotnet/perf-autofiling-issues#13771 Resolved
dotnet/perf-autofiling-issues#13499 Resolved
dotnet/perf-autofiling-issues#13497 Resolved
dotnet/perf-autofiling-issues#13495 Resolved
dotnet/perf-autofiling-issues#13494 Resolved
dotnet/perf-autofiling-issues#13772 Resolved
dotnet/perf-autofiling-issues#13984 Resolved
dotnet/perf-autofiling-issues#12058 Resolved
dotnet/perf-autofiling-issues#11780 Resolved
dotnet/perf-autofiling-issues#11812 Resolved
dotnet/perf-autofiling-issues#12054 Resolved
dotnet/perf-autofiling-issues#12073 Resolved
dotnet/perf-autofiling-issues#12484 Resolved
dotnet/perf-autofiling-issues#12307 Resolved
dotnet/perf-autofiling-issues#10951 Resolved
dotnet/perf-autofiling-issues#11779 Resolved
dotnet/perf-autofiling-issues#11811 Resolved
dotnet/perf-autofiling-issues#12056 Resolved
dotnet/perf-autofiling-issues#12057 Resolved
dotnet/perf-autofiling-issues#8834 Resolved
dotnet/perf-autofiling-issues#9173 Resolved
dotnet/perf-autofiling-issues#9599 Resolved
#77900 Resolved
#78804 Resolved

Mono Interpreter

Within the .NET 8 timeframe about 250 microbenchmarks regressed more than 10%. Summary of the most impactful issues to be resolved:

Details

RC2

Issue Status
dotnet/perf-autofiling-issues#20737 Resolved
dotnet/perf-autofiling-issues#21828, dotnet/perf-autofiling-issues#21829, dotnet/perf-autofiling-issues#21830, dotnet/perf-autofiling-issues#21872, dotnet/perf-autofiling-issues#22250 Resolved
dotnet/perf-autofiling-issues#21832 Resolved

Preview 7

Issue Status
dotnet/perf-autofiling-issues#19921 Resolved
dotnet/perf-autofiling-issues#19919 Resolved
dotnet/perf-autofiling-issues#19225 Resolved
dotnet/perf-autofiling-issues#19923 Resolved
dotnet/perf-autofiling-issues#19918 Resolved
dotnet/perf-autofiling-issues#19756 Resolved
dotnet/perf-autofiling-issues#19486 Resolved
dotnet/perf-autofiling-issues#19484 Resolved
dotnet/perf-autofiling-issues#19227 Resolved
dotnet/perf-autofiling-issues#19228 Resolved

Preview 6

Issue Status
dotnet/perf-autofiling-issues#19016 Resolved
dotnet/perf-autofiling-issues#19018 Resolved
dotnet/perf-autofiling-issues#18528 Resolved

Preview 5

Issue Status
dotnet/perf-autofiling-issues#18318 Resolved
dotnet/perf-autofiling-issues#17235 Resolved
dotnet/perf-autofiling-issues#18040 Resolved
dotnet/perf-autofiling-issues#17237 Resolved

Preview 4

Issue Status
dotnet/perf-autofiling-issues#16642 Resolved
dotnet/perf-autofiling-issues#15719 Resolved
dotnet/perf-autofiling-issues#17018 Resolved
dotnet/perf-autofiling-issues#16546 Resolved
dotnet/perf-autofiling-issues#15724 Resolved
dotnet/perf-autofiling-issues#15626 Resolved
dotnet/perf-autofiling-issues#15154 Resolved
dotnet/perf-autofiling-issues#14530 Resolved

Preview 3

Issue Status
dotnet/perf-autofiling-issues#13992 Resolved
dotnet/perf-autofiling-issues#13993 Resolved
dotnet/perf-autofiling-issues#13747 Resolved
dotnet/perf-autofiling-issues#13749 Resolved

Preview 2

Issue Status
dotnet/perf-autofiling-issues#12707, dotnet/perf-autofiling-issues#11453 Resolved
#79973 Resolved
dotnet/perf-autofiling-issues#12299 Resolved
dotnet/perf-autofiling-issues#13746 Resolved
dotnet/perf-autofiling-issues#13199 Resolved

.NET 7 / Preview 1

Issue Status
#79876 Resolved
#79336 Resolved
dotnet/perf-autofiling-issues#11449 Resolved
dotnet/perf-autofiling-issues#11147 Resolved
dotnet/perf-autofiling-issues#12501 Resolved
dotnet/perf-autofiling-issues#12965 Resolved
dotnet/perf-autofiling-issues#12081 Resolved
dotnet/perf-autofiling-issues#12962 Resolved
dotnet/perf-autofiling-issues#12080 Resolved
dotnet/perf-autofiling-issues#11791 Resolved
dotnet/perf-autofiling-issues#11790 Resolved
#78807 Resolved
dotnet/perf-autofiling-issues#12047 Resolved
dotnet/perf-autofiling-issues#11451 Resolved
#79604 Resolved
#78820 Resolved
dotnet/perf-autofiling-issues#11293 Resolved
#79606 Resolved
dotnet/perf-autofiling-issues#10933 Resolved
#79877 Resolved
#78815 Resolved
#79605 Resolved
#79607 Resolved
#78838 Resolved
#78826 Resolved
#78821 Resolved
#78980 Resolved
#78809 Resolved
#78812 Resolved
#78813 Resolved
#78814 Resolved
dotnet/perf-autofiling-issues#8641 Resolved
#79337 Resolved
#78810 Resolved
#78836 Resolved
#78825 Resolved
#78824 Resolved
#78823 Resolved
#78822 Resolved
#78837 Resolved
#78827 Resolved
#78835 Resolved
#78805 Resolved
dotnet/perf-autofiling-issues#10158 Resolved
#78804 Resolved
#78811 Resolved
#78808 Resolved
#78806 Resolved
#78819 Resolved
dotnet/perf-autofiling-issues#9346 Resolved
dotnet/perf-autofiling-issues#8642 Resolved
#77900 Resolved
dotnet/perf-autofiling-issues#8870 Resolved
dotnet/perf-autofiling-issues#9029 Resolved
dotnet/perf-autofiling-issues#9030 Resolved
dotnet/perf-autofiling-issues#9199 Resolved

Mono On Disk Size - iOS

Screenshot 2023-04-27 at 10 03 04

Details

.NET 8

Date Diff Change Size increase (bytes) Size increase (%) Tracking issue Status
06 Dec 2022 b399eed...fcf0a09 62f3eb2 - - #79285
12 Apr 2022 e7ed417...7526a4c #84289 590688 2.11 #85450
14 Apr 2022 2d833f4...9c02b25 #84587 351776 1.25 #85451
24 Apr 2022 223d152...9aefa9d #84582 385449 1.32 #85452
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Oct 26, 2022
@naricc naricc changed the title [MONO] Master Issue For Microbenchmark Perf [MONO][PERF] Master Issue For Microbenchmark Perf Oct 26, 2022
@SamMonoRT SamMonoRT added tenet-performance Performance related issue and removed untriaged New issue has not been triaged by the area owner labels Nov 3, 2022
@SamMonoRT SamMonoRT added this to the 8.0.0 milestone Nov 3, 2022
@SamMonoRT SamMonoRT added the tracking This issue is tracking the completion of other related issues. label Nov 4, 2022
@LeVladIonescu LeVladIonescu self-assigned this May 24, 2023
@kotlarmilos kotlarmilos modified the milestones: 8.0.0, 9.0.0 Aug 11, 2023
@kotlarmilos kotlarmilos changed the title [MONO][PERF] Master Issue For Microbenchmark Perf .NET 8 per-preview performance overview Dec 8, 2023
@lewing
Copy link
Member

lewing commented Feb 9, 2024

cc @artl93 @stevisok @jeffschwMSFT

@kotlarmilos
Copy link
Member

The .NET 9 issues have been moved to #98209. This issue will be closed after remaining regressions are addressed.

@lewing
Copy link
Member

lewing commented Feb 21, 2024

@DrewScoggins @kotlarmilos why aren't the wasm interpreter runs being labeled as interpreter runs and being tracked in #98209 ?

@kotlarmilos
Copy link
Member

They are tracked separately in #96444.

@kotlarmilos
Copy link
Member

@matouskozak Do we plan to triage tracked issues?

@matouskozak
Copy link
Member

matouskozak commented Jul 30, 2024

@matouskozak Do we plan to triage tracked issues?

I took a look at some MonoAOT ones, closed the ones that are no-longer regressed in .NET 9. We should align on what to do with the rest. Let's sync on Wednesday call and decide.

@kotlarmilos
Copy link
Member

All issues have been transferred/resolved to .NET 9+.

@github-actions github-actions bot locked and limited conversation to collaborators Sep 1, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-VM-meta-mono tenet-performance Performance related issue tracking This issue is tracking the completion of other related issues.
Projects
None yet
Development

No branches or pull requests

7 participants