Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clusterloader2: drop metrics deprecated in 1.19 #1172

Merged

Conversation

ingvagabund
Copy link
Contributor

Both predicate_evaluation and priority_evaluation operation metrics are replaced
with filter, resp. score extension points.
Also, preemption_evaluation, resp. binding operation metrics are replaced with
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket, resp.
scheduler_binding_duration_seconds_bucket metrics.

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Apr 11, 2020
@ingvagabund
Copy link
Contributor Author

Collected metrics contain the following entries for binding and predicate evaluation:

# HELP scheduler_binding_duration_seconds [ALPHA] Binding latency in seconds
# TYPE scheduler_binding_duration_seconds histogram
scheduler_binding_duration_seconds_bucket{le=\"0.001\"} 0
scheduler_binding_duration_seconds_bucket{le=\"0.002\"} 0
scheduler_binding_duration_seconds_bucket{le=\"0.004\"} 41
scheduler_binding_duration_seconds_bucket{le=\"0.008\"} 633
scheduler_binding_duration_seconds_bucket{le=\"0.016\"} 1707
scheduler_binding_duration_seconds_bucket{le=\"0.032\"} 2852
scheduler_binding_duration_seconds_bucket{le=\"0.064\"} 3806
scheduler_binding_duration_seconds_bucket{le=\"0.128\"} 4805
scheduler_binding_duration_seconds_bucket{le=\"0.256\"} 6157
scheduler_binding_duration_seconds_bucket{le=\"0.512\"} 7037
scheduler_binding_duration_seconds_bucket{le=\"1.024\"} 7282
scheduler_binding_duration_seconds_bucket{le=\"2.048\"} 7282
scheduler_binding_duration_seconds_bucket{le=\"4.096\"} 7282
scheduler_binding_duration_seconds_bucket{le=\"8.192\"} 7282
scheduler_binding_duration_seconds_bucket{le=\"16.384\"} 7282
scheduler_binding_duration_seconds_bucket{le=\"+Inf\"} 7282
scheduler_binding_duration_seconds_sum 887.1218679819982
scheduler_binding_duration_seconds_count 7282
# HELP scheduler_scheduling_algorithm_preemption_evaluation_seconds [ALPHA] Scheduling algorithm preemption evaluation duration in seconds
# TYPE scheduler_scheduling_algorithm_preemption_evaluation_seconds histogram
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.001\"} 0
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.002\"} 0
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.004\"} 26
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.008\"} 38
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.016\"} 50
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.032\"} 55
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.064\"} 60
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.128\"} 63
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.256\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"0.512\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"1.024\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"2.048\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"4.096\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"8.192\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"16.384\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket{le=\"+Inf\"} 64
scheduler_scheduling_algorithm_preemption_evaluation_seconds_sum 1.060999083
scheduler_scheduling_algorithm_preemption_evaluation_seconds_count 64

@ingvagabund ingvagabund force-pushed the scheduler-drop-deprecated-metrics branch 3 times, most recently from a490d22 to 8e0aa84 Compare April 11, 2020 17:10
@ingvagabund
Copy link
Contributor Author

@ahg-g PTAL

@ingvagabund
Copy link
Contributor Author

As per #1081 (comment) comment, do you want to display the deprecated binding/preemption metrics with the new ones? Right now, the old metrics are just replaced by the new ones.

@@ -42,7 +41,8 @@ const (
e2eSchedulingDurationMetricName = model.LabelValue(schedulermetric.SchedulerSubsystem + "_e2e_scheduling_duration_seconds_bucket")
schedulingAlgorithmDurationMetricName = model.LabelValue(schedulermetric.SchedulerSubsystem + "_scheduling_algorithm_duration_seconds_bucket")
frameworkExtensionPointDurationMetricName = model.LabelValue(schedulermetric.SchedulerSubsystem + "_framework_extension_point_duration_seconds_bucket")
schedulingLatencyMetricName = model.LabelValue(schedulermetric.SchedulerSubsystem + "_" + schedulermetric.DeprecatedSchedulingDurationName)
bindingDurationMetricName = model.LabelValue(schedulermetric.SchedulerSubsystem + "_binding_duration_seconds_bucket")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

binding is already one of the extension points, so we don't really need a separate metric for it.

Both predicate_evaluation and priority_evaluation operation metrics are replaced
with filter, resp. score extension points.
Also, preemption_evaluation, resp. binding operation metrics are replaced with
scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket, resp.
scheduler_binding_duration_seconds_bucket metrics.
@ingvagabund ingvagabund force-pushed the scheduler-drop-deprecated-metrics branch from 8e0aa84 to 73e8002 Compare April 15, 2020 08:30
@ahg-g
Copy link
Member

ahg-g commented Apr 15, 2020

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Apr 15, 2020
@ingvagabund
Copy link
Contributor Author

@wojtek-t PTAL

@wojtek-t
Copy link
Member

/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, ingvagabund, wojtek-t

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 17, 2020
@ingvagabund
Copy link
Contributor Author

/retest

@k8s-ci-robot k8s-ci-robot merged commit b9f8e87 into kubernetes:master Apr 17, 2020
@ingvagabund ingvagabund deleted the scheduler-drop-deprecated-metrics branch April 18, 2020 08:45
@ingvagabund
Copy link
Contributor Author

https://go.k8s.io/oncall

@mm4tt can you please reload perfdash?

mm4tt added a commit to mm4tt/perf-tests that referenced this pull request Apr 20, 2020
@mm4tt mm4tt mentioned this pull request Apr 20, 2020
mm4tt added a commit to mm4tt/perf-tests that referenced this pull request Apr 20, 2020
yuanchen8911 pushed a commit to yuanchen8911/perf-tests that referenced this pull request Apr 20, 2020
vamossagar12 pushed a commit to vamossagar12/perf-tests that referenced this pull request Apr 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants