Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: Seal by total growing segments size #34692

Merged
merged 4 commits into from
Jul 17, 2024

Conversation

bigsheeper
Copy link
Contributor

@bigsheeper bigsheeper commented Jul 15, 2024

Seals the largest growing segment if the total size of growing segments of each shard exceeds the size threshold(default 4GB). Introducing this policy can help keep the size of growing segments within a suitable level, alleviating the pressure on the delegator.

issue: #34554

@sre-ci-robot sre-ci-robot added size/L Denotes a PR that changes 100-499 lines. area/test sig/testing test/integration integration test labels Jul 15, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement labels Jul 15, 2024
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
@mergify mergify bot added the ci-passed label Jul 16, 2024
Copy link

codecov bot commented Jul 16, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.92%. Comparing base (7306d2d) to head (e1d8dec).
Report is 20 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #34692      +/-   ##
==========================================
+ Coverage   71.65%   79.92%   +8.27%     
==========================================
  Files        1160     1160              
  Lines      140889   140926      +37     
==========================================
+ Hits       100955   112638   +11683     
+ Misses      35580    23935   -11645     
+ Partials     4354     4353       -1     
Files Coverage Δ
internal/datacoord/segment_allocation_policy.go 90.99% <100.00%> (+1.86%) ⬆️
internal/datacoord/segment_info.go 87.09% <100.00%> (ø)
internal/datacoord/segment_manager.go 86.14% <100.00%> (+0.09%) ⬆️
pkg/util/paramtable/component_param.go 98.51% <100.00%> (+<0.01%) ⬆️

... and 247 files with indirect coverage changes

@xiaofan-luan
Copy link
Contributor

/lgtm
/approve

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bigsheeper, xiaofan-luan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@xiaofan-luan
Copy link
Contributor

overall looks good me, better to change the config to a better name

@sre-ci-robot sre-ci-robot merged commit 4939f82 into milvus-io:master Jul 17, 2024
11 of 12 checks passed
bigsheeper added a commit to bigsheeper/milvus that referenced this pull request Jul 18, 2024
Seals the largest growing segment if the total size of growing segments
of each shard exceeds the size threshold(default 4GB). Introducing this
policy can help keep the size of growing segments within a suitable
level, alleviating the pressure on the delegator.

issue: milvus-io#34554

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Jul 19, 2024
Seals the largest growing segment if the total size of growing segments
of each shard exceeds the size threshold(default 4GB). Introducing this
policy can help keep the size of growing segments within a suitable
level, alleviating the pressure on the delegator.

issue: #34554

pr: #34692

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved area/test ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm sig/testing size/L Denotes a PR that changes 100-499 lines. test/integration integration test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants