-
Notifications
You must be signed in to change notification settings - Fork 524
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
kafka replay speed: upstream local development environment #9455
base: main
Are you sure you want to change the base?
Conversation
This PR makes several changes to development/mimir-ingest-storage * deploys a jaeger instance to collect traces * deploys ingester-zone-c-61. This ingester is totally separate from the other two zones. The idea is to be able to feed its partition with old data and test replay speed. That ingester doesn't ingest metrics from the cluster itself, so being down doesn't affect the cluster's query availability * deploys 3 kafkas with RF=2 so that we can bring down brokers and test how our code reacts to leader reelections * optinally enabled dlv debugging for the Mimir images * configures ingesters to use concurrent fetching Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
}], | ||
[{ | ||
__address__ = "mimir-write-zone-c-61:8080", | ||
cluster = "docker-compose", | ||
container = "mimir-write", | ||
namespace = "mimir-read-write-mode", | ||
job = "mimir-write-zone-c", | ||
}], |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(nit) Seems that tabs and spaces are mixed in this config here, right? ;)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i think it's only using spaces.. i asked goland to convert "to spaces" and it said it's already formatted. i fixed the indentation of this line in the meantime
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@dimitarvdimitrov have you forgotten to push the changes, maybe? The indentation is still off here ;)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is what i pushed f5b6bcb
i think GH doesn't update the diff on the comment
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🔥 Besides the broken indentation, the changes work for me
What this PR does
This is the fourth of series of PRs to upstream the code for improving Kafka replay speed in the ingester.
This PR makes several changes to development/mimir-ingest-storage
Which issue(s) this PR fixes or relates to
Fixes #
Checklist
CHANGELOG.md
updated - the order of entries should be[CHANGE]
,[FEATURE]
,[ENHANCEMENT]
,[BUGFIX]
.about-versioning.md
updated with experimental features.