Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kubelet, systemd filtration and refactor containers exporter #1772

Merged
merged 5 commits into from
Sep 21, 2021

Conversation

sumo-drosiek
Copy link
Contributor

@sumo-drosiek sumo-drosiek commented Sep 21, 2021

  • unify exporting for systemd, collectd and containers logs
  • add filtration for systemd like we already have in fluentd
  • add kubelet pipeline

@sumo-drosiek sumo-drosiek requested a review from a team as a code owner September 21, 2021 08:08
Dominik Rosiek added 4 commits September 21, 2021 10:12
… in exporter

Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Comment on lines 3003 to 3004
- attributes/remove_fluent_tag
- filter/include_kubelet
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually as I think of it now I believe we can swap those 2 to save processing of "non kubelet" entries, i.e. no need to remove the fluent.tag from a record that will be filtered out anyway.

The same can be done for systemd

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so we should move it as far as possible, we have additional filtering in sourceprocessor for example

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do you mean "as far as possible"? Shouldn't we filter out as soon as possible in the pipeline?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mean moving - attributes/remove_fluent_tag just before batch

Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
@sumo-drosiek sumo-drosiek merged commit 6b13c92 into main Sep 21, 2021
@sumo-drosiek sumo-drosiek deleted the drosiek-kubelet branch September 21, 2021 09:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants