Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ingest consumer: more granular error handling, committer sanity check #6951

Merged
merged 4 commits into from
Dec 18, 2023
Merged

ingest consumer: more granular error handling, committer sanity check #6951

merged 4 commits into from
Dec 18, 2023

Commits on Dec 18, 2023

  1. ingest consumer: more granular error handling, committer sanity check 

    * check that the offset we're committing is certainly from the partition we're committing to
* process a fetch even when it contains some errors; this allows to process fetches with partial data

Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
    @dimitarvdimitrov
    dimitarvdimitrov committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    40226b0 View commit details
    Browse the repository at this point in the history

  2. Record total number of fetches 

    Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
    @dimitarvdimitrov
    dimitarvdimitrov committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    bc3151e View commit details
    Browse the repository at this point in the history

  3. Shortcut on 0 errors 

    Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
    @dimitarvdimitrov
    dimitarvdimitrov committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    2692bfd View commit details
    Browse the repository at this point in the history

  4. Work only on non-err fetches 

    Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
    @dimitarvdimitrov
    dimitarvdimitrov committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    4afd8c3 View commit details
    Browse the repository at this point in the history