Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emit time lag metrics to track how old is the data being processed and avoid data loss #628

Open
felipepessoto opened this issue Feb 22, 2022 · 1 comment

Comments

@felipepessoto
Copy link

Feature Requests:

  • What issue are you trying to solve?
    Be able to track if the time lag is increasing and react before it reaches the retention time, what would cause data loss.
  • How do you want to solve it?
    Emit metrics containing the time lag, so we can monitor it and create alerts.
  • What is your use case for this feature?
    This is important for production application

The metric values would be: UTC Now - EventData.SystemProperties.EnqueuedTimeUtc

@felipepessoto felipepessoto changed the title Emit metrics to track event enqueued time and avoid data loss Emit time lag metrics to track how old is the data being processed and avoid data loss Feb 25, 2022
@felipepessoto
Copy link
Author

Hi. Do you have any update on this?

I believe this metric is critical for production workloads that can't lose any events.
Would like to hear what you folks think. If this is something we could expect for the next releases?

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant