You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to properly react to errors coming from requests sent via elastic sink, the overall errors and the bulk-element errors should be sent as error events to the err port of the sink. Currently bulk element errors are only logged at the ERROR level, which might quickly fill up disks. Also with error events with a proper format, users are going to be able to handle failures according to their business logic (retry policies while maintaining idempotency etc. etc.)
Describe the solution you'd like
Send all sink errors as Error events. This includes bulk element errors. These might be sent as separate events or as part of a single event which contains an array of all bulk errors.
Notes
If this is an implementation of an RFC provide a URL
to the RFC this enhancement implements.
If this is a major enhancement or contribution an RFC may be required. It is ok to submit an enhancement
first and our core team will assist with major contributions. In general, major contributions should be
discussed with the community before submission.
The text was updated successfully, but these errors were encountered:
We want to extend this change to make the elastic sink a "Linked Transport" in that it will emit success and error events for each bulk item coming back.
Describe the problem you are trying to solve
In order to properly react to errors coming from requests sent via elastic sink, the overall errors and the bulk-element errors should be sent as error events to the
err
port of the sink. Currently bulk element errors are only logged at theERROR
level, which might quickly fill up disks. Also with error events with a proper format, users are going to be able to handle failures according to their business logic (retry policies while maintaining idempotency etc. etc.)Describe the solution you'd like
Send all sink errors as Error events. This includes bulk element errors. These might be sent as separate events or as part of a single event which contains an array of all bulk errors.
Notes
If this is an implementation of an RFC provide a URL
to the RFC this enhancement implements.
If this is a major enhancement or contribution an RFC may be required. It is ok to submit an enhancement
first and our core team will assist with major contributions. In general, major contributions should be
discussed with the community before submission.
The text was updated successfully, but these errors were encountered: