Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support listener access logging #8438

Closed
guydc opened this issue Jul 5, 2023 · 9 comments
Closed

Support listener access logging #8438

guydc opened this issue Jul 5, 2023 · 9 comments
Assignees
Labels
Area: Envoy activities related to envoy proxy Area: Logging Committed: 1.18 daily-update Issues that require a daily update Prioritized Indicating issue prioritized to be worked on in RFE stream Priority: High Required in next 3 months to make progress, bugs that affect multiple users, or very bad UX release/1.17 Size: M 3 - 5 days Type: Enhancement New feature or request

Comments

@guydc
Copy link

guydc commented Jul 5, 2023

Version

1.14.x (latest stable)

Is your feature request related to a problem? Please describe.

Downstream connections that fail to be established are not reported in the HCM or TCP Proxy access logs. There are certain listener metrics that can be used to identify the existence of such connection issues. However, the connection context (e.g. downstream IP, requested server name, failure reason...) is not available, making it difficult to investigate such issues.

According to Envoy Docs:

Downstream connection access logging can be enabled using listener access logs. The listener access logs complement HTTP request access logging and can be enabled separately and independently from filter access logs.

The %DOWNSTREAM_TRANSPORT_FAILURE_REASON% command operator, introduced in envoy 1.26, is only available for listener access logs. This stream info is particularly useful for troubleshooting connection issues.

Describe the solution you'd like

Gloo Edge should support:

  • Independent configuration of Listener Access Logs
  • The %DOWNSTREAM_TRANSPORT_FAILURE_REASON% command operator (envoy 1.26)

Describe alternatives you've considered

No response

Additional Context

No response

┆Issue is synchronized with this Asana task by Unito

@guydc guydc added the Type: Enhancement New feature or request label Jul 5, 2023
@SantoDE SantoDE added the Good First Issue Good issue for newbies label Jul 5, 2023
@AkshayAdsul AkshayAdsul added the Priority: High Required in next 3 months to make progress, bugs that affect multiple users, or very bad UX label Nov 2, 2023
@ilrudie ilrudie self-assigned this Nov 7, 2023
@ilrudie
Copy link

ilrudie commented Nov 7, 2023

@moshevayner is taking a look at this. I don't have permission to assign to him so just self assigning for now so that folks know someone is looking at it

@moshevayner
Copy link

Hey y'all 👋🏼 !
Excited to work on my first PR for this project! 🤩

I've been trying to dive into the code and figure out what exactly needs to be done, but unfortunately without much success so far..

I'd love to get some pointers as to what should be changed/added, and where.

Thanks!! 🙏🏼

@nfuden nfuden removed the Good First Issue Good issue for newbies label Nov 10, 2023
@nfuden
Copy link
Contributor

nfuden commented Nov 10, 2023

Hey happy to walk through on a call on Saturday or any day next week.

However it sounds like you may have picked this up as a good first issue but I believe this label was erroneously applied. The hard bit about this issue is that we have top level settings commands and lower level gateway configuration. Neither which nicely maps to listener filters which we do allow to be configured in some plugins but is a paradigm that we don't currently do as often.

If you would prefer we can find another good first issue if that's preferable.

@ilrudie ilrudie removed their assignment Nov 10, 2023
@ilrudie
Copy link

ilrudie commented Nov 10, 2023

I dropped the assignment to avoid confusion or unnecessary delay. I think we can reprioritize and let someone else pick it up

@moshevayner
Copy link

Hey happy to walk through on a call on Saturday or any day next week.

However it sounds like you may have picked this up as a good first issue but I believe this label was erroneously applied. The hard bit about this issue is that we have top level settings commands and lower level gateway configuration. Neither which nicely maps to listener filters which we do allow to be configured in some plugins but is a paradigm that we don't currently do as often.

If you would prefer we can find another good first issue if that's preferable.

Thanks a lot @nfuden !
Yup I'm good with trying to find something more suitable for an entry-level contrib.
@ilrudie is helping me out with finding that. 🙏🏼

@sam-heilbron sam-heilbron added Area: Envoy activities related to envoy proxy Area: Logging labels Jan 23, 2024
@nfuden nfuden added the Size: M 3 - 5 days label Feb 23, 2024
@htpvu htpvu added the Prioritized Indicating issue prioritized to be worked on in RFE stream label Mar 6, 2024
@idogoren
Copy link

idogoren commented Apr 8, 2024

@DuncanDoyle @sam-heilbron - I see that version v1.17.0-beta16 was already released.
Can you commit (as labeled in the issue) that a fix will be provided as part of 1.17 release?
Thanks

@DuncanDoyle
Copy link
Contributor

@idogoren: It's targeted for 1.17. Top of the list in our prio queue for engineering to pick it up.

@nfuden
Copy link
Contributor

nfuden commented Apr 22, 2024

Merged in 1.17 OSS. Should land in enterprise 1.17 beta2 or 1.17 beta3, will update once that becomes clearer

@nfuden
Copy link
Contributor

nfuden commented Apr 23, 2024

Closing and will comment once the enterprise version drops

@nfuden nfuden closed this as completed Apr 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Envoy activities related to envoy proxy Area: Logging Committed: 1.18 daily-update Issues that require a daily update Prioritized Indicating issue prioritized to be worked on in RFE stream Priority: High Required in next 3 months to make progress, bugs that affect multiple users, or very bad UX release/1.17 Size: M 3 - 5 days Type: Enhancement New feature or request
Projects
None yet
Development

No branches or pull requests