Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LTR with symmetric relevance on top and bottom elements of each query. #6356

Open
jaguerrerod opened this issue Mar 9, 2024 · 2 comments
Open
Labels

Comments

@jaguerrerod
Copy link

Is there a way to perform learning to rank so that documents at the beginning and end of each query are relevant in a symmetrical manner? The actual metric is Spearman correlation, and since LightGBM doesn't have a pairwise objective, I want to try an alternative by manipulating the relevances symmetrically with respect to the central part of each query.

@jameslamb jameslamb changed the title LTR with simmetric relevance on top and bottom elements of each query. LTR with symmetric relevance on top and bottom elements of each query. Mar 12, 2024
@jameslamb
Copy link
Collaborator

@shiyu1994 could you please help with this question?

@jaguerrerod
Copy link
Author

In the simplest scenario, every position carries equal weight, meaning that the crucial factor is the agreement in order between the responses and the predictions for every pair of observations. If the response Y is less than Z, then the prediction for Y (P(Y)) should also be less than the prediction for Z (P(Z)).
In other words, spearman rank correlation objective.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants