You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For narrow problems where we compute a full hessian, the inner CD loop is so fast that this would not be helpful to do. However, for future solvers for wide problems where we can't precompute a full hessian, I suspect that implementing inner loop active set logic would be very helpful!
The text was updated successfully, but these errors were encountered:
The result of #424 makes me think that this issue might have a substantial impact in certain narrow cases if someone ever wants to implement it.
This will have a large impact if:
The problem is coordinate descent dominated. This is normally only true for gaussian distribution and l1 penalty settings (LASSO).
The problem has a large penalty so that many coeffs will be zero.
But, in that situation, I could see it potentially leading to decent performance improvements because the innermost loop of the CD solver will iterate over a much smaller list of coefficients.
I'm leaving this "on hold" because it's not a high priority right now but I just wanted to share my thoughts.
This is a leftover task from #92
For narrow problems where we compute a full hessian, the inner CD loop is so fast that this would not be helpful to do. However, for future solvers for wide problems where we can't precompute a full hessian, I suspect that implementing inner loop active set logic would be very helpful!
The text was updated successfully, but these errors were encountered: