Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support KFAC preconditioning #10

Open
gpauloski opened this issue Feb 6, 2023 · 0 comments
Open

Support KFAC preconditioning #10

gpauloski opened this issue Feb 6, 2023 · 0 comments
Assignees
@gpauloski
Labels
enhancement New features or improvements to existing functionality
Milestone
v0.1.0

Comments

@gpauloski
Copy link
Owner

Add support for https://github.com/gpauloski/kfac-pytorch.

One idea is to create a PreconditionedOptimizer class that wraps the KFACPreconditioner and an Optimizer.
@gpauloski gpauloski self-assigned this Feb 6, 2023
@gpauloski gpauloski added the enhancement New features or improvements to existing functionality label Feb 6, 2023
@gpauloski gpauloski mentioned this issue Feb 6, 2023
Merged
11 tasks
@gpauloski gpauloski modified the milestones: v0.0.1, v0.0.2 Mar 12, 2023
@gpauloski gpauloski modified the milestones: v0.1.1, v0.1.0 Jun 1, 2023
@gpauloski gpauloski mentioned this issue Jun 28, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gpauloski gpauloski

Labels
enhancement New features or improvements to existing functionality
Projects
None yet
Milestone
v0.1.0
Development

No branches or pull requests
1 participant
@gpauloski