Skip to content

Issues: karpathy/nanoGPT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

212 Open 103 Closed
212 Open 103 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Pretraining loss explosion
#554 opened Sep 13, 2024 by mattgorb
why is the warmup_iters set 2000?
#552 opened Sep 5, 2024 by luxunxiansheng
The Positional Encoding is not using sin / cos?
#551 opened Sep 5, 2024 by mw66
1
Perplexity
#548 opened Aug 27, 2024 by Precola
Progressive training?
#547 opened Aug 22, 2024 by immartian
3
Rocm support?
#544 opened Aug 10, 2024 by ilovethensa
configuration for Macs(apple silicon)
#542 opened Aug 3, 2024 by bawsi99
What to change for training on two T4 GPUs ?
#539 opened Jul 27, 2024 by noorchauhan
1
Simple Use Case Demonstration with Old School Runescape Terminology
#537 opened Jul 19, 2024 by Omarch47
Nano GPT
#535 opened Jul 15, 2024 by phanee123
FileNotFoundError: [Errno 2] No such file or directory: 'data/openwebtext/train.bin'
#532 opened Jun 28, 2024 by HarikrishnanK9
1
About the get_batch
#531 opened Jun 28, 2024 by leo-young
1
Data cleaning for openwebtext
#529 opened Jun 26, 2024 by zzkzzkjsw
"RuntimeError: Internal Triton PTX codegen error" is raised when I train shakespeare_char with a GPU
#525 opened Jun 18, 2024 by shenbb
5
Pretraining Divergence
#524 opened Jun 13, 2024 by egoetz
3
Overfitting of the small GPU model
#493 opened Jun 11, 2024 by Bachstelze
Drop in performance when changing dtype to float32
#492 opened Jun 11, 2024 by blaisedelattre
2
What does "prioritize teeth over education" even mean?
#489 opened Jun 3, 2024 by dw61
2
[Q] Async prefetch next batch while model is doing forward pass
#486 opened May 23, 2024 by GM-git-dotcom
1
Shouldnt the ddp check be on ZERO instead of -1
#485 opened May 22, 2024 by sajinpgupta
Index out of range when training on custom dataset
#483 opened May 18, 2024 by TayTT
1
Implement multi-token prediction option for models
#479 opened May 4, 2024 by tmostak
7
nanoGPT/model.py where manual implementation of attention,Is it correct to modify it like I did？
#478 opened Apr 27, 2024 by wmx-github
1
Recommendation for something smaller
#476 opened Apr 23, 2024 by diamondfishtools
1
could nanoGPT be the AI assistant for the development of CAX software?
#474 opened Apr 19, 2024 by fengsim
1
ProTip! Exclude everything labeled bug with -label:bug.