Skip to content

Commit

Permalink
add nccl lecture to readme index
Browse files Browse the repository at this point in the history
  • Loading branch information
andreaskoepf committed May 4, 2024
1 parent 838fd2d commit dc0af4f
Showing 1 changed file with 10 additions and 13 deletions.
23 changes: 10 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,59 +7,52 @@ The PMPP Book: [Programming Massively Parallel Processors: A Hands-on Approach](

- [Video](https://youtu.be/LuhJEEJQgUM)
- Date: 2024-01-13, Speaker: [Mark Saroufim](https://twitter.com/marksaroufim)
- Notebook and slides in `lecture_001` folder

- Notebook and slides in [lecture_001](./lecture_001/) folder

## Lecture 2: Recap Ch. 1-3 from the PMPP book

- [Video](https://youtu.be/NQ-0D5Ti2dc)
- Date: 2024-01-20, Speaker: [Andreas Koepf](https://twitter.com/neurosp1ke)
- Slides: The powerpoint file [lecture_002/cuda_mode_lecture2.pptx](./lecture_002/cuda_mode_lecture2.pptx) can be found in the root directory of this repository. Alternatively [here](https://docs.google.com/presentation/d/1deqvEHdqEC4LHUpStO6z3TT77Dt84fNAvTIAxBJgDck/edit#slide=id.g2b1444253e5_1_75) as Google docs presentation.


## Lecture 3: Getting Started With CUDA

- [Video](https://youtu.be/4sgKnKbR-WE)
- Date: 2024-01-27, Speaker: [Jeremy Howard](https://twitter.com/jeremyphoward)
- Notebook: See the `lecture_003` folder, or run the [Colab version](https://colab.research.google.com/drive/180uk6frvMBeT4tywhhYXmz3PJaCIA_uk?usp=sharing)

- Notebook: See the [lecture_003](./lecture_003/) folder, or run the [Colab version](https://colab.research.google.com/drive/180uk6frvMBeT4tywhhYXmz3PJaCIA_uk?usp=sharing)

## Lecture 4: Intro to Compute and Memory Architecture

- [Video](https://youtu.be/lTmYrKwjSOU)
- Date: 2024-02-03, Speaker: [Thomas Viehmann](https://lernapparat.de/)
- Notebook and slides in the `lecture_004` folder.

- Notebook and slides in the [lecture_004](./lecture_004/) folder.

## Lecture 5: Going Further with CUDA for Python Programmers

- [Video](https://youtu.be/wVsR-YhaHlM)
- Date: 2024-02-10, Speaker: [Jeremy Howard](https://twitter.com/jeremyphoward)
- Notebook in the `lecture_005` folder.

- Notebook in the [lecture_005](./lecture_005/) folder.

## Lecture 6: Optimizing PyTorch Optimizers
- [Video](https://www.youtube.com/watch?v=hIop0mWKPHc)
- Date: 2024-02-17, Speaker: [Jane Xu](https://github.com/janeyx99)
- [Slides](https://docs.google.com/presentation/d/13WLCuxXzwu5JRZo0tAfW0hbKHQMvFw4O/edit#slide=id.p1)


## Lecture 7: Advanced Quantization
- [Video](https://www.youtube.com/watch?v=1u9xUK3G4VM)
- Date: 2024-02-25, Speaker: [Charles Hernandez](https://github.com/HDCharles)
- [Slides](https://www.dropbox.com/scl/fi/hzfx1l267m8gwyhcjvfk4/Quantization-Cuda-vs-Triton.pdf?rlkey=s4j64ivi2kpp2l0uq8xjdwbab&dl=0)


## Lecture 8: CUDA Performance Checklist
- [Video](https://www.youtube.com/watch?v=SGhfUhlowB4)
- Date: 2024-03-09, Speaker: [Mark Saroufim](https://github.com/msaroufim)
- Code in the `lecture_008` folder
- Code in the [lecture_008](./lecture_008/) folder
- [Slides](https://docs.google.com/presentation/d/1cvVpf3ChFFiY4Kf25S4e4sPY6Y5uRUO-X-A4nJ7IhFE/edit?usp=sharing)

## Lecture 9: Reductions
- [Video](https://www.youtube.com/watch?v=09wntC6BT5o)
- Date: 2024-03-09, Speaker: [Mark Saroufim](https://github.com/msaroufim)
- Code in the `lecture_009` folder
- Code in the [lecture_009](./lecture_009/) folder
- [Slides](https://docs.google.com/presentation/d/1s8lRU8xuDn-R05p1aSP6P7T5kk9VYnDOCyN5bWKeg3U/edit?usp=drive_link)

## Lecture 10: Build a Prod Ready CUDA Library
Expand All @@ -85,3 +78,7 @@ The PMPP Book: [Programming Massively Parallel Processors: A Hands-on Approach](
- [Video](https://www.youtube.com/watch?v=DdTsX6DQk24)
- Date: 2024-04-13, Speaker: [Umer Adil](https://twitter.com/UmerHAdil)
- [Notebook](./lecture_014/A_Practitioners_Guide_to_Triton.ipynb)

## Lecture 17: GPU Collective Communication (NCCL)
- Date: 2024-05-04, Speaker: [Dan Johnson](https://physbam.stanford.edu/~dansj/)
- Code in the [lecture_017](./lecture_017/) folder

0 comments on commit dc0af4f

Please sign in to comment.