CUDATutorial

A CUDA tutorial to make people learn CUDA program from 0

test enviroment

Turing T4 GPU

compile command

nvcc xxx.cu -o xxx if that does not work, pls try: nvcc xxx.cu --gpu-architecture=compute_yy -o xxx xxx is file name, yy is GPU compute capability, ep.A100's compute capability is 86.

remark

• related performance data is attached at the top of code file.
• the performance data is diverse and diverse on different GPU platforms and NVCC compiler, so some counter-intuitive result is normal, we should only explore and debug the result.
• welcome all comments and pull requests.

update notes

v2.0

• add cuda stream
• add quantize

v2.1

• add fp32/fp16 gemv(vec * mat,mat is col major)

v2.2

• add fp32/fp16 gemv(vec * mat,mat is row major)
• add some code explaination(WIP)