Pinned Loading

1. FMInference/H2O FMInference/H2O Public

   [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

   Python 335 29

2. jiaweizzhao/GaLore jiaweizzhao/GaLore Public

   GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

   Python 1.3k 136

3. VITA-Group/Q-GaLore VITA-Group/Q-GaLore Public

   Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

   Python 137 10

4. VITA-Group/BNN_NoBN VITA-Group/BNN_NoBN Public

   [CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

   Python 54 10

5. VITA-Group/PrAC-LTH VITA-Group/PrAC-LTH Public

   [ICML 2021] "Efficient Lottery Ticket Finding: Less Data is More" by Zhenyu Zhang*, Xuxi Chen*, Tianlong Chen*, Zhangyang Wang

   Python 25 3

6. meta-llama/llama-recipes meta-llama/llama-recipes Public

   Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

   Jupyter Notebook 11.1k 1.6k