Skip to content

Commit

Permalink
update the pre-built version of bitsandbytes library for windows us…
Browse files Browse the repository at this point in the history
…er to support QLoRA
  • Loading branch information
codemayq committed Jul 3, 2023
1 parent 3b0ee1e commit d9506a9
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,10 +105,10 @@ cd ChatGLM-Efficient-Tuning
pip install -r requirements.txt
```

If you want to enable LoRA or Freeze quantization on Windows, you will be required to install a pre-built version of `bitsandbytes` library, which supports CUDA 11.6 or 11.7.
If you want to enable LoRA(QLoRA) or Freeze quantization on Windows, you will be required to install a pre-built version of `bitsandbytes` library, which supports CUDA 11.1 to 12.1.

```
pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.1/bitsandbytes-0.37.2-py3-none-any.whl
pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl
```

### Fine-tuning with a Single GPU
Expand Down
4 changes: 2 additions & 2 deletions README_zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,10 +111,10 @@ cd ChatGLM-Efficient-Tuning
pip install -r requirements.txt
```

对于 Windows 用户,若要启用 LoRA 或 Freeze 的量化微调,请下载预构建的 `bitsandbytes` 包,目前仅支持 CUDA 11.6 和 11.7
对于 Windows 用户,若要启用 LoRA(QLoRA) 或 Freeze 的量化微调,请下载预构建的 `bitsandbytes` 包,目前支持 CUDA 11.1 到12.1

```
pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.1/bitsandbytes-0.37.2-py3-none-any.whl
pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl
```

### 单 GPU 微调训练
Expand Down

0 comments on commit d9506a9

Please sign in to comment.