Skip to content

Commit

Permalink
commit
Browse files Browse the repository at this point in the history
  • Loading branch information
taishan1994 committed May 26, 2023
1 parent 8e9e3a1 commit 2377fcb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ chatglm-6b下面数据是这样,除权重外已经放在model_hub/chatglm-6b

1、data下新建数据集,用process.py处理数据为instruct_data下的数据。

2、这里使用train_trainer.py进行训练,为了能够让transformers的Trainer在训练的过程中保存lora权重,对Trainer进行相应的修改,参考:https://github.com/huggingface/peft/issues/96 。因为有了config_utils.py,我们可以在字典里面定义相关参数,然后可以在命令行修改桉树的值(嵌套参数之间用_分隔)。
2、这里使用train_trainer.py进行训练,为了能够让transformers的Trainer在训练的过程中保存lora权重,对Trainer进行相应的修改,参考:https://github.com/huggingface/peft/issues/96 。因为有了config_utils.py,我们可以在字典里面定义相关参数,然后可以在命令行修改参数的值(嵌套参数之间用_分隔)。

```python
args = {
Expand Down

0 comments on commit 2377fcb

Please sign in to comment.