Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 21, 2024

• delete files

  zglxjtu

  committedMay 21, 2024
  98a20db

• update readme

  zglxjtu

  committedMay 21, 2024
  c4567c5

• update readme

  zglxjtu

  committedMay 21, 2024
  4a356bb

• update readme

  zglxjtu

  committedMay 21, 2024
  3b811d6

• data clean

  zglxjtu

  committedMay 21, 2024
  19494fa

Commits on Feb 29, 2024

• add ckpt

  zglxjtu

  committedFeb 29, 2024
  444155b

Commits on Jan 24, 2024

• update 2 ckpts

  zglxjtu

  committedJan 24, 2024
  bdc0a12

Commits on Jan 22, 2024

• set transformers version

  zglxjtu

  committedJan 22, 2024
  51581d7

• add sft data process file

  zglxjtu

  committedJan 22, 2024
  ccbcabb

• add some notes

  zglxjtu

  committedJan 22, 2024
  be202f8

• Modified output path

  zglxjtu

  committedJan 22, 2024
  19726f6

• Modified output path

  zglxjtu

  committedJan 22, 2024
  40be116

• Modified output path

  zglxjtu

  committedJan 22, 2024
  5a3e2d9

• add quick start

  zglxjtu

  committedJan 22, 2024
  57a93cb

Commits on Jan 20, 2024

• update

  DLLXW

  committedJan 20, 2024
  dfada68

• update

  DLLXW

  committedJan 20, 2024
  6bb487a

• update README

  DLLXW

  committedJan 20, 2024
  c930d1b

Commits on Jan 19, 2024

• update

  DLLXW

  committedJan 19, 2024
  be5a1a1

Commits on Jan 17, 2024

• Merge pull request DLLXW#56 from billvsme/fix/ddp_save_checkpoint

  DLLXW

  committedJan 17, 2024
  b21f11d

Commits on Jan 16, 2024

• fix sft.py multi gpu ddp save error

  billvsme

  committedJan 16, 2024
  d7b56ce

• fix multi gpu ddp save error

  billvsme

  committedJan 16, 2024
  02e0aa4

Commits on Dec 30, 2023

• update

  DLLXW

  committedDec 30, 2023
  9edb74c

• update

  DLLXW

  committedDec 30, 2023
  b10f904

Commits on Dec 26, 2023

• <bos>写成<eos>的致命笔误

  DLLXW

  committedDec 26, 2023
  e22b374

Commits on Sep 13, 2023

• Merge pull request DLLXW#32 from jh01231230/pretrain_windows_support_modifications

  DLLXW

  committedSep 13, 2023
  316d352

Commits on Sep 12, 2023

• Modified README.md : Changed the position of the instructions on how to run PyTorch with distributed training in the text.

  jh01231230

  committedSep 12, 2023
  3b06895

• Modified README.md : Added instructions on how to run PyTorch with distributed training and automatically set the environment variables.

  jh01231230

  committedSep 12, 2023
  e63ff5c

• Modified pretrain.py : Did a couple of changes for Windows compatibility, which will not affect the integrity and functionality of the original code for Linux/Unix based OS.

  jh01231230

  committedSep 12, 2023
  4550bf8

• Modified requirement.txt : Added scikit-learn as the dependency.

  jh01231230

  committedSep 12, 2023
  2ba31af

Commits on Sep 10, 2023

• Merge pull request DLLXW#27 from jh01231230/data_process_modifications

  DLLXW

  committedSep 10, 2023
  a60dbad

• Modified data_process.py : Modified process_baidu() method. To avoid the memory error when processing the large .json file, I divided it into five smaller batches and saved each one as a binary file.

  jh01231230

  committedSep 10, 2023
  00edb49

• Modified data_process.py : Refactored sft_to_pretrain() method. Now the method will require .json files which can be directly downloaded from Huggingface repo, instead of .csv.

  jh01231230

  committedSep 10, 2023
  bbed325

• Modified data_process.py : Added 'utf-8' encoding format when open files to avoid possible 'codec can't decode' issue.

  jh01231230

  committedSep 10, 2023
  49f8400

• Modified requirements.txt : Added transformers lib as the dependency.

  jh01231230

  committedSep 10, 2023
  690c659

Commits on Aug 31, 2023

• Merge pull request DLLXW#19 from jianhu-chen/patch-1

  DLLXW

  committedAug 31, 2023
  e9bf277

Pagination

PreviousNext