Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
yeganehkordi committed Dec 20, 2022
1 parent b1528e0 commit 3ce4656
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,8 @@ In recent years, there has been a growing interest in building models that can f

### How SELF-INSTRUCT works?
The SELF-INSTRUCT process is an iterative bootstrapping algorithm that starts with a seed set of manually-written instructions and uses them to prompt the language model to generate new instructions and corresponding input-output instances. These generations are then filtered to remove low-quality or similar ones, and the resulting data is added back to the task pool. This process can be repeated multiple times, resulting in a large collection of instructional data that can be used to fine-tune the language model to follow instructions more effectively.
Here is an overview of SELF-INSTRUCT:
![](doc/pipeline.JPG)

## Setup
Code and data for the SELF-INSTRUCT framework will be made available in this repository soon.
Expand Down
Binary file added docs/pipeline.JPG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/pipeline.pdf
Binary file not shown.

0 comments on commit 3ce4656

Please sign in to comment.