Skip to content

Commit

Permalink
Mention that server feature must be turned on to use the inference …
Browse files Browse the repository at this point in the history
…API.
  • Loading branch information
Noeda committed Mar 21, 2023
1 parent 5e24172 commit 957a8f9
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,12 @@ Use `rllama --help` to see all the options.

## Inference server

`rllama` can run in an inference server mode with a simple HTTP JSON API.
`rllama` can run in an inference server mode with a simple HTTP JSON API. You
need to enable `server` features for this.

```
cargo build --release --features server
```

The command line flags for this are:

Expand Down

0 comments on commit 957a8f9

Please sign in to comment.