Mention HTTP server in features in README.md

Noeda · Mar 21, 2023 · d85ed7f · d85ed7f
1 parent a832061
commit d85ed7f
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -8,6 +8,8 @@ RLLaMA is a pure Rust implementation of [LLaMA large language model inference.](
   * LLaMA-7B, LLaMA-13B, LLaMA-30B, LLaMA-65B all confirmed working
   * Hand-optimized AVX2 implementation
   * OpenCL support for GPU inference.
+  * Simple HTTP API support, with the possibility of doing token sampling on
+    client side
 
 ## Performance