Merge pull request #152 from mistralai/change_to_mistral_inference

Change to mistral-inference
mistralai · May 22, 2024 · 629631c · 629631c
2 parents 8598cf5 + 0e5b458
commit 629631c
Show file tree

Hide file tree

Showing 27 changed files with 2,088 additions and 734 deletions.
diff --git a/README.md b/README.md
diff --git a/assets/attention_through_layers.png b/assets/attention_through_layers.png
diff --git a/assets/chunking.png b/assets/chunking.png
diff --git a/assets/full_attention.png b/assets/full_attention.png
diff --git a/assets/kv_padding.png b/assets/kv_padding.png
diff --git a/assets/padding.png b/assets/padding.png
diff --git a/assets/rolling_cache.png b/assets/rolling_cache.png
diff --git a/assets/sliding_attention.png b/assets/sliding_attention.png
diff --git a/main.py b/main.py
diff --git a/mistral/__init__.py b/mistral/__init__.py
diff --git a/mistral/cache.py b/mistral/cache.py