Skip to content

Commit

Permalink
20240916 mistral text vectorizer (#2607)
Browse files Browse the repository at this point in the history
* wip

* Add images; index pages; placeholder emb page

* Add mistral embed page; add more xlinks
  • Loading branch information
databyjp authored Sep 16, 2024
1 parent ee4ec78 commit 0f9c8ec
Show file tree
Hide file tree
Showing 27 changed files with 360 additions and 3 deletions.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -398,6 +398,47 @@
# clean up
client.collections.delete("DemoCollection")

# START BasicVectorizerMistral
from weaviate.classes.config import Configure

client.collections.create(
"DemoCollection",
# highlight-start
vectorizer_config=[
Configure.NamedVectors.text2vec_mistral(
name="title_vector",
source_properties=["title"],
)
],
# highlight-end
# Additional parameters not shown
)
# END BasicVectorizerMistral

# clean up
client.collections.delete("DemoCollection")

# START FullVectorizerMistral
from weaviate.classes.config import Configure

client.collections.create(
"DemoCollection",
# highlight-start
vectorizer_config=[
Configure.NamedVectors.text2vec_mistral(
name="title_vector",
source_properties=["title"],
model="mistral-embed"
)
],
# highlight-end
# Additional parameters not shown
)
# END FullVectorizerMistral

# clean up
client.collections.delete("DemoCollection")

# START BasicVectorizerOctoAI
from weaviate.classes.config import Configure

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -473,6 +473,20 @@ await client.collections.create({
// Clean up
await client.collections.delete('DemoCollection');

// START BasicVectorizerMistral
// TS support & code example coming soon
// END BasicVectorizerMistral

// Clean up
await client.collections.delete('DemoCollection');

// START FullVectorizerMistral
// TS support & code example coming soon
// END FullVectorizerMistral

// Clean up
await client.collections.delete('DemoCollection');

// START BasicVectorizerOctoAI
// Code example coming soon
// END BasicVectorizerOctoAI
Expand Down Expand Up @@ -621,7 +635,7 @@ await client.collections.create({
name: 'title_vector',
sourceProperties: ['title'],
resourceName: '<azure-resource-name>',
deploymentID: '<azure-deployment-id>',
deploymentId: '<azure-deployment-id>',
},
),
],
Expand All @@ -648,7 +662,7 @@ await client.collections.create({
name: 'title_vector',
sourceProperties: ['title'],
resourceName: '<azure-resource-name>',
deploymentID: '<azure-deployment-id>',
deploymentId: '<azure-deployment-id>',
// // Further options
// baseURL: '<custom_azure_url>'
},
Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/anthropic/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_anthropic.jpg
# tags: ['model providers', 'anthropic']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Anthropic offers a wide range of models for natural language processing and generation. Weaviate seamlessly integrates with Anthropic's APIs, allowing users to leverage Anthropic's models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/anyscale/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_anyscale.jpg
# tags: ['model providers', 'anyscale']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Anyscale offers a wide range of models for natural language processing and generation. Weaviate seamlessly integrates with Anyscale's Endpoints APIs, allowing users to leverage Anyscale's models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/aws/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_aws.jpg
# tags: ['model providers', 'aws']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

AWS offers a wide range of models for natural language processing and generation. Weaviate seamlessly integrates with AWS's APIs, allowing users to leverage AWS's models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/cohere/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_cohere.jpg
# tags: ['model providers', 'cohere']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Cohere offers a wide range of models for natural language processing and generation. Weaviate seamlessly integrates with Cohere's APIs, allowing users to leverage Cohere's models directly within the Weaviate database.

Expand Down
2 changes: 2 additions & 0 deletions developers/weaviate/model-providers/databricks/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@ image: og/docs/integrations/provider_integrations_databricks.jpg
# tags: ['model providers', 'databricks']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

:::info Added in `v1.26.3`
:::

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/friendliai/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_friendliai.jpg
# tags: ['model providers', 'friendliai']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

:::info Added in `v1.26.3`
:::
Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/google/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_google.jpg
# tags: ['model providers', 'google']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Google AI offers a wide range of models for natural language processing and generation. Weaviate seamlessly integrates with [Google AI Studio](https://ai.google.dev/?utm_source=weaviate&utm_medium=referral&utm_campaign=partnerships&utm_content=) and [Google Vertex AI](https://cloud.google.com/vertex-ai) APIs, allowing users to leverage Google AI's models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/gpt4all/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_gpt4all.jpg
# tags: ['model providers', 'gpt4all']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

The GPT4All library allows you to easily run a wide range of models on your own device. Weaviate seamlessly integrates with the GPT4All library, allowing users to leverage compatible models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/huggingface/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_huggingface.jpg
# tags: ['model providers', 'huggingface']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Hugging Face offers a wide range of models for natural language processing. Weaviate seamlessly integrates with Hugging Face's Inference API, allowing users to leverage Hugging Face Hub's models directly within the Weaviate database.

Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/imagebind/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_imagebind.jpg
# tags: ['model providers', 'huggingface', 'imagebind']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Meta's ImageBind library can be used with a wide range of models for natural language processing. Weaviate seamlessly integrates with the ImageBind library, allowing users to leverage compatible models directly within the Weaviate database.

Expand Down
2 changes: 1 addition & 1 deletion developers/weaviate/model-providers/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ This enables an enhanced developed experience, such as the ability to:
| [Google](./google/index.md) | [Text](./google/embeddings.md), [Multimodal](./google/embeddings-multimodal.md) | [Text](./google/generative.md) | - |
| [Hugging Face](./huggingface/index.md) | [Text](./huggingface/embeddings.md) | - | - |
| [Jina AI](./jinaai/index.md) | [Text](./jinaai/embeddings.md) | - | - |
| [Mistral](./mistral/index.md) | - | [Text](./mistral/generative.md) | - |
| [Mistral](./mistral/index.md) | [Text](./mistral/embeddings.md) | [Text](./mistral/generative.md) | - |
| [OctoAI](./octoai/index.md) | [Text](./octoai/embeddings.md) | [Text](./octoai/generative.md) | - |
| [OpenAI](./openai/index.md) | [Text](./openai/embeddings.md) | [Text](./openai/generative.md) | - |
| [Azure OpenAI](./openai-azure/index.md) | [Text](./openai-azure/embeddings.md) | [Text](./openai-azure/generative.md) | - |
Expand Down
1 change: 1 addition & 0 deletions developers/weaviate/model-providers/jinaai/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ image: og/docs/integrations/provider_integrations_jinaai.jpg
# tags: ['model providers', 'jinaai']
---

<!-- Note: for images, use https://docs.google.com/presentation/d/15opIcJuaIjEEcs_1Zm8B6pccox2p7_MHSjCnRv4dPfU/edit?usp=sharing -->

Jina AI offers a wide range of models for natural language processing. Weaviate seamlessly integrates with Jina AI's APIs, allowing users to leverage Jina AI's models directly within the Weaviate database.

Expand Down
Loading

0 comments on commit 0f9c8ec

Please sign in to comment.