Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs Search Improvements #1004

Merged
merged 4 commits into from
Jul 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/gen_ref_pages.py
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ def build_reference_docs() -> None:
mkdocs_gen_files.set_edit_path(full_doc_path, Path("..") / path)

with mkdocs_gen_files.open("reference/SUMMARY.md", "w") as nav_file:
nav_file.writelines(["---", "search:", "\texclude: true", "---\n"])
nav_file.writelines(["---\n", "search:\n", "\x20\x20exclude: true\n", "---\n"])
nav_file.writelines(nav.build_literate_nav())
with mkdocs_gen_files.open("reference/griptape/index.md", "w") as index_file:
index_file.write(
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/data/artifacts.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---
dylanholmes marked this conversation as resolved.
Show resolved Hide resolved

## Overview

**[Artifacts](../../reference/griptape/artifacts/base_artifact.md)** are used for passing different types of data between Griptape components. All tools return artifacts that are later consumed by tasks and task memory.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/data/chunkers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Chunkers are used to split arbitrarily long text into chunks of certain token length.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/data/loaders.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Loaders are used to load textual data from different sources and chunk it into [TextArtifact](../../reference/griptape/artifacts/text_artifact.md)s.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

[Audio Transcription Drivers](../../reference/griptape/drivers/audio_transcription/index.md) extract text from spoken audio.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

You can persist and load memory by using Conversation Memory Drivers. You can build drivers for your own data stores by extending [BaseConversationMemoryDriver](../../reference/griptape/drivers/memory/conversation/base_conversation_memory_driver.md).
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/embedding-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview
Embeddings in Griptape are multidimensional representations of text data. Embeddings carry semantic information, which makes them useful for extracting relevant chunks from large bodies of text for search and querying.

Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/event-listener-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Event Listener Drivers are used to send Griptape [Events](../misc/events.md) to external services.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/image-generation-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

[Image Generation Drivers](../../reference/griptape/drivers/image_generation/index.md) are used by [image generation Engines](../engines/image-generation-engines.md) to build and execute API calls to image generation models.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/image-query-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Image Query Drivers are used by [Image Query Engines](../engines/image-query-engines.md) to execute natural language queries on the contents of images. You can specify the provider and model used to query the image by providing the Engine with a particular Image Query Driver.
Expand Down
16 changes: 11 additions & 5 deletions docs/griptape-framework/drivers/observability-drivers.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,20 @@
# Observability Drivers
---
search:
boost: 2
---

## Overview

Observability Drivers are used by [Observability](../structures/observability.md) to send telemetry (metrics and traces) related to the execution of an LLM application. The telemetry can be used to monitor the application and to diagnose and troubleshoot issues. All Observability Drivers implement the following methods:

* `__enter__()` sets up the Driver.
* `__exit__()` tears down the Driver.
* `observe()` wraps all functions and methods marked with the `@observable` decorator. At a bare minimum, implementations call the wrapped function and return its result (a no-op). This enables the Driver to generate telemetry related to the invocation's call arguments, return values, exceptions, latency, etc.

## Griptape Cloud

## Observability Drivers

### Griptape Cloud

!!! info
This driver requires the `drivers-observability-griptape-cloud` [extra](../index.md#extras).
Expand Down Expand Up @@ -34,7 +42,7 @@ with Observability(observability_driver=observability_driver):
```


## OpenTelemetry
### OpenTelemetry

!!! info
This driver requires the `drivers-observability-opentelemetry` [extra](../index.md#extras).
Expand Down Expand Up @@ -188,5 +196,3 @@ Output (only relevant because of use of `ConsoleSpanExporter`):
}
}
```


5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/prompt-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Prompt Drivers are used by Griptape Structures to make API calls to the underlying LLMs. [OpenAi Chat](#openai-chat) is the default prompt driver used in all structures.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/sql-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview
SQL drivers can be used to make SQL queries and load table schemas. They are used by the [SqlLoader](../../reference/griptape/loaders/sql_loader.md) to process data. All loaders implement the following methods:

Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/structure-run-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview
Structure Run Drivers can be used to run Griptape Structures in a variety of runtime environments.
When combined with the [Structure Run Task](../../griptape-framework/structures/tasks.md#structure-run-task) or [Structure Run Client](../../griptape-tools/official-tools/structure-run-client.md) you can create complex, multi-agent pipelines that span multiple runtime environments.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/text-to-speech-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

[Text to Speech Drivers](../../reference/griptape/drivers/text_to_speech/index.md) are used by [Text To Speech Engines](../engines/audio-engines.md) to build and execute API calls to audio generation models.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/vector-store-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Griptape provides a way to build drivers for vector DBs where embeddings can be stored and queried. Every Vector Store Driver implements the following methods:
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/web-scraper-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Web Scraper Drivers can be used to scrape text from the web. They are used by [WebLoader](../../reference/griptape/loaders/web_loader.md) to provide its functionality. All Web Scraper Drivers implement the following methods:
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/drivers/web-search-drivers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Web Search Drivers can be used to search for links from a search query. They are used by [WebSearch](../../reference/griptape/tools/web_search/tool.md) to provide its functionality. All Web Search Drivers implement the following methods:
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/engines/audio-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

[Audio Generation Engines](../../reference/griptape/engines/audio/index.md) facilitate audio generation. Audio Generation Engines provides a `run` method that accepts the necessary inputs for its particular mode and provides the request to the configured [Driver](../drivers/text-to-speech-drivers.md).
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/engines/extraction-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview
Extraction Engines in Griptape facilitate the extraction of data from text formats such as CSV and JSON.
These engines play a crucial role in the functionality of [Extraction Tasks](../../griptape-framework/structures/tasks.md).
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/engines/image-generation-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

[Image Generation Engines](../../reference/griptape/engines/image/index.md) facilitate text-to-image and image-to-image generation. Each Engine provides a `run` method that accepts the necessary inputs for its particular mode and provides the request to the configured [Driver](../drivers/image-generation-drivers.md).
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/engines/image-query-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Image Query Engines

The [Image Query Engine](../../reference/griptape/engines/image_query/image_query_engine.md) allows you to perform natural language queries on the contents of images. You can specify the provider and model used to query the image by providing the Engine with a particular [Image Query Driver](../drivers/image-query-drivers.md).
Expand Down
7 changes: 6 additions & 1 deletion docs/griptape-framework/engines/rag-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## RAG Engines

!!! note
Expand Down Expand Up @@ -69,4 +74,4 @@ engine = RagEngine(
print(
engine.process_query("what are Griptape agents?").output.to_text()
)
```
```
5 changes: 5 additions & 0 deletions docs/griptape-framework/engines/summary-engines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Summary engines are used to summarize text and collections of [TextArtifact](../../reference/griptape/artifacts/text_artifact.md)s.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/misc/events.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

You can use [EventListener](../../reference/griptape/events/event_listener.md)s to listen for events during a Structure's execution.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/misc/tokenizers.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Tokenizers are used throughout Griptape to calculate the number of [tokens](https://learn.microsoft.com/en-us/semantic-kernel/prompt-engineering/tokens) in a piece of text.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/agents.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

An [Agent](../../reference/griptape/structures/agent.md) is the quickest way to get started with Griptape.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/config.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

The [StructureConfig](../../reference/griptape/config/structure_config.md) class allows for the customization of Structures within Griptape, enabling specific settings such as Drivers to be defined for Tasks.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/conversation-memory.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

You can use Conversation Memory to give Griptape Structures the ability to keep track of the conversation across runs. All structures are created with [ConversationMemory](../../reference/griptape/memory/structure/conversation_memory.md) by default.
Expand Down
7 changes: 6 additions & 1 deletion docs/griptape-framework/structures/observability.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

The [Observability](../../reference/griptape/observability/observability.md) context manager sends telemetry (metrics and traces) for all functions and methods annotated with the `@observable` decorator to a destination of your choice. This is useful for monitoring and debugging your application.
Expand Down Expand Up @@ -54,4 +59,4 @@ observability_driver = GriptapeCloudObservabilityDriver()
with Observability(observability_driver=observability_driver):
my_function()
MyClass().my_method()
```
```
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/pipelines.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview
A [Pipeline](../../reference/griptape/structures/pipeline.md) is very similar to an [Agent](../../reference/griptape/structures/agent.md), but allows for multiple tasks.

Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/rulesets.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

A [Ruleset](../../reference/griptape/rules/ruleset.md) can be used to define rules for [Structures](../structures/agents.md) and [Tasks](../structures/tasks.md).
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/task-memory.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

Task Memory is a powerful feature of Griptape that allows you to control where the data returned by [Tools](../tools/index.md) is stored. This is useful in the following scenarios:
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/tasks.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

A [Task](../../reference/griptape/tasks/index.md) is a purpose-built abstraction for the Large Language Model (LLM). Griptape offers various types of Tasks, each suitable for specific use cases.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/structures/workflows.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

A [Workflow](../../reference/griptape/structures/workflow.md) is a non-sequential DAG that can be used for complex concurrent scenarios with tasks having multiple inputs.
Expand Down
5 changes: 5 additions & 0 deletions docs/griptape-framework/tools/index.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
---
search:
boost: 2
---

## Overview

One of the most powerful features of Griptape is the ability to use tools that can interact with the outside world.
Expand Down
2 changes: 2 additions & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ nav:
- Conversation Memory: "griptape-framework/structures/conversation-memory.md"
- Rulesets: "griptape-framework/structures/rulesets.md"
- Config: "griptape-framework/structures/config.md"
- Observability: "griptape-framework/structures/observability.md"
collindutter marked this conversation as resolved.
Show resolved Hide resolved
- Tools:
- Overview: "griptape-framework/tools/index.md"
- Building Custom Tools: "griptape-tools/custom-tools/index.md"
Expand All @@ -113,6 +114,7 @@ nav:
- Text to Speech Drivers: "griptape-framework/drivers/text-to-speech-drivers.md"
- Audio Transcription Drivers: "griptape-framework/drivers/audio-transcription-drivers.md"
- Web Search Drivers: "griptape-framework/drivers/web-search-drivers.md"
- Observability Drivers: "griptape-framework/drivers/observability-drivers.md"
- Data:
- Overview: "griptape-framework/data/index.md"
- Artifacts: "griptape-framework/data/artifacts.md"
Expand Down
Loading