Co-authored-by: Collin Dutter <collin@griptape.ai>

Co-authored-by: Collin Dutter <collin@griptape.ai>

…hat_template`. (#833)

…ansformers.TextGenerationPipeline`. (#832)

#831)

#849)

…ckGo (#869)

### Added
- `RagEngine` is an abstraction for implementing modular RAG pipelines.
  - `RagContext` is a container object for passing around RAG context. 
  - RAG stages:
    - `QueryRagStage` for parsing and expanding queries.
    - `RetrievalRagStage` for retrieving content.
    - `GenerationRagStage` for augmenting and generating outputs.
  - RAG modules:
    - Query:
      - `RelatedQueryGenerationRagModule` for generating related queries.
    - Retrieval:
      - `TextRetrievalRagModule` for retrieving text chunks.
      - `TextRerankRagModule` for re-ranking retrieved results.
    - Generation:
      - `MetadataGenerationRagModule` for appending metadata.
      - `RulesetsGenerationRagModule` for appending rulesets.
      - `PromptGenerationRagModule` for generating responses based on retrieved text chunks.
- `RagClient` tool for exposing `RagEngines` to LLM agents.
- `RagTask` task for including `RagEngines` in any structure.
- Rerank drivers:
  - `CohereRerankDriver` for using the Cohere rerank API.
- `utils.execute_futures_list()` for executing a list of futures.
- `LocalVectorStoreDriver.persist_file` for persisting vectors and chunks in a text file.
- `Entry.to_artifact()` for easy vector store entry conversions into Griptape artifacts.
- `BaseVectorStoreDriver.does_entry_exist()` to check if an entry exists in the vector store.

### Changed
- **BREAKING**: `BaseVectorStoreDriver.upsert_text_artifact()` and `BaseVectorStoreDriver.upsert_text()` use artifact/string values to generate `vector_id` if it wasn't implicitly passed. This change ensures that we don't generate embeddings for the same content every time.
- **BREAKING**: Removed `VectorQueryEngine` in favor of `RagEngine`.
- **BREAKING**: Removed `TextQueryTask` in favor of `RagTask`.
- **BREAKING**: `TextArtifactStorage` now requires `vector_store_driver` and `rag_engine` in place of `vector_query_engine`.
- **BREAKING**: Moved `load_artifacts()` from `BaseQueryEngine` to `BaseVectorStoreDriver`.
- **BREAKING**: Merged `BaseVectorStoreDriver.QueryResult` into `BaseVectorStoreDriver.Entry`.
- **BREAKING**: Replaced `query_engine` with `vector_store_driver` in `VectorStoreClient`.

…w accept callables instead of futures (#910)

Co-authored-by: Collin Dutter <collin@griptape.ai>

…istenerDriver.publish_event() (#919)

Co-authored-by: hkhajgiwale <hkhajgiwale@paloaltonetworks.com>
Co-authored-by: Harsh Khajgiwale <13365920+hkhajgiwale@users.noreply.github.com>
Co-authored-by: Anush <anushshetty90@gmail.com>

…d more (#942)

Co-authored-by: Collin Dutter <collin@griptape.ai>