-
Notifications
You must be signed in to change notification settings - Fork 162
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Release/v0.33.0 #1243
Release/v0.33.0 #1243
Conversation
### Added - `RagEngine` is an abstraction for implementing modular RAG pipelines. - `RagContext` is a container object for passing around RAG context. - RAG stages: - `QueryRagStage` for parsing and expanding queries. - `RetrievalRagStage` for retrieving content. - `GenerationRagStage` for augmenting and generating outputs. - RAG modules: - Query: - `RelatedQueryGenerationRagModule` for generating related queries. - Retrieval: - `TextRetrievalRagModule` for retrieving text chunks. - `TextRerankRagModule` for re-ranking retrieved results. - Generation: - `MetadataGenerationRagModule` for appending metadata. - `RulesetsGenerationRagModule` for appending rulesets. - `PromptGenerationRagModule` for generating responses based on retrieved text chunks. - `RagClient` tool for exposing `RagEngines` to LLM agents. - `RagTask` task for including `RagEngines` in any structure. - Rerank drivers: - `CohereRerankDriver` for using the Cohere rerank API. - `utils.execute_futures_list()` for executing a list of futures. - `LocalVectorStoreDriver.persist_file` for persisting vectors and chunks in a text file. - `Entry.to_artifact()` for easy vector store entry conversions into Griptape artifacts. - `BaseVectorStoreDriver.does_entry_exist()` to check if an entry exists in the vector store. ### Changed - **BREAKING**: `BaseVectorStoreDriver.upsert_text_artifact()` and `BaseVectorStoreDriver.upsert_text()` use artifact/string values to generate `vector_id` if it wasn't implicitly passed. This change ensures that we don't generate embeddings for the same content every time. - **BREAKING**: Removed `VectorQueryEngine` in favor of `RagEngine`. - **BREAKING**: Removed `TextQueryTask` in favor of `RagTask`. - **BREAKING**: `TextArtifactStorage` now requires `vector_store_driver` and `rag_engine` in place of `vector_query_engine`. - **BREAKING**: Moved `load_artifacts()` from `BaseQueryEngine` to `BaseVectorStoreDriver`. - **BREAKING**: Merged `BaseVectorStoreDriver.QueryResult` into `BaseVectorStoreDriver.Entry`. - **BREAKING**: Replaced `query_engine` with `vector_store_driver` in `VectorStoreClient`.
…w accept callables instead of futures (#910)
Co-authored-by: Collin Dutter <collin@griptape.ai>
…istenerDriver.publish_event() (#919)
Co-authored-by: hkhajgiwale <hkhajgiwale@paloaltonetworks.com> Co-authored-by: Harsh Khajgiwale <13365920+hkhajgiwale@users.noreply.github.com> Co-authored-by: Anush <anushshetty90@gmail.com>
Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
591243c
to
74a003a
Compare
Codecov ReportAttention: Patch coverage is 📢 Thoughts on this report? Let us know! |
- **BREAKING**: Removed `loaders-dataframe` and `loaders-audio` extras as they are no longer needed. | ||
- **BREKING**: `TextLoader`, `PdfLoader`, `ImageLoader`, and `AudioLoader` now take a `str | PathLike` instead of `bytes`. Passing `bytes` is still supported but deprecated. | ||
- **BREAKING**: Removed `DataframeLoader`. | ||
- **BREAKING**: Update `pypdf` dependency to `^5.0.1`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
duplicate pypdf & redis entries (L51-52)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good catch, updated
MIGRATION.md
Outdated
pip install torch | ||
``` | ||
|
||
### Removed `MediaArtifact` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Duplicate?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, migration guide was messed up.
689e4e7
to
31e6c5f
Compare
Describe your changes
Release
0.33.0
Issue ticket number and link
NA
📚 Documentation preview 📚: https://griptape--1243.org.readthedocs.build//1243/