Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update OpenAI image query default model to GPT-4o #802

Merged
merged 10 commits into from
May 23, 2024

Conversation

andrewfrench
Copy link
Member

@andrewfrench andrewfrench commented May 23, 2024

Update docs and configurations to use GPT-4o to power image queries. Rename OpenAI Image Query Drivers (and descendants) to not specify Vision in their names.


📚 Documentation preview 📚: https://griptape--802.org.readthedocs.build//802/

@@ -69,7 +69,7 @@ class AzureOpenAiStructureConfig(StructureConfig):
)
image_query_driver: BaseImageQueryDriver = field(
default=Factory(
lambda self: AzureOpenAiVisionImageQueryDriver(
lambda self: AzureOpenAiImageQueryDriver(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you update the model to gpt-4o here too since its available?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sick, will do.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as well as the prompt driver too

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need a similar Azure deployment note here for GPT-4o?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nope, gpt-4o is its own model in the portal

Copy link

codecov bot commented May 23, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

📢 Thoughts on this report? Let us know!

vachillo
vachillo previously approved these changes May 23, 2024
Copy link
Member

@vachillo vachillo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, just add a note in the changelog about the azure config updates

from griptape.engines import ImageQueryEngine
from griptape.loaders import ImageLoader

driver = AzureOpenAiVisionImageQueryDriver(
driver = AzureOpenAiImageQueryDriver(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AZURE_OPENAI_ENDPOINT_3 and AZURE_OPENAI_API_KEY_3 can be changed to use _2, and the model and azure_deployment can be changed to gpt-4o. sorry should have clarified this.

@andrewfrench andrewfrench merged commit 04af7d1 into dev May 23, 2024
12 checks passed
@andrewfrench andrewfrench deleted the french/240523/image-query-gpt-4o branch May 23, 2024 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants