Skip to content

Run Generative AI models using native OpenVINO C++ API

License

Notifications You must be signed in to change notification settings

gklodkox/openvino.genai

Repository files navigation

GenAI Pipeline Repository

The GenAI repository contains pipelines that implement image and text generation tasks. The implementation uses OpenVINO capabilities to optimize the pipelines. Each sample covers a family of models and suggests certain modifications to adapt the code to specific needs. It includes the following pipelines:

  1. Benchmarking script for large language models
  2. Causal LM
  3. OpenVINO Stable Diffuison (with LoRA) C++ pipeline

Note

This project is not for production use.

License

The GenAI repository is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.

Requirements

Requirements may vary for different samples. See respective readme files for more details, and make sure to install the OpenVINO version listed there. Refer to documentation to see how to install OpenVINO.

About

Run Generative AI models using native OpenVINO C++ API

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 68.8%
  • C++ 29.6%
  • CMake 1.6%