Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LoRA Adapter #871

Draft
wants to merge 35 commits into
base: master
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
0cd4cc2
Switch to LoRA adapter merge in compile_model. Re-implement LoRA tens…
slyalin Aug 4, 2024
1ce8850
Merge remote-tracking branch 'origin/master' into dynamic_lora
slyalin Aug 4, 2024
d916d99
WIP: New LoRA variants ported to both LLMs and SD
slyalin Aug 5, 2024
2642357
Enable LoRA via env var in text gen pipeline. Suppress too bulky debu…
slyalin Aug 7, 2024
0fa8e30
LoRA weights in states
slyalin Aug 8, 2024
aa0568e
Set state for infer_request and don't use Constant in init expression…
slyalin Aug 8, 2024
fffa5ff
Fixed SD wtih separate A and B
slyalin Aug 13, 2024
afa7a77
[WIP] LoRA prototype refactoring for better LLMPipeline integration a…
slyalin Aug 16, 2024
6127fef
[WIP] LoRA Refactoring
slyalin Aug 17, 2024
863e81b
[WIP] LaRA refactored: restored functionality of both text and SD pip…
slyalin Aug 19, 2024
55dba14
Clean up the greedy sample with LoRA implemented set method for LoRA …
slyalin Aug 20, 2024
bcc7782
[WIP] Added a dedicated LoRA LLMPipeline generation sample, adjust Ad…
slyalin Aug 21, 2024
e80580e
Polish AdaptersConfig methods. Start chaning alphas in a more optimal…
slyalin Aug 21, 2024
5642179
[WIP] Complitelly OV-inference-based LoRA weights preparation.
slyalin Aug 23, 2024
57dd39d
Restored empty adapter functionality via two alternative ways: empty …
slyalin Aug 23, 2024
3ec4907
Added lora_greedy_causal_lm sample in build.
slyalin Aug 23, 2024
c87fdcf
Report compilation/preparation time in ms instead of sec.
slyalin Aug 23, 2024
d02fbee
Adjust sample to use adapters.remove instead of modifying alpha. Run …
slyalin Aug 23, 2024
08e3dcf
[WIP] Code refactoring: common part + SD
slyalin Aug 25, 2024
33321cb
Fixed old code path in SD with new multi-value lora command line para…
slyalin Aug 25, 2024
c4969fb
[WIP] Code clean up. Expose fuse mode in genai API by re-enabling fus…
slyalin Aug 25, 2024
0724a79
Migrated lcm sample to the new api. Fixed issue with old lora when al…
slyalin Aug 26, 2024
d7312d7
Simplifying high-level API: syntactic sugar for better short cuts and…
slyalin Aug 28, 2024
cae1592
Switched lora sample to GPU. Removed most of the debug output. Use MO…
slyalin Aug 29, 2024
863a050
Removed old LoRA impelementation from SD/LCM samples, removed Eigen d…
slyalin Sep 12, 2024
1f5c2ac
Removed setting default alpha in Adapter because of possible confused…
slyalin Sep 12, 2024
504735a
Remove obsolete flags from AdapterConfig and use mode directly. Remov…
slyalin Sep 12, 2024
777084c
Switched image generation samples to their default mode -- MODE_FUSE.
slyalin Sep 12, 2024
dc84ba4
Extend image generation REAMEs with a way to provide multiple LoRA ad…
slyalin Sep 13, 2024
5a10d6b
Merge remote-tracking branch 'origin/master' into dynamic_lora
slyalin Sep 13, 2024
75c5242
Removed obsolete parts in the code. Added more comments. Implemented …
slyalin Sep 13, 2024
7bfe9bd
Removed base class for AdapterControllerImpl moving all parts to a si…
slyalin Sep 16, 2024
9153494
More clear timings in image generation samples to report model load a…
slyalin Sep 16, 2024
48f90cd
Reverted changes in stable_diffusion Timer.
slyalin Sep 16, 2024
6764c18
Merge remote-tracking branch 'origin/master' into dynamic_lora
slyalin Sep 16, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fixed old code path in SD with new multi-value lora command line para…
…meter
  • Loading branch information
slyalin committed Aug 25, 2024
commit 33321cb2b7ff2fc477d94904c4b8dc042c70699c
2 changes: 1 addition & 1 deletion image_generation/stable_diffusion_1_5/cpp/src/main.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -173,7 +173,7 @@ StableDiffusionModels compile_models(const std::string& model_path,
#else
OPENVINO_ASSERT(lora_path.size() == 1, "Multiple LoRA adapters are not supported");
Timer t("Loading and multiplying LoRA weights");
lora_weights = read_lora_adapters(lora_path, alpha);
lora_weights = read_lora_adapters(lora_path[0], alpha[0]);
#endif
}

Expand Down