[FEA] add split and retry integration tests for GpuGenerate #10185
Labels
reliability
Features to improve reliability or bugs that severly impact the reliability of the plugin
test
Only impacts tests
We currently don't test with split and retry in our python integration tests. This issue would be the first time we do this, specifically for
GpuGenerateExec
, as that where I noticed it last.Currently our CI cycles between injecting or not injecting retry randomly. I think we should consider injecting split and retry, if and only if the scope is equipped to support it.
This issue is blocked on: #10184. Both could be solved in the same (this) ticket.
The text was updated successfully, but these errors were encountered: