Skip to content

ggml-openvino: Optimize model recompiles of prefill stage - #428

Open
yzhou51 wants to merge 4 commits into
ravi9:dev_backend_openvinofrom
yzhou51:recompile-models
Open

yzhou51 wants to merge 4 commits into
ravi9:dev_backend_openvinofrom
yzhou51:recompile-models

ggml-openvino: match the output count before reusing a compiled NPU p…

f337ac1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view