[Engine] Opt-in routed prompt stream: skip streamed experts no token routes to (follow-up read time -18%, same output) - #4283

[Engine] Opt-in routed prompt stream: skip streamed experts no token routes to (follow-up read time -18%, same output)#4283

bitaccesscomau wants to merge 1 commit into

Niko1221:mainNiko1221/Strata:mainfrom

bitaccesscomau:pr/prefill-routed-streambitaccesscomau/Strata:pr/prefill-routed-streamCopy head branch name to clipboard