Expose native FP32 recurrent state storage for ExLlamaV3 - #503

Expose native FP32 recurrent state storage for ExLlamaV3#503

turboderp merged 1 commit into

theroyallab:maintheroyallab/tabbyAPI:mainfrom

Tsury:fp32-recurrent-state-optionTsury/tabbyAPI:fp32-recurrent-state-optionCopy head branch name to clipboard