All pull requests

Pull requests

• ROCm: cheaper IQ2_XXS sign expansion (decode gate/up and MMQ prefill)

  #1222·francosax opened Oct 16, 2026·

  ·

• server: let the memory-text tier survive images (fixes #1214)

  #1221·Flor1an-B opened Oct 16, 2026·

  ·
  1

• ROCm: make paired Q8_0 decode bit-exact; release test model maps

  #1220·francosax opened Oct 15, 2026·

  ·
  1

• Make the BPE tokenizer and detokenizer linear

  #1219·emilianbold opened Oct 15, 2026Contributor·

  ·
  1

• ROCm: tile the Q8_0 -> F16 transpose cache kernel

  #1218·francosax opened Oct 15, 2026·

  ·

• agent: stop a turn after repeated invalid tool calls

  #1217·emilianbold opened Oct 15, 2026Contributor·

  ·
  1

• kvstore: find the longest text-prefix checkpoint in one pass

  #1216·emilianbold opened Oct 15, 2026Contributor·

  ·
  1

• glm: skip MTP head/attention for discarded-output catch-up forwards

  #1213·Flor1an-B opened Oct 14, 2026·

  ·

• Fix Qwen Chat tool-turn disk keys for reasoning-echo histories

  #1212·fitchmultz opened Oct 13, 2026·

  ·
  1

  1

• ROCm 10.1: fix build, Q8_K rounding, prefill and DSpark BLAS selections

  #1210·francosax opened Oct 12, 2026·

  ·
  3

• Add MiMo V2.6 Flash MOPD support on Metal

  #1208·mvid opened Oct 11, 2026·

  ·

• Qwen3.8 Flash Next: +40% decode on one DGX Spark (prose), +46% (code)

  #1207·matrixfede opened Oct 11, 2026·

  ·
  1

• server: preserve Qwen Responses final-answer cache reuse

  #1206·mvdbos opened Oct 10, 2026·

  ·
  1

• Rewind the live GLM-5.3 KV to a snapshot instead of rebuilding the prompt

  #1205·williamxie1989 opened Oct 10, 2026·

  ·
  1

• Metal: fuse the V4.1 shared expert's gate, up and SwiGLU

  #1204·yijunyu opened Oct 10, 2026·

  ·

• server: live prefill/decode status via GET /v1/status + macOS menu bar

  #1203·williamxie1989 opened Oct 10, 2026·4 tasks done·

  ·

• Metal: retain bounded Qwen Responses prompt checkpoints

  #1200·mvdbos opened Oct 9, 2026·

  ·
  1

• Metal: reuse Q4_K raw loads in Qwen NAX prefill

  #1198·mvdbos opened Oct 9, 2026·

  ·
  1

• Accept WebP images on macOS via ImageIO

  #1197·joohooo opened Oct 9, 2026·

  ·
  3

• responses: heal the forked live checkpoint on a token-mismatch miss

  #1194·isgallagher opened Oct 7, 2026·

  ·

• rocm: fix host-side rsqrtf() call that breaks the ROCm build

  #1193·guessleej opened Oct 7, 2026·

  ·
  1

• metal: use shuffle network for non-causal top-k block sort

  #1192·emilianbold opened Oct 7, 2026Contributor·

  ·
  1

• Add qwen35moe CPU support for Qwen3.6 and Ornith

  #1191·simoltos opened Oct 7, 2026·

  ·

• Fix RTX PRO 6000 Blackwell CUDA builds by gating native FP4 MMQfix(cuda): resolve R6K sm_120 MMQ compilation failures

  #1190·gaowayne opened Oct 7, 2026·2 tasks done·

  ·
  1

• Add a Strix Halo (ROCm/gfx1151) benchmark harness and recorded baseline

  #1187·timlawrenz opened Oct 6, 2026·

  ·