Skip to content

ui: configure a model's load and sampling settings in a pane on the Models page - #36

Draft
allozaur wants to merge 6 commits into
allozaur/feat/prompt-libraryfrom
allozaur/feat/model-configuration
Draft

allozaur wants to merge 6 commits into
allozaur/feat/prompt-libraryfrom
allozaur/feat/model-configuration

Conversation

@allozaur

@allozaur allozaur commented Nov 2, 2026 •

Copy link
Copy Markdown
Owner

Overview

A model's load and sampling settings can be adjusted and saved in a configuration pane on the Models page, and are applied the next time it loads.

Additional information

Outside the work-in-progress stack on the fork, based on allozaur/feat/prompt-library (#29), so that the storage layer (#39) can sit on top of it with the prompt library under it too. Since 12 November the design system (#22) is below the prompt library, and since 13 November Llama Harness (#55) and MCP as an extension (#61) are too, so this layer imports its base components from @ggml-org/llama-ui; the pane's own sizes are still master's fixed ones, and its Slider stays in the app for now. Its diff is only this layer, and its files are under ui/apps/chat now that the stack starts with the move to ui/ (#54).

The model configuration pane from ggml-org#29587, rebased onto this stack. Only its own commits came along: the ones under them were an older copy of the servers work and of Discover, which master already has. The upstream PR and its branch are unchanged.

What changed in the rebase
  • The pane mounts in master's ModelsManagerModelDrawer, which holds the saved overrides and loads with their arguments. "Mount the configuration pane as a drawer in the manager" was skipped: that drawer already does it.
  • The overrides, load arguments, draft and size helpers the pane needs are back in ModelsManager/utils.ts, with drafts read through the servers' model lists.
  • The OpenAI-compatible gates are gone, as llama.cpp servers are the only kind now; the header names the server instead.
  • The tools submenu keeps the stack's tab offset.
Commits (6)
  • ui : add the model configuration pane
  • ui : resolve bundled icon paths against the app base path
  • ui : animate the tools submenu expansion
  • ui : let the delete action scroll with the model it removes
  • ui : adapt the model configuration pane to the stack
  • ui: keep the model settings pane on master's styles until the design system lands
Testing
  • Type-check passes on this layer with 0 errors; 230 client and 789 unit tests pass.
  • Lint and formatting are clean on every touched file.
  • Not tried in the browser yet: opening the pane, saving settings and loading with them.

Requirements

@allozaur
allozaur added this pull request to stack #37 November 2, 2026 14:32
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 00807c9 to 1f901ba Compare November 2, 2026 14:41
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from 62dbc6b to 8bda0fc Compare November 3, 2026 10:02
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 1f901ba to 14cf1da Compare November 3, 2026 10:02
@allozaur
allozaur removed this pull request from stack #37 November 3, 2026 10:02
@allozaur
allozaur added this pull request to stack #41 November 3, 2026 10:03
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 14cf1da to e26116c Compare November 9, 2026 10:05
@allozaur
allozaur removed this pull request from stack #41 November 9, 2026 10:06
@allozaur
allozaur added this pull request to stack #42 November 9, 2026 10:06
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch 3 times, most recently from ab47faf to f301dfb Compare November 9, 2026 11:56
@allozaur
allozaur force-pushed the allozaur/feat/servers branch 2 times, most recently from 7fbabe8 to e7a2c6b Compare November 9, 2026 12:44
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from f301dfb to 41c3e66 Compare November 9, 2026 12:44
@allozaur
allozaur removed this pull request from stack #42 November 9, 2026 12:45
@allozaur
allozaur added this pull request to stack #44 November 9, 2026 12:45
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 41c3e66 to b640ec5 Compare November 9, 2026 14:35
@allozaur
allozaur removed this pull request from stack #44 November 9, 2026 14:36
@allozaur
allozaur added this pull request to stack #46 November 9, 2026 14:37
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from b640ec5 to efa16d4 Compare November 9, 2026 15:06
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from 8be6ea1 to 6a2834b Compare November 9, 2026 15:24
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from efa16d4 to 04e2447 Compare November 9, 2026 15:24
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from 6a2834b to c4d1026 Compare November 9, 2026 16:03
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 04e2447 to 51d425b Compare November 9, 2026 16:03
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from c4d1026 to 16c93c9 Compare November 9, 2026 16:26
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch 2 times, most recently from 1e0e5e6 to 73c3fba Compare November 9, 2026 16:35
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from 16c93c9 to 3187ad3 Compare November 9, 2026 16:35
@allozaur
allozaur changed the base branch from allozaur/feat/prompt-library to allozaur/feat/servers November 10, 2026 17:23
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from bedb78f to f93c93a Compare November 10, 2026 18:04
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from f43fa70 to d9e5ba2 Compare November 10, 2026 18:04
@allozaur
allozaur force-pushed the allozaur/feat/servers branch from f93c93a to 40f1f78 Compare November 12, 2026 01:29
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from d9e5ba2 to 44e3ef4 Compare November 12, 2026 01:29
allozaur added a commit that referenced this pull request Nov 12, 2026
Replayed onto develop: the PR branch sits on a stale copy of the stack.
@allozaur
allozaur changed the base branch from allozaur/feat/servers to allozaur/feat/prompt-library November 12, 2026 11:15
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 44e3ef4 to 9c8d0f1 Compare November 12, 2026 11:16
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from 12fb4f6 to cb9c4bd Compare November 12, 2026 20:55
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 9c8d0f1 to c9b2fb9 Compare November 12, 2026 20:55
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from cb9c4bd to 418c747 Compare November 12, 2026 23:00
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from c9b2fb9 to d608f13 Compare November 12, 2026 23:00
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from 418c747 to cb51e44 Compare November 13, 2026 20:39
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from d608f13 to 5437322 Compare November 13, 2026 20:39
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from cb51e44 to 8267ecc Compare November 16, 2026 07:05
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 5437322 to 40db7f7 Compare November 16, 2026 07:05
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from 8267ecc to 2309d14 Compare November 16, 2026 08:19
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 40db7f7 to 848a9bd Compare November 16, 2026 08:19
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from 2309d14 to 295bd1f Compare November 16, 2026 09:24
@allozaur
allozaur force-pushed the allozaur/feat/model-configuration branch from 848a9bd to 217473c Compare November 16, 2026 09:24
@allozaur
allozaur force-pushed the allozaur/feat/prompt-library branch from 295bd1f to 40ecb0d Compare November 16, 2026 10:42
allozaur and others added 6 commits November 17, 2026 23:35
The pane shows a model's information, load and inference settings side by
side: what its provider reports, the Hub records it falls back to, the
load controls gated by what the serving backend can do, and the
per-model overrides the load form writes. The slider control arrives
with it.

Assisted-by: pi:llama.cpp/DeepSeek-V4.1-Flash
Serve the recommended MCP server favicons and the Hugging Face badge from
the app's base path, not the domain root, so they resolve when the app is
mounted under a path. Also normalizes the safe HTML config indentation.

Assisted-by: pi:GLM-5.3-Flash
The tool groups in the add menu expand with a measured height
transition instead of a Collapsible, so the rows animate in every
browser, and collapsed rows leave the tab order.

Assisted-by: pi
It sat pinned just above the pane's edge on a phone, where the actions bar below
it is the only thing that should stay put.

Assisted-by: pi (zai-org/GLM-5.3-Flash)
The load and inference tabs size their icons with the stack's icon tokens
instead of fixed heights and widths.

Assisted-by: Claude (Opus 5.5 Medium)
…system lands

Assisted-by: Claude (Opus 5.5 Medium)

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants