Skip to content

Qualify post-v0.2 upstream changes with context ABI and FP8 CPU safety checks #20

Open

Description

@leehack

Triage

P2 / enhancement / owner qualification. The FP8 report is upstream-confirmed; exposure of our pinned artifact is NOT established.

Evidence and benefit

Our v0.2.0-3 manifest pins 3f8527a46c54ecf4cb4ed6003da8e8982283c73c (ggml 89c4413f). Raw main on 2026-10-15 was 120e3e875c5501c1babb50c0966122cb569d12d4 (ggml d25b121c).

New raw evidence — 2026-10-17

Current raw main/release: f0aac524d3f29140e60ba78f3cfb16d6acea87db / master-973-f0aac52. Owner, current main and published core 0.14.0 still pin v0.2.0-3 / 3f8527a46c54ecf4cb4ed6003da8e8982283c73c.

  • Windows UTF-8 model/CLI paths are now merged in #2144 (8c442fb0, first master-969) / #2145 (2f016e8e, first master-970). They remain absent from the owner artifact; test model and auxiliary/output paths separately.
  • #2148, 68285df3, adds MOSS-Image Base/SFT, Qwen3.5 encoder and external tokenizer requirements. Consumer llamadart#1166 owns distinct tokenizer/recipe work. Iris, Z-Image L2P and FLUX.3 remain raw-only too.
  • #2149 independently isolates Metal GROUP_NORM leaving batch items after the first unwritten in official master-968/969 libraries (CPU controls pass); batched CFG then returns white images. This is an upstream-reported candidate correctness gate, not proof our older pinned artifact is affected, and not the same mechanism as owner Metal: a failed GPU command buffer still returns an image as success #19's command-buffer failure.
  • #2147 refreshes ggml/removes conv1d workarounds. Latest raw CI succeeds after the earlier MUSA container failure; successful packaging is not model correctness evidence.

Additional acceptance: model-free asymmetric GROUP_NORM batch-1/batch-2 sentinels plus real-image batched/unbatched CFG controls on the exact candidate and pinned owner Metal library; fail closed or retain a supported unbatched route if affected. Cover MOSS tokenizer/FLUX.2 VAE loading (#2150 report lacks full logs) and Windows non-ASCII paths. Preserve SD#19 at P1 independent of mitigations or missing hardware.

Acceptance

  • Select an exact candidate; audit wrapper exports and struct sizes/offsets/default initialization. An appended pointer changes FFI layout; a pin-only update with old bindings is not acceptable.
  • Reproduce or explicitly bound FP8 CPU exposure on the pinned artifact and candidate. Add positive and negative controls ensuring fallback or an actionable refusal, never a process crash. Do not label current llamadart affected without evidence.
  • Preserve explicit on/off behavior when adopting auto modes; qualify CPU/Metal/Vulkan, mixed-device decisions, memory pressure, logs, cancellation and error-state recovery. Retain existing iOS direct-VAE refusal unless independently fixed.
  • Validate representative new families/components and reject unsupported weight variants; link consumer API work rather than claiming native support equals Dart support.
  • Produce digest/provenance-verified platform bundles, exports, Apple XCFramework minimum-OS/privacy/signing checks, then coordinate generated bindings, pins, request/capability mapping, docs and examples.
  • Keep existing owner Metal: a failed GPU command buffer still returns an image as success #19 and upstream video/VAE/HIP problems separate unless the exact candidate demonstrably fixes them.

Boundaries

Tracking/qualification only. This issue does not authorize publication, workflow dispatch, paid hardware runs, downstream pin changes, or weakening supported-channel policy. No PR-caused regression is alleged without a causal reproduction. Preserve immutable historical artifacts and record unavailable models/hardware explicitly; CPU/software fallback is not hardware GPU qualification.

Activity

  1. added
    enhancementNew feature or request
    priority:P2Important improvement or regression; schedule next
    on Oct 15, 2026
  2. leehack commented on Oct 15, 2026

    @leehack
    OwnerAuthor

    Consumer API dependencies: llamadart#1069 (MoSR/upscaling) and llamadart#1070 (Turbo sigma configuration). Existing owner #19 is triaged separately as P1 false-success correctness; upstream-update preparation does not silently close it.

  3. leehack commented on Oct 17, 2026

    @leehack
    OwnerAuthor

    Raw advanced to master-973-f0aac52, while published owner/core 0.14.0 image pin stays v0.2.0-3. Added merged Windows UTF-8 fixes, MOSS-Image / consumer #1166, and the exact official-library Metal GROUP_NORM batch defect #2149 as a candidate gate. Pinned exposure is unproven; owner #19 remains a separate P1. Raw CI 39009185406 succeeds; the prior failure was the MUSA container job, not evidence that every backend failed. No artifact, binding or public model-support upgrade is claimed.

  4. leehack commented on Oct 18, 2026

    @leehack
    OwnerAuthor

    2026-10-18 candidate delta: raw main is d55cc0f75f9f9c71af2a7b2fd6cf3c6d10420151; latest raw release remains master-973-f0aac52, owner/core image pin remains v0.2.0-3 (3f8527a46c54). #2160 adds MOSS split-QKV/host loading (consumer #1166); #2159 adds Diffusers MiniMax-H3 LoRA mappings/alpha semantics, not a new model family or current Dart video feature. New #2154 reports Krea2 AMD-dGPU OOM around the previously tracked memory-reclamation change; follow-up implicates FA/conv-mode interactions too, so causality is not settled. Add exact pinned/candidate controls with FA/conv on/off and memory headroom before treating the iGPU repair as universally safe. No pinned exposure is established; Metal #19 remains P1 and #2149 remains separate. Raw #2150 closed by installation correction, not a proven VAE patch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestpriority:P2Important improvement or regression; schedule next

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions