Skip to content

Release 0.3.0 - #42

Merged
Josephrp merged 5 commits into
mainfrom
dev
Nov 16, 2026
Merged

Josephrp merged 5 commits into
mainfrom
dev

Conversation

@Josephrp

Copy link
Copy Markdown
Contributor

Release 0.3.0

Bumps version 0.2.0 → 0.3.0 (pyproject.toml, ccbt/__init__.py, uv.lock, changelogs) on top of the XET G9 claim flip (#41, already on dev).

Contents

  • XET is now supported: all 20 claims (C1–C20) flipped from experimental to supported after the G9 big-bang gate passed on local live evidence (real hf_xet/huggingface_hub/git-lfs against ccbt CAS/Hub on loopback, external OpenXet CAS cross-test, HF production CAS check). Full evidence transcript is in Flip XET claims C1-C20 to supported after G9 live gate #41.
  • CAS shard-upload v2 upstream ShardUploadEvent frames; Hub API compatibility with modern huggingface_hub.
  • check_xet_claims.py --release exits 0.

Verification

  • validate_version.py passes; ccbt.__version__ == "0.3.0".
  • Pre-commit hooks pass (pytest-fast hook run manually as the identical selective command: full unit suite 7,557 passed; 2 order-dependent failures — test_shutdown_udp_tracker, test_incoming_update_refreshes_stale_file_hash_manifest — both pass in isolation and are unrelated to this bump).

Merging this PR brings main to the release commit; tag v0.3.0 follows on the merge commit to trigger the Release and PyPI workflows.

0hiana and others added 3 commits November 15, 2026 21:31
Live evidence (local only, never CI): dev/scripts/run_xet_live_gate.py drives real hf_xet/huggingface_hub/git-lfs against ccbt CAS/Hub on loopback, cross-tests ccbt CasHttpClient and hf_xet against an external OpenXet CAS (ggoggam/openxet @ 6bf5021), plus native golden/e2e/transport/consensus suites. All 8 steps pass; identical Xet file hash across ccbt CAS, hf_xet, and external CAS.

Fixes found by the live gate: CAS shard-upload v2 now emits upstream ShardUploadEvent frames; Hub API modern huggingface_hub compatibility (repo URL, preupload, commitOid, delete); sync-client deadlock in hub interop test.
## Summary

Flips all 20 XET claims (C1–C20) in `dev/xet-claim-registry.yaml` from
`experimental` to `supported` (big-bang, per release policy), after the
G9 gate passed on **local live evidence**. No version bump, no merge to
`main`, no tag — release execution waits for explicit approval.

## Live evidence (local only, never CI)

Harness: `dev/scripts/run_xet_live_gate.py` (under `dev/scripts/`,
outside `tests/`, so CI never collects it). It starts the real ccbt
CAS/Hub on loopback and drives them with real `hf_xet` 1.8.0 /
`huggingface_hub` 2.4.0 / git 2.56 / git-lfs 3.8, cross-tests against a
real external Xet CAS server, and runs the native suites as subprocess
pytest steps.

```
XET live gate evidence
{
  "commit": "9da26cbb56e9550049b9b49cc3fe039870f69f1f",
  "python": "3.12.8",
  "hf": "hf_xet=1.8.0 huggingface_hub=2.4.0",
  "git": "git version 2.56.0.windows.1",
  "git_lfs": "git-lfs/3.8.0",
  "docker": "Docker version 29.9.2",
  "external_cas_endpoint": "http://127.0.0.1:8080",
  "external_cas_note": "ggoggam/openxet @ 6bf5021460695f45e8c73cd93e54cd343b4b41ec (Docker compose.local.yaml, auth disabled, fallback for stubbi/openxet); HF production CAS also verified separately (upload/download byte-identical, throwaway repo deleted)"
}

[PASS] server-startup (3.4s) cas+hub responding
[PASS] ccbt-cas-roundtrip (3.7s) file_hash=98da4fde90579f1fb1c029bf6fbd6d8eb19f2eb3856cb700a006c7e4b19c8973 bytes=3158073 chunks=33 first_inserted=True sha256=bf9e0c440b1d1e65cf26605ee93f264a4d47fba7cf42d0b4e58918d09988d8ff
[PASS] hf_xet-to-ccbt-cas (0.3s) xet_hash=98da4fde90579f1fb1c029bf6fbd6d8eb19f2eb3856cb700a006c7e4b19c8973 bytes=3158073
[PASS] huggingface_hub-to-ccbt-hub (2.3s) repo=alice/live-gate upload+download byte-identical, repo deleted
[PASS] git-lfs-git-xet-roundtrip (44.3s) 1 passed
[PASS] native-golden-e2e-transport-consensus (28.4s) 28 passed
[PASS] ccbt-client-to-external-cas (4.2s) file_hash=98da4fde90579f1fb1c029bf6fbd6d8eb19f2eb3856cb700a006c7e4b19c8973 bytes=3158073 chunks=33 first_inserted=True
[PASS] hf_xet-to-external-cas (0.2s) xet_hash=98da4fde90579f1fb1c029bf6fbd6d8eb19f2eb3856cb700a006c7e4b19c8973 bytes=3158073
OVERALL: PASS
```

Key interop facts:

- The **same Xet file hash** (`98da4fde…`) is produced/consumed by ccbt
CAS, stock `hf_xet`, and the external OpenXet server, in both directions
(ccbt-uploaded file downloaded by `hf_xet`; `hf_xet`-side hash matching
ccbt's).
- External CAS: ggoggam/openxet @
`6bf5021460695f45e8c73cd93e54cd343b4b41ec` (recorded in
`dev/xet-conformance.lock.json`). stubbi/openxet remains the canonical
wire-contract reference; it needs a Rust source build, so the
Docker-ready fallback was used, as the gate plan allows. HF production
CAS (`cas-server.xethub.hf.co`) was also verified separately: 3 MB Xet
upload + byte-identical download via `huggingface_hub`, throwaway
private repo deleted.

## Real bugs the live gate found (fixed here)

- CAS shard-upload v2 emitted `{"status": "validating"}` frames that
stock `hf_xet` rejects; now emits upstream `ShardUploadEvent` frames
(`validating`/`committing`/`result`, `type`-tagged), and `CasHttpClient`
parses them (backward compatible).
- Hub API vs modern `huggingface_hub`: repo URL shape (`{base}/{name}`),
`name`+`organization` payloads, `preupload` endpoint,
`commitOid`/`commitUrl`, `X-Repo-Commit`, and repo deletion
(`DELETE`/`POST /api/repos/delete` + `RepoStore.delete_repo`).
- `test_interop_hub_huggingface_hub` deadlocked (sync hub client
blocking the in-process test server loop; previously only skipped in CI)
— now runs the sync client via `asyncio.to_thread`.

## Verification

- `python dev/scripts/check_xet_claims.py` → `claims=20 warnings=0
errors=0`
- `python dev/scripts/check_xet_claims.py --release` → exit 0
- Regenerated `docs/en/xet-support-matrix.md` (status-aware generator
wording) and `dev/xet-release-checklist.md`: all rows `supported`
- Affected tests: 12 passed (`test_cas_server`, `test_xet_cas_http`,
`test_hub_git_xet`)
- Pre-commit (ruff, ruff-format, compatibility-linter, ty, bandit,
pytest-fast, validators): all pass

## HOLD

Per the gate plan, this stops at `dev`. Do **not** bump to 0.3.0, merge
to `main`, tag, or publish until release execution is explicitly
approved.
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 15, 2026 23:39 — with GitHub Actions Inactive
Shards upload .coverage with include-hidden-files under unique per-shard names so merge-multiple download cannot overwrite them; coverage job gates Codecov on an explicit combine output (hashFiles ignored the gitignored outputs), emits coverage.xml for Codecov and coverage-htmlcov for docs. Build Documentation now downloads that HTML from the successful Test run for the same SHA instead of re-running the full pytest suite, falling back to the placeholder page when no artifact exists. README badge URL normalized to ccBitTorrent / app.codecov.io.
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@Josephrp
Josephrp temporarily deployed to approval-required November 16, 2026 09:07 — with GitHub Actions Inactive
@codecov

codecov Bot commented Nov 16, 2026

Copy link
Copy Markdown

Welcome to Codecov 🎉

Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.

ℹ️ You can also turn on project coverage checks and project coverage reporting on Pull Request comment

Thanks for integrating Codecov - We've got you covered ☂️

Replace tight sleep(0.2) vs join(0.1) races with a blocking Event so TimeoutError is deterministic under load/coverage (same flake as test_timeout_for_tracker_requests_timeout on macos unit-session-storage).

This branch was successfully deployed

1 active deployment
approval-required — 6447d57c Deployed Nov 16, 2026 by Josephrp via build-docs #37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants