Skip to content

Use the serialization_test_data/<lang>_generated_files layout - #14

Merged
tisonkun merged 5 commits into
mainfrom
issue-11-test-data-layout
Oct 4, 2026
Merged

tisonkun merged 5 commits into
mainfrom
issue-11-test-data-layout

Conversation

@leerho

@leerho leerho commented Oct 4, 2026

Copy link
Copy Markdown
Member

Closes #11.

Stacked on #13. Review that one first. This PR's base will switch to main once #13 merges.

Moves the snapshots from serialization/<lang>/snapshots/ to serialization_test_data/<lang>_generated_files/. That's the layout datasketches-java and datasketches-go already use for cross-language fixtures, and datasketches-cpp is moving to it (apache/datasketches-cpp#535). A TCK checkout can then serve directly as an implementation's test data root, and moving files between the TCK and an implementation is a plain copy.

Changes

  • git mv of all 735 .sk files. File contents are unchanged.
  • internal/snapshots/reconcile.go: a snapshotDirectory helper now holds the layout in one place.
  • cmd/tck output test and snapshot: updated to the new path.
  • docs/serialization-snapshots.md: new paths, and a note on why the layout matches the implementations.

Verification

  • mise run check
  • mise run tck -- snapshots check go against the moved files: file set and deterministic contents match.

Follow-up

Java's tools/download_serialization_test_data.sh needs a small change after this merges: the member pattern becomes */serialization_test_data/<lang>_generated_files/*.sk, --strip-components goes from 4 to 3, and TCK_REVISION moves to the merge commit.

🤖 Generated with Claude Code

leerho and others added 4 commits October 1, 2026 17:05
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Move the Java snapshot pin from 3a1bf7f to 059b5a9, the merge of
apache/datasketches-java#774, and regenerate the Java snapshots.

Deterministic changes:
- HLL_6 and HLL_8 compact images set the compact flag (java#761).
- Empty tuple and AoS compact images write a zero seed hash.
- Adds frequent_long_purged and frequent_string_purged (java#770).

All other modifications are probabilistic snapshots.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Move the C++ snapshot pin from fe0261a to 16d4ea6 and regenerate the
C++ snapshots.

Deterministic changes:
- Single-item compact theta images set the single-item flag (cpp#526).
- Adds frequent_long_purged and frequent_string_purged (cpp#529).
- Removes the 27 aos_*_cpp.sk snapshots: the C++ array-of-strings tuple
  sketch was reverted (cpp#537) because its key hashing is incompatible
  with Java (cpp#533).

All other modifications are probabilistic snapshots.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Move the snapshots from serialization/<lang>/snapshots to
serialization_test_data/<lang>_generated_files, the layout that
datasketches-java, datasketches-go and (with cpp#535) datasketches-cpp
already use for cross-language fixtures. A TCK checkout can then serve
directly as an implementation's test data root, and moving files
between the TCK and an implementation is a plain copy.

The file contents are unchanged; only their directory moves.

Closes #11

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@leerho
leerho requested review from proost and tisonkun October 4, 2026 23:15
Base automatically changed from snapshot-refresh to main October 4, 2026 23:25
Main contains the squash merge of #13 and has the same tree as the parent of the layout change. Preserve the PR tree so all 731 snapshots keep their existing contents at the new paths.

Validated with mise run check and exact blob comparisons for all moved snapshots.
@tisonkun
tisonkun merged commit b2c8692 into main Oct 4, 2026
1 check passed
@tisonkun
tisonkun deleted the issue-11-test-data-layout branch October 4, 2026 23:31
tisonkun added a commit that referenced this pull request Oct 4, 2026
Reconcile the snapshot directory migration from #14 with the latest-snapshot update workflow. Preserve the snapshot corpus from main, retain the update behavior, and use serialization_test_data in the workflow and documentation.

Validated with mise run check and exact snapshot comparisons against main.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use the serialization_test_data/<lang>_generated_files layout for snapshots

2 participants