Skip to content

Replace miniz_oxide with flate2 for Gzip (de)compression for SPZ - #485

Merged
dmarcos merged 2 commits into
sparkjsdev:mainfrom
mrxz:spz-flate2
Oct 16, 2026
Merged

dmarcos merged 2 commits into
sparkjsdev:mainfrom
mrxz:spz-flate2

Conversation

@mrxz

@mrxz mrxz commented Oct 14, 2026

Copy link
Copy Markdown
Collaborator

Follow up of #474. The SPZ encoding and decoding still used miniz_oxide in combination with custom Gzip header parsing. This PR replaces it with GzDecoder and GzEncoder from flate2. With this change miniz_oxide is no longer used (directly) and has been removed as dependency from Cargo.toml. Splat formats using deflate/gzip compression now all use flate2 with the zlib-rs backend.

@oscarlorentzon oscarlorentzon left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The encoder looks good. The decoder changes affect memory use and file type detection.

Comment thread rust/spark-lib/src/decoder.rs Outdated
Comment thread rust/spark-lib/src/spz.rs Outdated
@dmarcos

dmarcos commented Oct 15, 2026

Copy link
Copy Markdown
Contributor

needs rebase

@mrxz

mrxz commented Oct 16, 2026

Copy link
Copy Markdown
Collaborator Author

@dmarcos Rebased

@dmarcos

dmarcos commented Oct 16, 2026

Copy link
Copy Markdown
Contributor

thanks!

@dmarcos
dmarcos merged commit 538ed22 into sparkjsdev:main Oct 16, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants