Repository navigation
[Feature] the new flux/bonsai model #1596
Description
Feature Summary
bonsai addition to te reppo
Detailed Description
is there any chance you can add the new light weight flux/bonsai model because its good quality to for the computation and time of generation
Alternatives you considered
No response
Additional context
No response
Activity
Green-Sky commentedon Jun 2, 2026
bonsai-image is just flux2 klein 4b.
I made compatible ggufs for the binary release here https://huggingface.co/Green-Sky/bonsai-image-binary-4B-GGUF
For ternay there is missing quant support in ggml/llama.cpp. See #331
dfgdrfgyhfgfvtg commentedon Jun 2, 2026
so i just have to use that and it will work?
dfgdrfgyhfgfvtg commentedon Jun 2, 2026
im really sorry i just want to use it so please any help is appreciated
Green-Sky commentedon Jun 2, 2026
Just check the sd.cpp docs on how to use flux2 klein 4b, and sub in this gguf as the diffusion model.
https://huggingface.co/Green-Sky/bonsai-image-binary-4B-GGUF/blob/main/bonsai_image_4b-mod_q8_0-q1_0.gguf
dfgdrfgyhfgfvtg commentedon Jun 2, 2026
im really sorry for the bother but im new to tis so even if i read it i cant really do anytthing