Using Flux Kontext in Krita with the Generative AI Plugin
0A look at using the Flux Kontext model within Krita (free/open source) with the AI diffusion plugin for instruction-driven image-to-image. Flux Kontext is a new sort of image generation model - you tell it want you want it to do, not what you want in the final image.
Kontext understands the difference between "keep this" and "change that," making it incredibly impressive for maintaining character consistency across multiple edits. This is mostly an overview of the setup, some demo images, working around some quirks in Krita, futzing with the Krita's layers, and trying to show some additional capabilities of Kontext. Is this a workable Stable Diffusion XL alternative? Absolutely. Can this replace Adobe Photoshop's generative AI tools? In many cases, probably.
edit: update -- these quants work out of the box with Krita as well. I just tried Q4_0. It's.. alright. I think the fp8 one linked on the GitHub page works better. Q4_0 seems to follow the prompt worse. The images still look great, but they're less close to what was asked for than the output from the larger models. You'll still need the text encoder and VAE when using the GGUF quants.
Krita
https://krita.org/en/
Krita AI Diffusion Plugin by Acly
https://github.com/Acly/krita-ai-diffusion
Click view PDF for a link to the Flux Kontext evaluation paper
https://arxiv.org/abs/2506.15742
Flux Kontext Prompting Guide
https://docs.bfl.ai/guides/prompting_guide_kontext_i2i
Flux Kontext models compatible with the AI diffusion plugin (out of the box)
https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/blob/main/split_files/vae/ae.safetensors
https://huggingface.co/comfyanonymous/flux_text_encoders/blob/main/clip_l.safetensors
https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp8_e4m3fn_scaled.safetensors
[0:00] What Even Is This And Why Are We Here?
[1:10] Model Capabilities and Tasks
[2:15] Visual Cues and Masking
[2:42] Installation Tips
[4:49] Example Flux Kontext Workflow in Krita
[7:23] Exploring Flux Kontext Edge Cases
[8:50] High Resolution Compositing with Flux Kontext