[feature request] SeedVR2 for upscaling

[StableLlama]

For photography images SeeedVR2 has an astonishing quality for upscaling. It can also be used to remove the plastic look on the faces by downscaling, (optionally adding some noise), and then upscaling again.

So it would be great when Krita AI could do that internally and I don't have to use an external workflow for that.

[rktvr]

seedvr needs massive amounts of ram though right? and only their 7b model is actually good. i remember getting oom constantly with a single image and a 24gb vram card

[StableLlama]

I am using seedvr2_ema_7b_fp8_mixed_block35_fp16 (dunno why, that's the one in the workflow I'm constantly using) and have 16 GB VRAM.
When the VRAM isn't sufficient it is possible to increase the blocks_to_swap (I'm using 16).

Usually I'm upscaling to 2048x2048 and that's working fine

[eruanno123]

I use SeedVR2 external workflow, which I'm sharing here. With 16 GB of VRAM and block swapping plus tiled image/latent processing, I can reliably upscale images up to ~4096×4096. But I work with 3B model - it gives me subjectively better results.

The highest resolution I’ve produced so far was 7200×5600, which required manually splitting the canvas into two parts. I’m planning to extend the external workflow by leveraging Krita’s selection mask and ROI bounding box nodes + Composite node, allowing the upscale to run in smaller batches.

Krita SeedRV2 Upscale API.json

Having this supported natively would be great!

Btw. I've seen commits that enable Canvas resizing. This will eliminate the peculiar scaling factor I implemented (or rather overengineered) in the workflow. The scaling factor 200 means 2.00x - it assumes that Canvas has already been scaled by that factor.

[realjoschek]

i have now a working implementation of seedvr2 upscaling in my fork, you need to have the https://github.com/numz/ComfyUI-SeedVR2_VideoUpscaler installed in your comfy. i think external workflow above is probably easier as a solution though.

i was looking for a better upscaler and never had a look at seedvr2 because i thought it was just for video. so: thanks for bringing it up