InstantId

[TingTingin]

looking into https://github.com/InstantID/InstantID it seems like its actually also uses insightface and ipadapter might be easy to integrate

[hben35096]

The effect is fantastic!!
Hopefully, it will work well with other nodes in Comfyui.

[cubiq]

OMG we are all gonna die!

[hben35096]

OMG we are all gonna die! !

This feature has been added??!!!

[xiaohu2015]

OMG we are all gonna die!

Don't be so sad, haha, there will always be something better, and this is something you should be happy about.

[cubiq]

I'm just kidding, just wanted to show that I'm working on the instantid extension. It's so similar to IPAdapter that I could put everything together (but I will make an external plugin)

[xiaohu2015]

I'm just kidding, just wanted to show that I'm working on the instantid extension. It's so similar to IPAdapter that I could put everything together (but I will make an external plugin)

yes, IP-Adapter plus ControlNet, i would also like to combine InstantID with other ip adapters

[hben35096]

It's really exciting

[zsxkib]

great work!

[johndpope]

@ZHO-ZHO-ZHO crafted comfyui-instantid - I'm looking to use ip adapter with it.

this is the repo -
https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/

I want to plug in an image ref instead of the text prompt as described here
instantX-research/InstantID#56

anyone able to assist?

UPDATE - looks like there's some updated workflows

[hben35096]

crafted comfyui-instantid - 我想用 ip 适配器来使用它。

这是回购 - https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/

我想插入图像引用而不是文本提示，如此处所述 InstantID/InstantID#56

有人能帮忙吗？

更新 - 看起来有一些更新的工作流程

@ZHO-ZHO-ZHO crafted comfyui-instantid - I'm looking to use ip adapter with it.

this is the repo - https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/

I want to plug in an image ref instead of the text prompt as described here InstantID/InstantID#56

anyone able to assist?

As far as I know, ZHO's ComfyUI-InstantID can't even connect to the one that comes with Comfyui
KSampler, although its version can be opened in Comfyui, is difficult to use with other nodes in Comfyui.

[GXcells]

OMG we are all gonna die!

There is also a LORA for InstandID to add in addition to the IP adapter?

[GXcells]

@ZHO-ZHO-ZHO crafted comfyui-instantid - I'm looking to use ip adapter with it.

this is the repo - https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/

I want to plug in an image ref instead of the text prompt as described here InstantID/InstantID#56

anyone able to assist?

UPDATE - looks like there's some updated workflows

This repo is a bit complicated.
I will wait for Cubiq's own implementation that will be probably much cleaner and easy.

[jesenzhang]

@ZHO-ZHO-ZHO crafted comfyui-instantid - I'm looking to use ip adapter with it.
this is the repo - https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/
I want to plug in an image ref instead of the text prompt as described here InstantID/InstantID#56
anyone able to assist?
UPDATE - looks like there's some updated workflows

This repo is a bit complicated. I will wait for Cubiq's own implementation that will be probably much cleaner and easy.

I'm waiting too.

[johndpope]

I ask @ZHO-ZHO-ZHO to switch his insightfaceloader over - ZHO-ZHO-ZHO/ComfyUI-InstantID#49 - please upvote.

[thibaudart]

OMG we are all gonna die!

did you fix your last issue with the controlnet part?

[cubiq]

not completely I have issues with high/low CFG for some reason. I hadn't much time to work on it yet unfortunately.

[thibaudart]

thanks to start the implementation . maybe if you share someone can find a solution.
you did an important work with your extension. thank you so much.

[cubiq]

@thibaudart I have no problem at sharing my shitty code 😄 https://github.com/cubiq/ComfyUI_InstantID

that is the base code, but more work is needed, it's not the latest version that I have locally but it's a good starting point.

[hben35096]

Mikubill/sd-webui-controlnet#2589
ControlNet has added Instant ID and seems to fix some issues

[thibaudart]

@cubiq thanks for sharing!
@hben35096 it's for webui not comfy :(

[jesenzhang]

Any updates?

[spenc-r]

Curious if attention masking would work with InstantID. Any resources anyone could point me to? Found this commit but hard for me to understand, as I am new to SD. I am interested in writing an implementation

[johndpope]

instantX-research/InstantID#89 this has some masking - spenc-r

[cubiq]

yes attention masking is possible

[qqqllppp]

ZHO^3 's instantID eats too much vram, im getting oom even on 12gb vram 😭 Im crossing my fingers hoping the implementation here would eat less vram 🙏🏼

[JorgeR81]

ZHO^3 's instantID eats too much vram, im getting oom even on 12gb vram

I think this may be due to a bug in that implementation.
ZHO-ZHO-ZHO/ComfyUI-InstantID#66

( and apparently InstantID works well in A1111, with 6gb vram, in low vram mode )
ZHO-ZHO-ZHO/ComfyUI-InstantID#66 (comment)

[thibaudart]

the biggest issue with Zho implementation is the fact we can’t use it in a complex workflow :( T Le ven. 2 févr. 2024 à 19:22, JorgeR81 ***@***.***> a écrit :

…

ZHO^3 's instantID eats too much vram, im getting oom even on 12gb vram I think this may be due to a bug in that implementation. ZHO-ZHO-ZHO/ComfyUI-InstantID#66 <ZHO-ZHO-ZHO/ComfyUI-InstantID#66> ( and apparently InstantID works well in A1111, with 6gb vram, in low vram mode ) ZHO-ZHO-ZHO/ComfyUI-InstantID#66 (comment) <ZHO-ZHO-ZHO/ComfyUI-InstantID#66 (comment)> — Reply to this email directly, view it on GitHub <#242 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AYWNXDDO47UKJHW7GN6AEMTYRUVHHAVCNFSM6AAAAABCFUX4H6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUGQ2DQNBTGQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[cubiq]

I just pushed a tiled node for IPAdapter and I'm also working on a clip-vision mask option (probably tomorrow), then I'll check the InstantID. I think I have it 90% sorted out already

[hortom]

Maybe it could be useful: I added some amateur-ish VRAM optimisations to ZHO's node here: ZHO-ZHO-ZHO/ComfyUI-InstantID#87

[cubiq]

It is finally working!

I'll post the code tomorrow

[cubiq]

Okay the InstantID native code is live. I think it's still beta but seems to be working very well. Please read the README file for important information.

https://github.com/cubiq/ComfyUI_InstantID

/cc @xiaohu2015

[camoody1]

@cubiq Thank you! Quick question... In your Readme file, you mention watermarks being everywhere. Is this because of the turbo model you're using or from the InstantID model?

[cubiq]

it comes from the instantID model. it can be fixed easily by changing the resolution slightly

[hortom]

As I see, it is suggested to use a preprocessor for the sample images for insight face. I use padding for the pose.

[edtjulien]

@cubiq Thanks so much for your work!

[cubiq]

As I see, it is suggested to use a preprocessor for the sample images for insight face. I use padding for the pose.

the preprocessor shouldn't be needed unless you have a very extreme closeup, even then I iteratively lower the detection resolution and this technique has a very high detection rate

[cubiq]

also supports multiple people