Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to train tutorial_train.py using IPAttnProcessor. #445

Open
kingbackyang opened this issue Nov 18, 2024 · 1 comment
Open

how to train tutorial_train.py using IPAttnProcessor. #445

kingbackyang opened this issue Nov 18, 2024 · 1 comment

Comments

@kingbackyang
Copy link

Hello, IP-Adapter is a great work. When I am reproducing the result and train tutorial_train.py, I find that when you use ./all_models/stable-diffusion-v1-5/ as the args.pretrained_model_name_or_path, the cross_attention_dim in Line 300 will None. This will call the original cross attention (AttnProcessor) but not IPAttnProcessor.

Therefor, I want to know that I want to train the IP-Adapter (IPAttnProcessor), how to set args.pretrained_model_name_or_path? Thank you!

@kingbackyang
Copy link
Author

Sorry, I found that you use IPAttnProcessor in unet.attn2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant