Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huber loss not supported?? #1868

Open
Deathawaits4 opened this issue Jan 7, 2025 · 3 comments
Open

Huber loss not supported?? #1868

Deathawaits4 opened this issue Jan 7, 2025 · 3 comments

Comments

@Deathawaits4
Copy link

The readme states huber loss is both available for sd3.5 and Flux, but every time i try to train using it i get:

Huber schedule 'snr' is not supported with the current model.

@Ice-YY
Copy link

Ice-YY commented Jan 7, 2025

I believe only the exponential is supported for now

@Deathawaits4
Copy link
Author

okay thanks for the answer, i tested and it seems to be the case. This is sad since snr yields better results than exponential. What i don't understand is the readme explicitly stating snr to be an option and it's also the default if not setting it, this is a little confusing.

@rockerBOO
Copy link
Contributor

snr requires the noise scheduler to have alphas_cumprod but isn't set for FlowMatchEulerDiscreteScheduler. Beyond that I'm not sure what is involved. Maybe the README could be updated to be clearer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants