New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

paper CaFo #476

Open

junxnone opened this issue Oct 11, 2024 · 0 comments

Owner

junxnone commented Oct 11, 2024

CaFo

分别利用 GPT-3/CLIP/DINO/DALL-E 从 Prompt/Generate/CacheModel 方面提升模型性能

Arch

1 利用 GPT-3 生成更丰富语义的 Prompt
2 利用 DALL-E 生成 Prompt 相关的 Image
3 将生成的 Image 和 Training Image 使用 CLIP & DINO 生成 Cache Model
4 Inference 测试图片通过 CLIP & DINO 生成查询 keys, 从 Cache Model 中获取 ensemble 结果

Reference

junxnone changed the title ~~x CaFo~~ paper CaFo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment