Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Where is the genrative task part of Dylora #8

Open
ardand4708 opened this issue Mar 27, 2024 · 0 comments
Open

Where is the genrative task part of Dylora #8

ardand4708 opened this issue Mar 27, 2024 · 0 comments

Comments

@ardand4708
Copy link

Hi thanks for your work.
I am studying LoRA and I noticed that the your work Dylora dose not contain the implementation of NLG part.
I am simply writing to ask in order to reproduce the results of generative tasks, should I change the hyper-parameter lora-dim in as you did with lora_r in the NLU task?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant