Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code for training the models #2

Open
cguerner opened this issue Apr 2, 2024 · 0 comments
Open

Code for training the models #2

cguerner opened this issue Apr 2, 2024 · 0 comments

Comments

@cguerner
Copy link

cguerner commented Apr 2, 2024

Hi,

I'm trying to add llama2 as one of the models under the framework. I'm curious re. the fit method here, seems you omitted it for some reason.

# assume model was already trained

Without this function or a training script, I'm thinking I could just take a LlamaForSequenceClassification model and train it on the exclusive train set for the different number of overall sentiment classes, for example following this script: https://huggingface.co/blog/Lora-for-sequence-classification-with-Roberta-Llama-Mistral#llama-2.

Thanks!

Best,
Clément

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant