Skip to content

This is an example of using your own data to "continue pre-training" a pre-trained model, then fine-tuning it on your own dataset, and finally using it alone to predict your own domain data.

Notifications You must be signed in to change notification settings

zoeChen119/Continuing_Pretrain_BERT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

Continuing_Pretrain_BERT

This is an example of using your own data to "continue pre-training" a pre-trained model, then fine-tuning it on your own dataset, and finally using it alone to predict your own domain data.

About

This is an example of using your own data to "continue pre-training" a pre-trained model, then fine-tuning it on your own dataset, and finally using it alone to predict your own domain data.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages