如何在另一个数据集上微调我训练的 model (bert)

Question

*** I used a pretrained BertModel to fine-tune model on squadv1 then fine-tune result model to final model.

This how I can load my trined model on squadv1

output_dir="mybert_squadv1/checkpoint-60000/"
model = AutoModelForQuestionAnswering.from_pretrained(output_dir)
tokenizer = AutoTokenizer.from_pretrained(output_dir, do_lower_case=do_lower_case)

after I loaded my model on a dataset, I want to fine-tune this model on another dataset. Let say squadv3 Can I do that or not? if so, how i can do it?

Answer 1

you just get the tokenizer. After that,you should add your own Neural Networks after that and loss function. you can see how to train a normal network.