GitHub - jclary-31/Bert2Bert_translator: french- english translator, using BERT only, no GPT. this is my first projects with LLMs, I still have some issues

I am trying to do a bert2bert translator.

But something wrong. I put test on github to get help from the community. severall files here.

Bert_translator is my first version
bert2bert_quicktest is a short code focused on the first identified errors
bert2bert_oktest is a short code where everithing works ok, it is adapted from the discussion I had with an expert, here https://discuss.huggingface.co/t/bert2bert-translator/167108
Bert_translator_v2 is the correction of the first version,.... but something is still strange when I train /eval the model at each epoch+ the scheduler seems to create errors.

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
Bert_translator.ipynb		Bert_translator.ipynb
Bert_translator_v2.ipynb		Bert_translator_v2.ipynb
README.md		README.md
bert2bert_oktest.ipynb		bert2bert_oktest.ipynb
bert2bert_quicktest.ipynb		bert2bert_quicktest.ipynb
translation_examples.csv		translation_examples.csv

Provide feedback