[ML-News] GitHub - facebookresearch/XLM: PyTorch original implementation of Cross-lingual Language Model Pretraining.
@alex_conneau「Just released our new XLM/mBERT pytorch model in 100 languages. Significantly outperforms the TensorFlow mBERT OSS model while trained on the same Wikipedia data. https://t.co/lgPX6fgciy @GuillaumeLample @Thom_Wolf @PyTorch」 @deliprao「Today, OpenAI released GPT-2 774M (English) and Facebook released XLM pre-trained models for 100 languages. Looks like a glut of #NLProc resources for everyone freely accessible. What a wonderful time to live! https://t.co/1OMd3D5xDo https://t.co/lyC2eKvp3J」 @icoxfog417「本手法による事前学習済みモデルが公開。多言語の文関係推論(XNLI)でmultilingualなBERTよりも良好な精度。 https://t.co/BUZ2RixroC」
alex_conneau「Just released our new XLM/mBERT pytorch model in 100 ... ( English) and Facebook released XLM pre-trained models for 100 languages.