diff --git a/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md b/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md index 43c14ad0..7a39e5f1 100644 --- a/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md +++ b/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md @@ -1,19 +1,25 @@ +--- +language: norwegian +thumbnail: https://i.imgur.com/QqSEC5I.png +--- + # Norwegian Electra -Image incoming, im going to have som fun with this one. +![Image of norwegian electra](https://i.imgur.com/QqSEC5I.png) Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8) Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet. - +# Model +## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators +Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning +- https://openreview.net/pdf?id=r1xMH1BtvB +- https://github.com/google-research/electra # Acknowledgments - ### TensorFlow Research Cloud Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️ - https://www.tensorflow.org/tfrc - #### OSCAR corpus - https://oscar-corpus.com/ - #### OPUS - http://opus.nlpl.eu/ - http://www.opensubtitles.org/