From 94cb73c2d2efeb188b522ff352f98b15124ba9f8 Mon Sep 17 00:00:00 2001 From: Viktor Alm Date: Thu, 14 May 2020 02:05:15 +0200 Subject: [PATCH] Add image and metadata (#4345) Unfortunately i accidentally orphaned my other PR --- .../README.md | 16 +++++++++++----- 1 file changed, 11 insertions(+), 5 deletions(-) diff --git a/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md b/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md index 43c14ad0..7a39e5f1 100644 --- a/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md +++ b/model_cards/ViktorAlm/electra-base-norwegian-uncased-discriminator/README.md @@ -1,19 +1,25 @@ +--- +language: norwegian +thumbnail: https://i.imgur.com/QqSEC5I.png +--- + # Norwegian Electra -Image incoming, im going to have som fun with this one. +![Image of norwegian electra](https://i.imgur.com/QqSEC5I.png) Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8) Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet. - +# Model +## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators +Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning +- https://openreview.net/pdf?id=r1xMH1BtvB +- https://github.com/google-research/electra # Acknowledgments - ### TensorFlow Research Cloud Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️ - https://www.tensorflow.org/tfrc - #### OSCAR corpus - https://oscar-corpus.com/ - #### OPUS - http://opus.nlpl.eu/ - http://www.opensubtitles.org/