Add image and metadata (#4345)
Unfortunately i accidentally orphaned my other PR
This commit is contained in:
1 parent
a0eebdc404
commit
94cb73c2d2
1 file changed
+11
-5
@@ -1,19 +1,25 @@
|
|||||||
|
---
|
||||||
|
language: norwegian
|
||||||
|
thumbnail: https://i.imgur.com/QqSEC5I.png
|
||||||
|
---
|
||||||
|
|
||||||
# Norwegian Electra
|
# Norwegian Electra
|
||||||
Image incoming, im going to have som fun with this one.
|

|
||||||
|
|
||||||
Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
|
Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
|
||||||
|
|
||||||
Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
|
Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
|
||||||
|
# Model
|
||||||
|
## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators
|
||||||
|
Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning
|
||||||
|
- https://openreview.net/pdf?id=r1xMH1BtvB
|
||||||
|
- https://github.com/google-research/electra
|
||||||
# Acknowledgments
|
# Acknowledgments
|
||||||
|
|
||||||
### TensorFlow Research Cloud
|
### TensorFlow Research Cloud
|
||||||
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
|
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
|
||||||
- https://www.tensorflow.org/tfrc
|
- https://www.tensorflow.org/tfrc
|
||||||
|
|
||||||
#### OSCAR corpus
|
#### OSCAR corpus
|
||||||
- https://oscar-corpus.com/
|
- https://oscar-corpus.com/
|
||||||
|
|
||||||
#### OPUS
|
#### OPUS
|
||||||
- http://opus.nlpl.eu/
|
- http://opus.nlpl.eu/
|
||||||
- http://www.opensubtitles.org/
|
- http://www.opensubtitles.org/
|
||||||
Reference in new issue
Block a user