Create README.md (#3306)

* Create README.md

* Updated README.md
This commit is contained in:
Jannes authored and GitHub committed 2020-03-17 09:05:11 -04:00
1 parent 68ef0a111f
commit bd3feddf67
1 file changed
+22
+22
View File
@@ -0,0 +1,22 @@
---
language: swedish
---
# BERTSSON Models
The models are trained on:
- Government Text
- Swedish Literature
- Swedish News
Corpus size: Roughly 6B tokens.
The following models are currently available:
- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.
All models are cased and trained with whole word masking.
Stay tuned for evaluations.