1 parent
68ef0a111f
commit
bd3feddf67
1 file changed
+22
@@ -0,0 +1,22 @@
|
||||
---
|
||||
|
||||
language: swedish
|
||||
|
||||
---
|
||||
|
||||
# BERTSSON Models
|
||||
|
||||
The models are trained on:
|
||||
- Government Text
|
||||
- Swedish Literature
|
||||
- Swedish News
|
||||
|
||||
Corpus size: Roughly 6B tokens.
|
||||
|
||||
The following models are currently available:
|
||||
|
||||
- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.
|
||||
|
||||
All models are cased and trained with whole word masking.
|
||||
|
||||
Stay tuned for evaluations.
|
||||
Reference in new issue
Block a user