diff --git a/model_cards/jannesg/bertsson/README.md b/model_cards/jannesg/bertsson/README.md new file mode 100644 index 00000000..6ff91aaa --- /dev/null +++ b/model_cards/jannesg/bertsson/README.md @@ -0,0 +1,22 @@ +--- + +language: swedish + +--- + +# BERTSSON Models + +The models are trained on: +- Government Text +- Swedish Literature +- Swedish News + +Corpus size: Roughly 6B tokens. + +The following models are currently available: + +- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google. + +All models are cased and trained with whole word masking. + +Stay tuned for evaluations.