From bd3feddf67f3005ca73c69abc07ffc5e64e8a0ba Mon Sep 17 00:00:00 2001 From: Jannes <36601086+jannesgg@users.noreply.github.com> Date: Tue, 17 Mar 2020 14:05:11 +0100 Subject: [PATCH] Create README.md (#3306) * Create README.md * Updated README.md --- model_cards/jannesg/bertsson/README.md | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) create mode 100644 model_cards/jannesg/bertsson/README.md diff --git a/model_cards/jannesg/bertsson/README.md b/model_cards/jannesg/bertsson/README.md new file mode 100644 index 00000000..6ff91aaa --- /dev/null +++ b/model_cards/jannesg/bertsson/README.md @@ -0,0 +1,22 @@ +--- + +language: swedish + +--- + +# BERTSSON Models + +The models are trained on: +- Government Text +- Swedish Literature +- Swedish News + +Corpus size: Roughly 6B tokens. + +The following models are currently available: + +- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google. + +All models are cased and trained with whole word masking. + +Stay tuned for evaluations.