Files
transformers/model_cards/jannesg/bertsson
Jannes bd3feddf67 Create README.md (#3306)
* Create README.md

* Updated README.md
2020-03-17 09:05:11 -04:00
..
2020-03-17 09:05:11 -04:00

language
language
swedish

BERTSSON Models

The models are trained on:

  • Government Text
  • Swedish Literature
  • Swedish News

Corpus size: Roughly 6B tokens.

The following models are currently available:

  • bertsson - A BERT base model trained with the same hyperparameters as first published by Google.

All models are cased and trained with whole word masking.

Stay tuned for evaluations.