From 4e817ff41885063e08bb3bcd63e5adfd835b9911 Mon Sep 17 00:00:00 2001 From: Txus Date: Sat, 25 Apr 2020 15:16:40 +0200 Subject: [PATCH] Create README.md (#3966) --- .../codegram/calbert-base-uncased/README.md | 25 +++++++++++++++++++ 1 file changed, 25 insertions(+) create mode 100644 model_cards/codegram/calbert-base-uncased/README.md diff --git a/model_cards/codegram/calbert-base-uncased/README.md b/model_cards/codegram/calbert-base-uncased/README.md new file mode 100644 index 00000000..77cb5254 --- /dev/null +++ b/model_cards/codegram/calbert-base-uncased/README.md @@ -0,0 +1,25 @@ +--- +language: catalan +--- + +# CALBERT: a Catalan Language Model + +## Introduction + +CALBERT is an open-source language model for Catalan based on the ALBERT architecture. + +It is now available on Hugging Face in its `base-uncased` version, and was pretrained on the [OSCAR dataset](https://traces1.inria.fr/oscar/). + +For further information or requests, please go to the [GitHub repository](https://github.com/codegram/calbert) + +## Pre-trained models + +| Model | Arch. | Training data | +|-------------------------------------|------------------|-----------------------------------| +| `codegram` / `calbert-base-uncased` | Base (uncased) | OSCAR (4.3 GB of text) | + + +## Authors + +CALBERT was trained and evaluated by [Txus Bach](https://twitter.com/txustice), as part of [Codegram](https://www.codegram.com)'s applied research. +