59 lines
1.3 KiB
Markdown
59 lines
1.3 KiB
Markdown
---
|
|
language: esperanto
|
|
thumbnail: https://huggingface.co/blog/assets/EsperBERTo-thumbnail-v2.png
|
|
---
|
|
|
|
# EsperBERTo: RoBERTa-like Language model trained on Esperanto
|
|
|
|
**Companion model to blog post https://huggingface.co/blog/how-to-train** 🔥
|
|
|
|
## Training Details
|
|
|
|
- current checkpoint: 566000
|
|
- machine name: `galinette`
|
|
|
|
|
|
|
|
|
|
## Example pipeline
|
|
|
|
```python
|
|
from transformers import pipeline
|
|
|
|
fill_mask = pipeline(
|
|
"fill-mask",
|
|
model="julien-c/EspertBERTo-small",
|
|
tokenizer="julien-c/EspertBERTo-small"
|
|
)
|
|
|
|
fill_mask("Jen la komenco de bela <mask>.")
|
|
|
|
# This is the beginning of a beautiful <mask>.
|
|
# =>
|
|
|
|
# {
|
|
# 'score':0.06502299010753632
|
|
# 'sequence':'<s> Jen la komenco de bela vivo.</s>'
|
|
# 'token':1099
|
|
# }
|
|
# {
|
|
# 'score':0.0421181358397007
|
|
# 'sequence':'<s> Jen la komenco de bela vespero.</s>'
|
|
# 'token':5100
|
|
# }
|
|
# {
|
|
# 'score':0.024884626269340515
|
|
# 'sequence':'<s> Jen la komenco de bela laboro.</s>'
|
|
# 'token':1570
|
|
# }
|
|
# {
|
|
# 'score':0.02324388362467289
|
|
# 'sequence':'<s> Jen la komenco de bela tago.</s>'
|
|
# 'token':1688
|
|
# }
|
|
# {
|
|
# 'score':0.020378097891807556
|
|
# 'sequence':'<s> Jen la komenco de bela festo.</s>'
|
|
# 'token':4580
|
|
# }
|
|
``` |