c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,712 Commits 171 Branches 49 Tags
bc65afc4dfac3badf3de3be395d4023b44c61bdd
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yohei Tamura 8594dd80dd BertJapaneseTokenizer accept options for mecab (#3566) 
* BertJapaneseTokenizer accept options for mecab

* black

* fix mecab_option to Option[str]
 2020-04-03 11:12:19 -04:00
Yohei Tamura bfec203d4e modified: src/transformers/tokenization_utils.py 2020-01-09 12:54:28 +01:00
Yohei Tamura d08a338c3b modified: transformers/modeling_utils.py 2019-11-16 18:47:37 +09:00