c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,684 Commits 171 Branches 49 Tags
47e1334c0b56007c9d222e029db27fd2fdfccbb2
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yohei Tamura 8594dd80dd BertJapaneseTokenizer accept options for mecab (#3566) 
* BertJapaneseTokenizer accept options for mecab

* black

* fix mecab_option to Option[str]
 2020-04-03 11:12:19 -04:00
Yohei Tamura bfec203d4e modified: src/transformers/tokenization_utils.py 2020-01-09 12:54:28 +01:00
Yohei Tamura d08a338c3b modified: transformers/modeling_utils.py 2019-11-16 18:47:37 +09:00