c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
691 Commits 171 Branches 49 Tags
1135f2384ab735759e8c1a0643dba938e4e609ea
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
John Hewitt 4d1ad83236 update docstring of BERT tokenizer to reflect do_wordpiece_only 2019-02-27 14:50:41 -08:00
John Hewitt e14c6b52e3 add BertTokenizer flag to skip basic tokenization 2019-02-26 20:11:24 -08:00