c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,430 Commits 171 Branches 49 Tags
40bb99e1be65490bc5018ca8cae69f641f53296b
Commit Graph
1 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mark Neumann 65a89a8976 Fix BasicTokenizer to respect never_split parameters (#2557) 
* add failing test

* fix call to _run_split_on_punc

* format with black
 2020-01-17 14:57:56 -05:00