c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,267 Commits 171 Branches 49 Tags
3e98f27e4a9bb0ac3d0fe24b94d30da42cdae8a7
Commit Graph
1 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mark Neumann 65a89a8976 Fix BasicTokenizer to respect never_split parameters (#2557) 
* add failing test

* fix call to _run_split_on_punc

* format with black
 2020-01-17 14:57:56 -05:00