Commit Graph
1 Commits
Author SHA1 Message Date
samvelyan 9ce36e3e4b Re-implemented tokenize() iteratively in PreTrainedTokenizer. 2019-08-14 08:57:09 +00:00