c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

big doc update [WIP]

Browse Source
This commit is contained in:
thomwolf committed 2019-08-04 12:14:57 +02:00
1 parent bfbe52ec39
commit 009273dbdd
19 files changed
+189 -60
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/main_classes/tokenizer.rst
+8
View File
@@ -0,0 +1,8 @@
Tokenizer
----------------------------------------------------
``PreTrainedTokenizer``
~~~~~~~~~~~~~~~~~~~~~~~~
.. autoclass:: pytorch_transformers.PreTrainedTokenizer
:members: