samvelyan 9ce36e3e4b Re-implemented tokenize() iteratively in PreTrainedTokenizer.

2019-08-14 08:57:09 +00:00

..

tests

remove derived classes for now

2019-08-05 19:08:19 +02:00

__init__.py

Merge branch 'master' into auto_models

2019-08-05 19:17:35 +02:00

__main__.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_gpt2_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_openai_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_pytorch_checkpoint_to_tf.py

Merge branch 'master' into auto_models

2019-08-05 19:17:35 +02:00

convert_tf_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_transfo_xl_checkpoint_to_pytorch.py

fix #950

2019-08-05 17:26:29 +02:00

convert_xlm_checkpoint_to_pytorch.py

fix #827

2019-07-23 14:06:43 +02:00

convert_xlnet_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

file_utils.py

cleaning up tokenizer tests structure (at last) - last remaining ppb refs

2019-08-05 14:08:56 +02:00

modeling_auto.py

remove derived classes for now

2019-08-05 19:08:19 +02:00

modeling_bert.py

Corrected logger.error info

2019-08-09 19:36:44 -04:00

modeling_gpt2.py

Merge branch 'master' of https://github.com/huggingface/pytorch-transformers

2019-08-10 20:04:37 +02:00

modeling_openai.py

fix #993

2019-08-10 20:04:35 +02:00

modeling_transfo_xl_utilities.py

fix #827

2019-07-23 14:06:43 +02:00

modeling_transfo_xl.py

Fix examples in docstring

2019-08-06 11:32:41 +08:00

modeling_utils.py

Clarified PreTrainedModel.from_pretrained warning messages in documentation.

2019-08-08 19:04:34 -04:00

modeling_xlm.py

fix #976

2019-08-08 10:38:57 -04:00

modeling_xlnet.py

fix #976

2019-08-08 10:38:57 -04:00

optimization.py

updating schedules for state_dict saving

2019-07-23 15:57:18 +02:00

tokenization_auto.py

cleaning up example docstrings

2019-07-27 20:25:39 +02:00

tokenization_bert.py

cleaning up tokenizer tests structure (at last) - last remaining ppb refs

2019-08-05 14:08:56 +02:00

tokenization_gpt2.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_openai.py

update tokenizer - update squad example for xlnet

2019-07-15 17:30:42 +02:00

tokenization_transfo_xl.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_utils.py

Re-implemented tokenize() iteratively in PreTrainedTokenizer.

2019-08-14 08:57:09 +00:00

tokenization_xlm.py

update readme and pretrained model weight files

2019-07-16 15:11:29 +02:00

tokenization_xlnet.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00