Thomas Wolf 41789c6c3d Merge pull request #1059 from GuillemGSubies/master ...

Better use of spacy tokenizer in open ai and xlm tokenizers

2019-08-21 01:53:48 +02:00

..

tests

Merge pull request #806 from wschin/fix-a-path

2019-08-21 01:14:40 +02:00

__init__.py

Release: 1.1.0

2019-08-15 11:15:08 -04:00

__main__.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_gpt2_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_openai_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_pytorch_checkpoint_to_tf.py

Merge branch 'master' into auto_models

2019-08-05 19:17:35 +02:00

convert_roberta_checkpoint_to_pytorch.py

Fixup 9d0603148b

2019-08-12 12:28:55 -04:00

convert_tf_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_transfo_xl_checkpoint_to_pytorch.py

fix #950

2019-08-05 17:26:29 +02:00

convert_xlm_checkpoint_to_pytorch.py

fix #827

2019-07-23 14:06:43 +02:00

convert_xlnet_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

file_utils.py

cleaning up tokenizer tests structure (at last) - last remaining ppb refs

2019-08-05 14:08:56 +02:00

modeling_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

modeling_bert.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

modeling_gpt2.py

minor typo

2019-08-20 11:33:46 +02:00

modeling_openai.py

minor typo

2019-08-20 11:33:46 +02:00

modeling_roberta.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

modeling_transfo_xl_utilities.py

fix #827

2019-07-23 14:06:43 +02:00

modeling_transfo_xl.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

modeling_utils.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

modeling_xlm.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

modeling_xlnet.py

Doc: loading from config alone does not load the model weights

2019-08-19 10:17:47 -04:00

optimization.py

updating schedules for state_dict saving

2019-07-23 15:57:18 +02:00

tokenization_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

tokenization_bert.py

Added documentation and changed parameters for special_tokens_sentences_pair.

2019-08-12 15:13:53 -04:00

tokenization_gpt2.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_openai.py

Update tokenization_openai.py

2019-08-20 14:19:25 +02:00

tokenization_roberta.py

Doc

2019-08-14 14:56:14 -04:00

tokenization_transfo_xl.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_utils.py

Merge branch 'master' into iterative_split_on_token

2019-08-21 01:33:02 +02:00

tokenization_xlm.py

Update tokenization_xlm.py

2019-08-20 14:19:39 +02:00

tokenization_xlnet.py

Added documentation and changed parameters for special_tokens_sentences_pair.

2019-08-12 15:13:53 -04:00