Commit Graph
603 Commits
Author SHA1 Message Date
thomwolf c306869ea2 add two transformer xl models 2019-02-07 17:07:03 +01:00
thomwolf d482e3d79d adding examples for openai and transformer-xl 2019-02-07 17:06:41 +01:00
thomwolf 9c3c24800b split saved model in config & weights 2019-02-07 17:06:17 +01:00
thomwolf 2df41663f1 added test 2019-02-07 17:05:49 +01:00
tholor 9aebc711c9 adjust error message related to args.do_eval 2019-02-07 11:49:38 +01:00
tholor 4a450b25d5 removing unused argument eval_batch_size from LM finetuning #256 2019-02-07 10:06:38 +01:00
Thomas Wolf 58f0a2745c Merge pull request #258 from BoeingX/master
Fix the undefined variable in squad example
2019-02-06 20:33:18 +01:00
Baoyang Song 7ac3311e48 Fix the undefined variable in squad example 2019-02-06 19:36:08 +01:00
thomwolf ed47cb6cba fixing transfo eval script 2019-02-06 16:22:17 +01:00
thomwolf 973926431e fix differencies with tensorflow version (mem cells and adaptive sofmax clusters) 2019-02-06 15:42:29 +01:00
thomwolf ba9e4eb354 fix unicode in tokenization tests 2019-02-06 00:28:00 +01:00
thomwolf 34bdb7f9cb update circle-ci for python 2.7 and 3.5 2019-02-06 00:25:12 +01:00
Thomas Wolf 848aae49e1 Merge branch 'master' into python_2 2019-02-06 00:13:20 +01:00
thomwolf 448937c00d python 2 compatibility 2019-02-06 00:07:46 +01:00
thomwolf ba37ddc5ce fix run_lm_modeling example command line 2019-02-06 00:07:08 +01:00
thomwolf 822915142b fix docstring 2019-02-05 16:34:32 +01:00
Thomas Wolf bd74632687 Merge pull request #251 from Iwontbecreative/active_loss_tok_classif
Only keep the active part mof the loss for token classification
2019-02-05 16:33:45 +01:00
Thomas Wolf fd223374f0 Merge pull request #208 from Liangtaiwan/mergesquad
Merge run_squad.py and run_squad2.py
2019-02-05 16:15:03 +01:00
thomwolf d609ba24cb resolving merge conflicts 2019-02-05 16:14:25 +01:00
thomwolf bde1eeebe0 rename 2019-02-05 16:11:22 +01:00
thomwolf 3ea3b00e59 merge squad example in single example 2019-02-05 16:10:27 +01:00
thomwolf d8e3bdbb4c moved up to current master 2019-02-05 16:09:39 +01:00
Thomas Wolf 64ce900974 Merge pull request #248 from JoeDumoulin/squad1.1-fix
fix prediction on run-squad.py example
2019-02-05 16:00:51 +01:00
thomwolf 0ad9b239a1 gitignore 2019-02-05 15:43:11 +01:00
Thomas Wolf e9e77cd3c4 Merge pull request #218 from matej-svejda/master
Fix learning rate problems in run_classifier.py
2019-02-05 15:40:44 +01:00
thomwolf 1579c53635 more explicit notation: num_train_step => num_train_optimization_steps 2019-02-05 15:36:33 +01:00
Thibault Fevry f3bda2352a Only keep the active part mof the loss for token classification 2019-02-04 11:46:36 -05:00
thomwolf 6179f537a3 clean up tokenization spaces 2019-02-04 17:41:22 +01:00
thomwolf 850da1cc36 strip decoded outputs 2019-02-04 17:35:05 +01:00
thomwolf 01a3966bc6 more options on special tokens 2019-02-04 17:26:25 +01:00
thomwolf 05f961840b logging 2019-02-04 13:06:19 +01:00
joe dumoulin aa90e0c36a fix prediction on run-squad.py example 2019-02-01 10:15:44 -08:00
Thomas Wolf 8f8bbd4a4c Merge pull request #244 from deepset-ai/prettify_lm_masking
Avoid confusion of inplace LM masking
2019-02-01 12:17:50 +01:00
Thomas Wolf e2d53d95b0 Merge pull request #242 from ksurya/argparse
Fix argparse type error
2019-02-01 12:14:55 +01:00
Thomas Wolf 7e0b415ab4 Merge pull request #240 from girishponkiya/patch-1
Minor update in README
2019-02-01 12:14:05 +01:00
tholor ce75b169bd avoid confusion of inplace masking of tokens_a / tokens_b 2019-01-31 11:42:06 +01:00
Surya Kasturi 9bf528877e Update run_squad.py 2019-01-30 15:09:31 -05:00
Surya Kasturi af2b78601b Update run_squad2.py 2019-01-30 15:08:56 -05:00
Girishkumar 0dd2b750ca Minor update in README
Update links to classes in `modeling.py`
2019-01-30 23:49:15 +05:30
Matej Svejda 5169069997 make examples consistent, revert error in num_train_steps calculation 2019-01-30 11:47:25 +01:00
thomwolf 3a848111e6 update config, docstrings and readme to switch to seperated tokens and position embeddings 2019-01-29 11:00:11 +01:00
thomwolf 98c96fb1a7 splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests 2019-01-29 10:31:42 +01:00
thomwolf 5456d82311 more versatile model loading 2019-01-29 09:54:18 +01:00
thomwolf 9b2540b5a7 update __init__ 2019-01-29 09:54:08 +01:00
thomwolf bd3b3aee9c update 2019-01-28 17:47:29 +01:00
thomwolf a45a9cc0e1 update tests 2019-01-28 17:16:02 +01:00
thomwolf b12616fd8e updating code organization to fix imports 2019-01-28 17:03:39 +01:00
thomwolf d77dd62ff8 directly load from TF checkpoints + code cleanup 2019-01-28 16:50:23 +01:00
Matej Svejda 9c6a48c8c3 fix learning rate/fp16 and warmup problem for all examples 2019-01-27 14:07:24 +01:00
Matej Svejda 01ff4f82ba learning rate problems in run_classifier.py 2019-01-22 23:40:06 +01:00