c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,820 Commits 171 Branches 49 Tags
6c1d0bc0665ef01710db301fb1a0a3c23778714a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
thomwolf 92c0f2fb90 Merge remote-tracking branch 'origin/julien_multiple-choice' into encoding-qol 2019-10-04 15:48:06 -04:00
thomwolf 391db836ab fix #1260 - remove special logic for decoding pairs of sequence 2019-10-01 19:09:13 -04:00
thomwolf f7978f70ec use format instead of f-strings 2019-10-01 18:45:38 -04:00
thomwolf c50783e388 Merge branch 'pooler_end_logits_fp16_fix' of https://github.com/slayton58/pytorch-transformers into pr/1284 2019-10-01 18:17:48 -04:00
thomwolf da2e47ad15 clean up a little run_tf_glue 2019-09-27 09:41:15 +02:00
thomwolf 528c288fa9 clean up run_tf_glue 2019-09-27 09:40:29 +02:00
thomwolf 6c3b131516 typo in readme/doc 2019-09-26 16:23:28 +02:00
thomwolf f83b35b77d Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 16:14:23 +02:00
thomwolf 4e63c90720 update installation instructions in readme 2019-09-26 16:14:21 +02:00
thomwolf e4e35296fb update setup.py metadata 2019-09-26 13:52:24 +02:00
thomwolf 1d646badbb Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 13:48:00 +02:00
thomwolf 9676d1a2a8 update readme and setup.py 2019-09-26 13:47:58 +02:00
thomwolf 4dde31cb76 update readme 2019-09-26 12:18:26 +02:00
thomwolf 80bf868a26 Merge branch 'master' into tf2 2019-09-26 12:04:47 +02:00
thomwolf 481d9c4fb5 Merge branch 'master' into tf2 2019-09-26 12:02:54 +02:00
thomwolf 4ddc31ff40 update readme with migration change 2019-09-26 12:00:38 +02:00
thomwolf f47f7f4611 add logo 2019-09-26 11:28:44 +02:00
thomwolf 9fabc0b6a9 wip readme 2019-09-26 11:21:34 +02:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf 2f071fcb02 clean up TFConv1D API 2019-09-26 10:09:45 +02:00
thomwolf 5705333441 add initialization for everybody 2019-09-26 10:06:20 +02:00
thomwolf f2a337b3ed fix tokenization tests for gpt2 roberta 2019-09-26 09:02:43 +02:00
thomwolf 7a99e4b196 fix #1196 and fix #1285 2019-09-26 08:41:02 +02:00
thomwolf 7c9f8f93f9 fix tests 2019-09-26 01:59:53 +02:00
thomwolf d6dde438ea add batch dimension in encode 2019-09-26 01:45:55 +02:00
thomwolf 4a21c4d88d add warning if neither pt nor tf are found 2019-09-26 01:30:06 +02:00
thomwolf 2967de06f4 adding intialization to bert 2019-09-25 22:08:38 +02:00
thomwolf a6bcfb8015 fix tests 2019-09-25 21:14:12 +02:00
thomwolf 78863f6b36 fix tokenizer to tensors 2019-09-25 21:09:46 +02:00
thomwolf 8a618e0af5 clean up __init__ 2019-09-25 21:04:52 +02:00
thomwolf 3b7fb48c3b fix loading from tf/pt 2019-09-25 17:46:16 +02:00
thomwolf a049c8043b push fix to training 2019-09-25 17:33:16 +02:00
thomwolf 5def3302f4 update run_glue 2019-09-25 12:38:08 +02:00
thomwolf f71758f7a4 update internal glue processors 2019-09-25 12:00:50 +02:00
thomwolf 0f091062d4 Merge branch 'glue-example' into tf2 2019-09-25 10:21:52 +02:00
thomwolf c4acc3a8e9 let encode accept tensor inputs 2019-09-25 10:19:14 +02:00
thomwolf 789ea72037 fix output_token_type in glue 2019-09-24 17:32:01 +02:00
thomwolf 1cbd566c63 Merge branch 'glue-example' into glue-included 2019-09-24 17:24:52 +02:00
thomwolf 743e383d4b py2 fix 2019-09-24 17:21:54 +02:00
thomwolf 99a90e43d4 update data processors __init__ 2019-09-24 17:16:46 +02:00
thomwolf b5ec526f85 updated data processor and metrics 2019-09-24 17:10:50 +02:00
thomwolf a6981076ec various updates 2019-09-24 16:46:26 +02:00
thomwolf 128bdd4c35 fix tests pt/tf 2019-09-24 15:43:39 +02:00
thomwolf 28a30af6d1 fix auto models 2019-09-24 15:33:39 +02:00
thomwolf de203853cc docstring for xlnet 2019-09-24 15:30:55 +02:00
thomwolf 559790f9e4 docstring for xlm 2019-09-24 15:26:57 +02:00
thomwolf b3087ddde8 docstring t-xl 2019-09-24 15:21:51 +02:00
thomwolf 4761a39781 doctring roberta 2019-09-24 15:19:09 +02:00
thomwolf 45a6f2edd9 docstring for GPT 2019-09-24 15:15:47 +02:00
thomwolf e7ba5bc85b docstring for GPT2 2019-09-24 15:12:36 +02:00
thomwolf b94f73bab7 distilbert docstring 2019-09-24 15:06:51 +02:00
thomwolf 9678c49419 docstrings for bert 2019-09-24 14:57:05 +02:00
thomwolf f3d1511b5b fix imports 2019-09-24 14:42:09 +02:00
thomwolf dd2d90f344 update automodels 2019-09-24 14:39:41 +02:00
thomwolf ee261439a9 add save_pretrained 2019-09-24 14:30:28 +02:00
thomwolf 29bb3e4eb0 double loading ok 2019-09-24 14:23:46 +02:00
thomwolf f5397ffc3b update loading logics 2019-09-24 14:03:58 +02:00
thomwolf 271f213621 updating to load tf model in pt - fixing headmasking test 2019-09-24 13:51:28 +02:00
thomwolf cf9c1cbb60 fix tests chen only using tf 2019-09-24 13:32:47 +02:00
thomwolf 2167e366ba update circleCi 2019-09-24 13:27:45 +02:00
thomwolf e9a103c17a bidirectional conversion TF <=> PT - extended tests 2019-09-24 13:25:50 +02:00
thomwolf a7e01a248b converting distilled/fine-tuned models 2019-09-24 10:58:52 +02:00
thomwolf 8ba44ced95 fix roberta conversion script 2019-09-24 09:48:23 +02:00
thomwolf 2b11fa5174 update __init__ and conversion script 2019-09-23 22:35:45 +02:00
thomwolf 6448396d54 fix roberta test 2019-09-23 22:27:13 +02:00
thomwolf 1e47dee24c Merge branch 'tf2' of https://github.com/huggingface/pytorch-transformers into tf2 2019-09-23 22:08:10 +02:00
thomwolf c9591f6fac updated models input format + tests 2019-09-23 22:08:08 +02:00
thomwolf c014d1f0c6 fix the skipping 2019-09-23 16:39:57 +02:00
thomwolf 0b22e47a40 skipping pretrained TF model tests for now 2019-09-23 16:38:03 +02:00
thomwolf 830d212be7 test circleCI h5py version 2019-09-23 16:26:06 +02:00
thomwolf a31e591d27 fix XLM tests 2019-09-23 15:54:10 +02:00
thomwolf 447de34dde tests for distilbert and roberta 2019-09-23 15:38:29 +02:00
thomwolf 68a3e0223a roberta and distilbert 2019-09-20 23:14:51 +02:00
thomwolf 3a527fa820 OpenAI GPT tests ok 2019-09-18 14:15:48 +02:00
thomwolf 556442afb3 hot fix 2019-09-18 14:12:41 +02:00
thomwolf 160b5d6080 fix xlm lang_embeddings loading 2019-09-18 14:10:20 +02:00
thomwolf 26497d1199 fix tests 2019-09-18 12:17:21 +02:00
thomwolf 6a083fd447 update pt-tf conversion script 2019-09-18 12:11:32 +02:00
thomwolf f6969cc12b upgrade max model difference to 2e-2 (for transfo-xl adaptive softmax + inputs) 2019-09-18 11:12:02 +02:00
thomwolf e768f2322a update run_openai_gpt to fix #1264 2019-09-18 10:07:47 +02:00
thomwolf 8334993915 clean up examples - updated to new keyword inputs - #1246 2019-09-18 10:01:27 +02:00
thomwolf 45de034bf8 fix #1223 2019-09-17 10:25:06 +02:00
thomwolf c88f05163d fix typo in XLM models 2019-09-16 13:42:20 +02:00
thomwolf 4b956b2a6b add layer_norm_epsilon configuration for transformer xl 2019-09-13 17:09:20 +02:00
thomwolf b97af8cce9 skip finetuned checkpoints 2019-09-13 16:43:49 +02:00
thomwolf 65c49bb27e adding TF 2.0 adaptive softmax with logits + loss outputs 2019-09-13 15:50:51 +02:00
thomwolf 39c38b2ea0 fix 2019-09-12 16:47:11 +02:00
thomwolf dcddf498c8 fix bert layernorm 2019-09-12 16:46:32 +02:00
thomwolf d3a3a0353c clean up cache after conversion 2019-09-12 16:42:52 +02:00
thomwolf a84adddd1b convert all models 2019-09-12 13:14:07 +02:00
thomwolf 969d3ae95e XLMWithLMHead fixed - standardize conversion 2019-09-11 15:47:33 +02:00
thomwolf 646711e1e2 standardize scopes names - add conversion methods 2019-09-11 15:34:17 +02:00
thomwolf 4356f791a2 XLM passing tests 2019-09-11 11:49:54 +02:00
thomwolf 465870c33f Xlnet working - also added simple question answering model for XLNet 2019-09-10 16:44:41 +02:00
thomwolf 16b6361792 xlnet paassing first test 2019-09-10 12:39:27 +02:00
thomwolf 32aabe8c33 WIP XLNet 2019-09-10 12:17:18 +02:00
thomwolf f851fb55ca fixing error message 2019-09-10 09:24:08 +02:00
thomwolf 50c6bc4195 fix tf bert model 2019-09-09 17:46:01 +02:00
thomwolf 0537139b2b removing tf.function 2019-09-09 14:47:31 +02:00