c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,091 Commits 171 Branches 49 Tags
89d627289890c8e556df72b7901260b038236e55
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf 89d6272898 Fix #1623 2019-11-04 16:21:12 +01:00
thomwolf ad90868627 Update example readme 2019-11-04 11:27:22 +01:00
thomwolf 328a86d2af adding links to the templates in readme and contributing 2019-10-30 11:37:55 +01:00
thomwolf 7f4226f9e6 adding templates 2019-10-30 11:31:56 +01:00
thomwolf 4d456542e9 Fix citation 2019-10-21 16:34:14 +02:00
thomwolf 56e2ee4ead fix model2model 2019-10-17 16:33:31 +02:00
thomwolf 8cd56e3036 fix data processing in script 2019-10-17 16:33:26 +02:00
thomwolf be916cb3fb Merge branch 'master' of https://github.com/huggingface/transformers 2019-10-15 10:37:13 +02:00
thomwolf 5875aaf762 install tensorboard 2019-10-15 10:36:46 +02:00
thomwolf 898ce064f8 add tests on TF2.0 & PT checkpoint => model convertion functions 2019-10-15 10:04:19 +02:00
thomwolf 2c1d5564ad add readme information 2019-10-15 09:56:52 +02:00
thomwolf c55badcee0 Add NER finetuning details by @stefan-it in example readme 2019-10-15 09:33:52 +02:00
thomwolf 0f9ebb0b43 add seqeval as requirement for examples 2019-10-15 09:17:31 +02:00
thomwolf 66adb71734 update to transformers 2019-10-15 09:17:31 +02:00
thomwolf d9d387afce clean up 2019-10-14 12:14:40 +02:00
thomwolf b7141a1bc6 maxi simplication 2019-10-14 12:14:08 +02:00
thomwolf bfbe68f035 update forward pass 2019-10-14 12:04:23 +02:00
thomwolf 0ef9bc923a Cleaning up seq2seq [WIP] 2019-10-14 11:58:13 +02:00
thomwolf 4b8f3e8f32 adding citation 2019-10-11 16:18:16 +02:00
thomwolf 18a3cef7d5 no nans 2019-10-11 16:09:42 +02:00
thomwolf 1f5d9513d8 fix test 2019-10-11 15:55:01 +02:00
thomwolf 0f9fc4fbde adding option to desactivate past/memory outputs 2019-10-11 15:47:08 +02:00
thomwolf 2a4fef837a move Circle-CI from TF2-rc0 to official TF2 2019-10-10 15:57:35 +02:00
thomwolf 751e246087 using tf.print in roberta 2019-10-10 15:47:20 +02:00
thomwolf c9e8c51946 fixing SequenceSummary head in TF 2.0 2019-10-10 15:16:05 +02:00
thomwolf da26bae61b adding more tests on TF and pytorch serialization - updating configuration for better serialization 2019-10-10 14:30:48 +02:00
thomwolf bb04edb45b Add tests that TF 2.0 model can be integrated with other Keras modules 2019-10-10 13:08:24 +02:00
thomwolf 177a721205 move back to simple space spliting 2019-10-10 11:45:47 +02:00
thomwolf a5997dd81a better error messages 2019-10-10 11:31:01 +02:00
thomwolf 43a237f15e switching to moses tokenizer 2019-10-10 10:11:16 +02:00
thomwolf d9e60f4f0d Merge branch 'master' into pr/1383 2019-10-09 17:25:08 +02:00
thomwolf 07d055f849 higher tolerance 2019-10-09 17:10:04 +02:00
thomwolf 48b438ff2a doc and conversion 2019-10-09 17:06:30 +02:00
thomwolf c19b8e4ae0 fixing CTRL tests and OpenAI GPT tests 2019-10-09 13:51:05 +02:00
thomwolf 6dce6dda1b fixing TF 2.0 model - adding more severe test on pt/tf equivalence 2019-10-09 11:57:55 +02:00
thomwolf c56d921dda adding TF 2.0 model 2019-10-09 11:07:43 +02:00
thomwolf 1c5079952f simpler distilbert mask - fix tf tests 2019-10-09 04:26:20 +02:00
thomwolf 23b7138ab4 fix #1378 and #1453 2019-10-09 01:54:44 +02:00
thomwolf 45dc04f33d tf model [WIP] 2019-10-08 17:37:17 +02:00
thomwolf 248314772f fix tokenization 2019-10-08 17:19:28 +02:00
thomwolf 03c2c762a6 update tokenizer 2019-10-08 17:12:03 +02:00
thomwolf 3edfa1d6aa update model to use past 2019-10-08 17:11:58 +02:00
thomwolf bd5363cc83 update CTRL configuration 2019-10-07 15:37:30 +02:00
thomwolf dc89441167 update CTRL pytorch model 2019-10-07 15:37:25 +02:00
thomwolf 320b7a7e01 fix #1416 2019-10-07 14:26:59 +02:00
thomwolf 78ef1a9930 fixes 2019-10-04 17:59:44 -04:00
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
thomwolf 92c0f2fb90 Merge remote-tracking branch 'origin/julien_multiple-choice' into encoding-qol 2019-10-04 15:48:06 -04:00
thomwolf 391db836ab fix #1260 - remove special logic for decoding pairs of sequence 2019-10-01 19:09:13 -04:00
thomwolf f7978f70ec use format instead of f-strings 2019-10-01 18:45:38 -04:00
thomwolf c50783e388 Merge branch 'pooler_end_logits_fp16_fix' of https://github.com/slayton58/pytorch-transformers into pr/1284 2019-10-01 18:17:48 -04:00
thomwolf da2e47ad15 clean up a little run_tf_glue 2019-09-27 09:41:15 +02:00
thomwolf 528c288fa9 clean up run_tf_glue 2019-09-27 09:40:29 +02:00
thomwolf 6c3b131516 typo in readme/doc 2019-09-26 16:23:28 +02:00
thomwolf f83b35b77d Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 16:14:23 +02:00
thomwolf 4e63c90720 update installation instructions in readme 2019-09-26 16:14:21 +02:00
thomwolf e4e35296fb update setup.py metadata 2019-09-26 13:52:24 +02:00
thomwolf 1d646badbb Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 13:48:00 +02:00
thomwolf 9676d1a2a8 update readme and setup.py 2019-09-26 13:47:58 +02:00
thomwolf 4dde31cb76 update readme 2019-09-26 12:18:26 +02:00
thomwolf 80bf868a26 Merge branch 'master' into tf2 2019-09-26 12:04:47 +02:00
thomwolf 481d9c4fb5 Merge branch 'master' into tf2 2019-09-26 12:02:54 +02:00
thomwolf 4ddc31ff40 update readme with migration change 2019-09-26 12:00:38 +02:00
thomwolf f47f7f4611 add logo 2019-09-26 11:28:44 +02:00
thomwolf 9fabc0b6a9 wip readme 2019-09-26 11:21:34 +02:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf 2f071fcb02 clean up TFConv1D API 2019-09-26 10:09:45 +02:00
thomwolf 5705333441 add initialization for everybody 2019-09-26 10:06:20 +02:00
thomwolf f2a337b3ed fix tokenization tests for gpt2 roberta 2019-09-26 09:02:43 +02:00
thomwolf 7a99e4b196 fix #1196 and fix #1285 2019-09-26 08:41:02 +02:00
thomwolf 7c9f8f93f9 fix tests 2019-09-26 01:59:53 +02:00
thomwolf d6dde438ea add batch dimension in encode 2019-09-26 01:45:55 +02:00
thomwolf 4a21c4d88d add warning if neither pt nor tf are found 2019-09-26 01:30:06 +02:00
thomwolf 2967de06f4 adding intialization to bert 2019-09-25 22:08:38 +02:00
thomwolf a6bcfb8015 fix tests 2019-09-25 21:14:12 +02:00
thomwolf 78863f6b36 fix tokenizer to tensors 2019-09-25 21:09:46 +02:00
thomwolf 8a618e0af5 clean up __init__ 2019-09-25 21:04:52 +02:00
thomwolf 3b7fb48c3b fix loading from tf/pt 2019-09-25 17:46:16 +02:00
thomwolf a049c8043b push fix to training 2019-09-25 17:33:16 +02:00
thomwolf 5def3302f4 update run_glue 2019-09-25 12:38:08 +02:00
thomwolf f71758f7a4 update internal glue processors 2019-09-25 12:00:50 +02:00
thomwolf 0f091062d4 Merge branch 'glue-example' into tf2 2019-09-25 10:21:52 +02:00
thomwolf c4acc3a8e9 let encode accept tensor inputs 2019-09-25 10:19:14 +02:00
thomwolf 789ea72037 fix output_token_type in glue 2019-09-24 17:32:01 +02:00
thomwolf 1cbd566c63 Merge branch 'glue-example' into glue-included 2019-09-24 17:24:52 +02:00
thomwolf 743e383d4b py2 fix 2019-09-24 17:21:54 +02:00
thomwolf 99a90e43d4 update data processors __init__ 2019-09-24 17:16:46 +02:00
thomwolf b5ec526f85 updated data processor and metrics 2019-09-24 17:10:50 +02:00
thomwolf a6981076ec various updates 2019-09-24 16:46:26 +02:00
thomwolf 128bdd4c35 fix tests pt/tf 2019-09-24 15:43:39 +02:00
thomwolf 28a30af6d1 fix auto models 2019-09-24 15:33:39 +02:00
thomwolf de203853cc docstring for xlnet 2019-09-24 15:30:55 +02:00
thomwolf 559790f9e4 docstring for xlm 2019-09-24 15:26:57 +02:00
thomwolf b3087ddde8 docstring t-xl 2019-09-24 15:21:51 +02:00
thomwolf 4761a39781 doctring roberta 2019-09-24 15:19:09 +02:00
thomwolf 45a6f2edd9 docstring for GPT 2019-09-24 15:15:47 +02:00
thomwolf e7ba5bc85b docstring for GPT2 2019-09-24 15:12:36 +02:00
thomwolf b94f73bab7 distilbert docstring 2019-09-24 15:06:51 +02:00
thomwolf 9678c49419 docstrings for bert 2019-09-24 14:57:05 +02:00
thomwolf f3d1511b5b fix imports 2019-09-24 14:42:09 +02:00