Commit Graph
100 Commits
Author SHA1 Message Date
thomwolf dc667ce1a7 double check cc @LysandreJik 2019-12-14 09:56:27 +01:00
thomwolf 1d87b37d10 updating 2019-12-06 15:30:09 +01:00
thomwolf f8fb4335c9 clean up a little bit PT <=> TF conversion 2019-12-05 15:19:32 +01:00
thomwolf 18fb93530b fixing #2042 - Nicer error message 2019-12-05 14:36:34 +01:00
thomwolf 2d5d86e037 fix #2031 2019-12-05 14:06:29 +01:00
thomwolf 3268ebd229 fix xlnet test 2019-12-05 13:35:29 +01:00
thomwolf 6c5297a423 Fixing camembert tokenization 2019-12-05 13:27:58 +01:00
thomwolf 71e4693f08 fix #1968 2019-12-05 12:14:24 +01:00
thomwolf 75a97af6bc fix #1450 - add doc 2019-12-05 11:26:55 +01:00
thomwolf 8b388827b5 fix #1920 2019-12-05 11:18:43 +01:00
thomwolf 5bfcd0485e fix #1991 2019-12-04 14:53:11 +01:00
thomwolf 4a666885b5 reducing my level of enthousiasm 2019-11-29 09:40:50 -05:00
thomwolf adb5c79ff2 update all tf.shape and tensor.shape to shape_list 2019-11-29 09:40:50 -05:00
thomwolf 8da47b078d fix merge tests 2019-11-27 23:11:37 +01:00
thomwolf 8aba81a0b6 fix #1789 2019-11-12 08:52:43 +01:00
thomwolf f1e4db2aa8 Fix #1686 2019-11-05 09:38:00 +01:00
thomwolf 8d6b9d717c fix #1532 and encode_plus 2019-11-04 17:07:51 +01:00
thomwolf 89d6272898 Fix #1623 2019-11-04 16:21:12 +01:00
thomwolf b340a910ed fix tests - flagged as slow all the tests downloading from AWS 2019-11-04 16:03:36 +01:00
thomwolf f02805da6f fix tests 2019-11-04 15:42:23 +01:00
thomwolf 1724cee8c4 switch from properties to methods 2019-11-04 15:34:10 +01:00
thomwolf 9b45d0f878 Add common properties input_embeddings and output_embeddings 2019-11-04 12:28:56 +01:00
thomwolf ad90868627 Update example readme 2019-11-04 11:27:22 +01:00
thomwolf 328a86d2af adding links to the templates in readme and contributing 2019-10-30 11:37:55 +01:00
thomwolf 7f4226f9e6 adding templates 2019-10-30 11:31:56 +01:00
thomwolf 4d456542e9 Fix citation 2019-10-21 16:34:14 +02:00
thomwolf 56e2ee4ead fix model2model 2019-10-17 16:33:31 +02:00
thomwolf 8cd56e3036 fix data processing in script 2019-10-17 16:33:26 +02:00
thomwolf be916cb3fb Merge branch 'master' of https://github.com/huggingface/transformers 2019-10-15 10:37:13 +02:00
thomwolf 5875aaf762 install tensorboard 2019-10-15 10:36:46 +02:00
thomwolf 898ce064f8 add tests on TF2.0 & PT checkpoint => model convertion functions 2019-10-15 10:04:19 +02:00
thomwolf 2c1d5564ad add readme information 2019-10-15 09:56:52 +02:00
thomwolf c55badcee0 Add NER finetuning details by @stefan-it in example readme 2019-10-15 09:33:52 +02:00
thomwolf 0f9ebb0b43 add seqeval as requirement for examples 2019-10-15 09:17:31 +02:00
thomwolf 66adb71734 update to transformers 2019-10-15 09:17:31 +02:00
thomwolf d9d387afce clean up 2019-10-14 12:14:40 +02:00
thomwolf b7141a1bc6 maxi simplication 2019-10-14 12:14:08 +02:00
thomwolf bfbe68f035 update forward pass 2019-10-14 12:04:23 +02:00
thomwolf 0ef9bc923a Cleaning up seq2seq [WIP] 2019-10-14 11:58:13 +02:00
thomwolf 4b8f3e8f32 adding citation 2019-10-11 16:18:16 +02:00
thomwolf 18a3cef7d5 no nans 2019-10-11 16:09:42 +02:00
thomwolf 1f5d9513d8 fix test 2019-10-11 15:55:01 +02:00
thomwolf 0f9fc4fbde adding option to desactivate past/memory outputs 2019-10-11 15:47:08 +02:00
thomwolf 2a4fef837a move Circle-CI from TF2-rc0 to official TF2 2019-10-10 15:57:35 +02:00
thomwolf 751e246087 using tf.print in roberta 2019-10-10 15:47:20 +02:00
thomwolf c9e8c51946 fixing SequenceSummary head in TF 2.0 2019-10-10 15:16:05 +02:00
thomwolf da26bae61b adding more tests on TF and pytorch serialization - updating configuration for better serialization 2019-10-10 14:30:48 +02:00
thomwolf bb04edb45b Add tests that TF 2.0 model can be integrated with other Keras modules 2019-10-10 13:08:24 +02:00
thomwolf 177a721205 move back to simple space spliting 2019-10-10 11:45:47 +02:00
thomwolf a5997dd81a better error messages 2019-10-10 11:31:01 +02:00
thomwolf 43a237f15e switching to moses tokenizer 2019-10-10 10:11:16 +02:00
thomwolf d9e60f4f0d Merge branch 'master' into pr/1383 2019-10-09 17:25:08 +02:00
thomwolf 07d055f849 higher tolerance 2019-10-09 17:10:04 +02:00
thomwolf 48b438ff2a doc and conversion 2019-10-09 17:06:30 +02:00
thomwolf c19b8e4ae0 fixing CTRL tests and OpenAI GPT tests 2019-10-09 13:51:05 +02:00
thomwolf 6dce6dda1b fixing TF 2.0 model - adding more severe test on pt/tf equivalence 2019-10-09 11:57:55 +02:00
thomwolf c56d921dda adding TF 2.0 model 2019-10-09 11:07:43 +02:00
thomwolf 1c5079952f simpler distilbert mask - fix tf tests 2019-10-09 04:26:20 +02:00
thomwolf 23b7138ab4 fix #1378 and #1453 2019-10-09 01:54:44 +02:00
thomwolf 45dc04f33d tf model [WIP] 2019-10-08 17:37:17 +02:00
thomwolf 248314772f fix tokenization 2019-10-08 17:19:28 +02:00
thomwolf 03c2c762a6 update tokenizer 2019-10-08 17:12:03 +02:00
thomwolf 3edfa1d6aa update model to use past 2019-10-08 17:11:58 +02:00
thomwolf bd5363cc83 update CTRL configuration 2019-10-07 15:37:30 +02:00
thomwolf dc89441167 update CTRL pytorch model 2019-10-07 15:37:25 +02:00
thomwolf 320b7a7e01 fix #1416 2019-10-07 14:26:59 +02:00
thomwolf 78ef1a9930 fixes 2019-10-04 17:59:44 -04:00
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
thomwolf 92c0f2fb90 Merge remote-tracking branch 'origin/julien_multiple-choice' into encoding-qol 2019-10-04 15:48:06 -04:00
thomwolf 391db836ab fix #1260 - remove special logic for decoding pairs of sequence 2019-10-01 19:09:13 -04:00
thomwolf f7978f70ec use format instead of f-strings 2019-10-01 18:45:38 -04:00
thomwolf c50783e388 Merge branch 'pooler_end_logits_fp16_fix' of https://github.com/slayton58/pytorch-transformers into pr/1284 2019-10-01 18:17:48 -04:00
thomwolf da2e47ad15 clean up a little run_tf_glue 2019-09-27 09:41:15 +02:00
thomwolf 528c288fa9 clean up run_tf_glue 2019-09-27 09:40:29 +02:00
thomwolf 6c3b131516 typo in readme/doc 2019-09-26 16:23:28 +02:00
thomwolf f83b35b77d Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 16:14:23 +02:00
thomwolf 4e63c90720 update installation instructions in readme 2019-09-26 16:14:21 +02:00
thomwolf e4e35296fb update setup.py metadata 2019-09-26 13:52:24 +02:00
thomwolf 1d646badbb Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-09-26 13:48:00 +02:00
thomwolf 9676d1a2a8 update readme and setup.py 2019-09-26 13:47:58 +02:00
thomwolf 4dde31cb76 update readme 2019-09-26 12:18:26 +02:00
thomwolf 80bf868a26 Merge branch 'master' into tf2 2019-09-26 12:04:47 +02:00
thomwolf 481d9c4fb5 Merge branch 'master' into tf2 2019-09-26 12:02:54 +02:00
thomwolf 4ddc31ff40 update readme with migration change 2019-09-26 12:00:38 +02:00
thomwolf f47f7f4611 add logo 2019-09-26 11:28:44 +02:00
thomwolf 9fabc0b6a9 wip readme 2019-09-26 11:21:34 +02:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf 2f071fcb02 clean up TFConv1D API 2019-09-26 10:09:45 +02:00
thomwolf 5705333441 add initialization for everybody 2019-09-26 10:06:20 +02:00
thomwolf f2a337b3ed fix tokenization tests for gpt2 roberta 2019-09-26 09:02:43 +02:00
thomwolf 7a99e4b196 fix #1196 and fix #1285 2019-09-26 08:41:02 +02:00
thomwolf 7c9f8f93f9 fix tests 2019-09-26 01:59:53 +02:00
thomwolf d6dde438ea add batch dimension in encode 2019-09-26 01:45:55 +02:00
thomwolf 4a21c4d88d add warning if neither pt nor tf are found 2019-09-26 01:30:06 +02:00
thomwolf 2967de06f4 adding intialization to bert 2019-09-25 22:08:38 +02:00
thomwolf a6bcfb8015 fix tests 2019-09-25 21:14:12 +02:00
thomwolf 78863f6b36 fix tokenizer to tensors 2019-09-25 21:09:46 +02:00
thomwolf 8a618e0af5 clean up __init__ 2019-09-25 21:04:52 +02:00
thomwolf 3b7fb48c3b fix loading from tf/pt 2019-09-25 17:46:16 +02:00
thomwolf a049c8043b push fix to training 2019-09-25 17:33:16 +02:00