Commit Graph
100 Commits
Author SHA1 Message Date
thomwolf cbb368ca06 distilbert tests 2019-12-14 09:31:18 +01:00
thomwolf 5c00e344c1 update model doc - swith 3B/11B to 3b/11b 2019-12-13 16:33:29 +01:00
thomwolf 33e72b08d5 fix inner dimensions for 3B/11B models 2019-12-13 11:33:05 +01:00
thomwolf f19dad61c7 fixing XLM conversion tests with dummy input 2019-12-12 14:46:30 +01:00
thomwolf 413f41921b fix merge 2019-12-12 07:34:42 +01:00
thomwolf 29570db25b allowing from_pretrained to load from url directly 2019-12-11 17:19:18 +01:00
thomwolf fafd4c86ec fix TF 2.0 version of T5 - update conversion script 2019-12-11 13:47:27 +01:00
thomwolf 67a8be8e90 fix backward in tests 2019-12-10 17:50:32 +01:00
thomwolf f2538c1274 all tests in torch no grad 2019-12-10 16:33:11 +01:00
thomwolf a5df980c5b updating distilbert test 2019-12-10 16:01:15 +01:00
thomwolf 7c3a15ace9 Merge branch 'master' into t5 2019-12-10 15:36:54 +01:00
thomwolf 981a5c8c17 updating models urls 2019-12-10 15:36:19 +01:00
thomwolf 8ae1044f80 updating tests and TF 2.0 model 2019-12-10 15:11:07 +01:00
thomwolf 0558c9cb9b Merge branch 'master' into t5 2019-12-10 12:58:48 +01:00
thomwolf 608a8f5b56 updating tf 2.0 layer_norm to T5 layer norm 2019-12-10 10:01:01 +01:00
thomwolf 8e651f56b7 fix tf tests 2019-12-09 22:13:57 +01:00
thomwolf 808bb8da7e fix transfo xl tests 2019-12-09 21:48:34 +01:00
thomwolf b016dd16c9 fix tests on python 3.5 2019-12-09 21:38:07 +01:00
thomwolf 169fea6855 updating T5 2019-12-09 16:25:33 +01:00
thomwolf 1d87b37d10 updating 2019-12-06 15:30:09 +01:00
thomwolf f8fb4335c9 clean up a little bit PT <=> TF conversion 2019-12-05 15:19:32 +01:00
thomwolf 18fb93530b fixing #2042 - Nicer error message 2019-12-05 14:36:34 +01:00
thomwolf 2d5d86e037 fix #2031 2019-12-05 14:06:29 +01:00
thomwolf 3268ebd229 fix xlnet test 2019-12-05 13:35:29 +01:00
thomwolf 6c5297a423 Fixing camembert tokenization 2019-12-05 13:27:58 +01:00
thomwolf 71e4693f08 fix #1968 2019-12-05 12:14:24 +01:00
thomwolf 75a97af6bc fix #1450 - add doc 2019-12-05 11:26:55 +01:00
thomwolf 8b388827b5 fix #1920 2019-12-05 11:18:43 +01:00
thomwolf 5bfcd0485e fix #1991 2019-12-04 14:53:11 +01:00
thomwolf f3776df0f3 WIP debugging 2019-12-02 15:47:00 +01:00
thomwolf 4a666885b5 reducing my level of enthousiasm 2019-11-29 09:40:50 -05:00
thomwolf adb5c79ff2 update all tf.shape and tensor.shape to shape_list 2019-11-29 09:40:50 -05:00
thomwolf 8da47b078d fix merge tests 2019-11-27 23:11:37 +01:00
thomwolf 8aba81a0b6 fix #1789 2019-11-12 08:52:43 +01:00
thomwolf 268d4f2099 fix position biases + better tests 2019-11-08 16:41:55 +01:00
thomwolf b4fcd59a5a add sentinels in tokenizer 2019-11-08 14:38:53 +01:00
thomwolf 15e53c4e87 maybe fix tests 2019-11-08 12:43:21 +01:00
thomwolf f03c0c1423 adding models in readme and auto classes 2019-11-08 11:49:46 +01:00
thomwolf 4321c54125 fix tests 2019-11-08 11:49:32 +01:00
thomwolf 727a79b305 added TF2 model and tests - updated templates 2019-11-08 11:35:03 +01:00
thomwolf 8fda532c3c fix python 2 sentencepiece tokenization 2019-11-07 17:09:50 +01:00
thomwolf ba10065c4b update model, conversion script, tests and template 2019-11-07 15:55:36 +01:00
thomwolf 076a207935 adding tests and updating model 2019-11-06 11:52:50 +01:00
thomwolf 73f2c342f5 fixing template 2019-11-06 11:52:39 +01:00
thomwolf 3835e1e651 adding tokenizer 2019-11-06 11:52:29 +01:00
thomwolf 88e5bef58f share position biases 2019-11-05 17:02:52 +01:00
thomwolf 568c0ffb7e adding T5 model 2019-11-05 16:40:29 +01:00
thomwolf 60a5babd57 adding files 2019-11-05 12:01:23 +01:00
thomwolf f1e4db2aa8 Fix #1686 2019-11-05 09:38:00 +01:00
thomwolf 8d6b9d717c fix #1532 and encode_plus 2019-11-04 17:07:51 +01:00
thomwolf 89d6272898 Fix #1623 2019-11-04 16:21:12 +01:00
thomwolf b340a910ed fix tests - flagged as slow all the tests downloading from AWS 2019-11-04 16:03:36 +01:00
thomwolf f02805da6f fix tests 2019-11-04 15:42:23 +01:00
thomwolf 1724cee8c4 switch from properties to methods 2019-11-04 15:34:10 +01:00
thomwolf 9b45d0f878 Add common properties input_embeddings and output_embeddings 2019-11-04 12:28:56 +01:00
thomwolf ad90868627 Update example readme 2019-11-04 11:27:22 +01:00
thomwolf 328a86d2af adding links to the templates in readme and contributing 2019-10-30 11:37:55 +01:00
thomwolf 7f4226f9e6 adding templates 2019-10-30 11:31:56 +01:00
thomwolf 4d456542e9 Fix citation 2019-10-21 16:34:14 +02:00
thomwolf 56e2ee4ead fix model2model 2019-10-17 16:33:31 +02:00
thomwolf 8cd56e3036 fix data processing in script 2019-10-17 16:33:26 +02:00
thomwolf be916cb3fb Merge branch 'master' of https://github.com/huggingface/transformers 2019-10-15 10:37:13 +02:00
thomwolf 5875aaf762 install tensorboard 2019-10-15 10:36:46 +02:00
thomwolf 898ce064f8 add tests on TF2.0 & PT checkpoint => model convertion functions 2019-10-15 10:04:19 +02:00
thomwolf 2c1d5564ad add readme information 2019-10-15 09:56:52 +02:00
thomwolf c55badcee0 Add NER finetuning details by @stefan-it in example readme 2019-10-15 09:33:52 +02:00
thomwolf 0f9ebb0b43 add seqeval as requirement for examples 2019-10-15 09:17:31 +02:00
thomwolf 66adb71734 update to transformers 2019-10-15 09:17:31 +02:00
thomwolf d9d387afce clean up 2019-10-14 12:14:40 +02:00
thomwolf b7141a1bc6 maxi simplication 2019-10-14 12:14:08 +02:00
thomwolf bfbe68f035 update forward pass 2019-10-14 12:04:23 +02:00
thomwolf 0ef9bc923a Cleaning up seq2seq [WIP] 2019-10-14 11:58:13 +02:00
thomwolf 4b8f3e8f32 adding citation 2019-10-11 16:18:16 +02:00
thomwolf 18a3cef7d5 no nans 2019-10-11 16:09:42 +02:00
thomwolf 1f5d9513d8 fix test 2019-10-11 15:55:01 +02:00
thomwolf 0f9fc4fbde adding option to desactivate past/memory outputs 2019-10-11 15:47:08 +02:00
thomwolf 2a4fef837a move Circle-CI from TF2-rc0 to official TF2 2019-10-10 15:57:35 +02:00
thomwolf 751e246087 using tf.print in roberta 2019-10-10 15:47:20 +02:00
thomwolf c9e8c51946 fixing SequenceSummary head in TF 2.0 2019-10-10 15:16:05 +02:00
thomwolf da26bae61b adding more tests on TF and pytorch serialization - updating configuration for better serialization 2019-10-10 14:30:48 +02:00
thomwolf bb04edb45b Add tests that TF 2.0 model can be integrated with other Keras modules 2019-10-10 13:08:24 +02:00
thomwolf 177a721205 move back to simple space spliting 2019-10-10 11:45:47 +02:00
thomwolf a5997dd81a better error messages 2019-10-10 11:31:01 +02:00
thomwolf 43a237f15e switching to moses tokenizer 2019-10-10 10:11:16 +02:00
thomwolf d9e60f4f0d Merge branch 'master' into pr/1383 2019-10-09 17:25:08 +02:00
thomwolf 07d055f849 higher tolerance 2019-10-09 17:10:04 +02:00
thomwolf 48b438ff2a doc and conversion 2019-10-09 17:06:30 +02:00
thomwolf c19b8e4ae0 fixing CTRL tests and OpenAI GPT tests 2019-10-09 13:51:05 +02:00
thomwolf 6dce6dda1b fixing TF 2.0 model - adding more severe test on pt/tf equivalence 2019-10-09 11:57:55 +02:00
thomwolf c56d921dda adding TF 2.0 model 2019-10-09 11:07:43 +02:00
thomwolf 1c5079952f simpler distilbert mask - fix tf tests 2019-10-09 04:26:20 +02:00
thomwolf 23b7138ab4 fix #1378 and #1453 2019-10-09 01:54:44 +02:00
thomwolf 45dc04f33d tf model [WIP] 2019-10-08 17:37:17 +02:00
thomwolf 248314772f fix tokenization 2019-10-08 17:19:28 +02:00
thomwolf 03c2c762a6 update tokenizer 2019-10-08 17:12:03 +02:00
thomwolf 3edfa1d6aa update model to use past 2019-10-08 17:11:58 +02:00
thomwolf bd5363cc83 update CTRL configuration 2019-10-07 15:37:30 +02:00
thomwolf dc89441167 update CTRL pytorch model 2019-10-07 15:37:25 +02:00
thomwolf 320b7a7e01 fix #1416 2019-10-07 14:26:59 +02:00
thomwolf 78ef1a9930 fixes 2019-10-04 17:59:44 -04:00