c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,033 Commits 171 Branches 49 Tags
2918b7d2a09d7253b338c004258866da41cd6642
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf 2918b7d2a0 updating tests 2019-07-12 10:57:58 +02:00
thomwolf bd404735a7 embeddings resizing + tie_weights 2019-07-12 00:02:49 +02:00
thomwolf 273617b86d update config - fix gpt/gpt-2 from pretrained 2019-07-11 22:45:03 +02:00
thomwolf 6b13f4cb3a update circle-ci 2019-07-11 22:36:35 +02:00
thomwolf 2b644785f0 add tests on examples and large circle ci config 2019-07-11 22:31:50 +02:00
thomwolf c6bf1a400d fix test examples et model pretrained 2019-07-11 22:29:08 +02:00
thomwolf 92a782b108 fix run_glue test 2019-07-11 22:20:10 +02:00
thomwolf ccb6947dc1 optimization tests 2019-07-11 17:39:47 +02:00
thomwolf 6135de2fa3 readme update 2019-07-11 15:39:49 +02:00
thomwolf b21d84b027 update examples 2019-07-11 15:37:34 +02:00
thomwolf ec07cf5a66 rewamp optimization 2019-07-11 14:48:22 +02:00
thomwolf 4fef5919a5 updating examples 2019-07-11 12:03:08 +02:00
thomwolf 50b7e52a7f WIP examples 2019-07-10 15:33:34 +02:00
thomwolf ed6c8d37f4 fix merge 2019-07-09 17:14:52 +02:00
thomwolf e468192e2f Merge branch 'pytorch-transformers' into xlnet 2019-07-09 17:05:37 +02:00
thomwolf 4ce237c880 update run_glue 2019-07-09 17:00:32 +02:00
thomwolf 3b7cb7bf44 small update to run_glue 2019-07-09 16:12:15 +02:00
thomwolf d743f2f34e updating test 2019-07-09 15:58:58 +02:00
thomwolf d0efbd3cd1 update sequencesummary module 2019-07-09 15:46:43 +02:00
thomwolf d5481cbe1b adding tests to examples - updating summary module - coverage update 2019-07-09 15:29:42 +02:00
thomwolf c079d7ddff fix python 2 tests 2019-07-09 10:40:59 +02:00
thomwolf b19786985d unified tokenizer api and serialization + tests 2019-07-09 10:25:18 +02:00
thomwolf 3d5f291386 updates to run_glue 2019-07-05 17:22:15 +02:00
thomwolf 99b90edab1 cleaning up run_glue example 2019-07-05 17:09:35 +02:00
thomwolf 1113f97f33 clean up glue example 2019-07-05 16:31:13 +02:00
thomwolf 162ba383b0 fix model loading 2019-07-05 15:57:14 +02:00
thomwolf 6dacc79d39 fix python2 tests 2019-07-05 15:11:59 +02:00
thomwolf 36bca545ff tokenization abstract class - tests for examples 2019-07-05 15:02:59 +02:00
thomwolf a4f980547f remove circle ci parallelism 2019-07-05 12:31:34 +02:00
thomwolf eb91f6437e update readme and setup 2019-07-05 12:30:15 +02:00
thomwolf 0231ba291e circle-ci 2019-07-05 11:59:04 +02:00
thomwolf 0bab55d5d5 [BIG] name change 2019-07-05 11:55:36 +02:00
thomwolf 9113b50c96 hubs [WIP] 2019-07-05 11:31:51 +02:00
thomwolf e75c3f70aa standardizing tokenizers API and adding tests 2019-07-05 11:20:27 +02:00
thomwolf c0239e09e6 first commit 2019-07-04 17:06:30 +02:00
thomwolf cf86d23eff parallelism in circlci 2019-07-04 17:02:21 +02:00
thomwolf 15b70338ba adding squad model to xlnet and xlm 2019-07-04 16:50:42 +02:00
thomwolf fbe04423b6 Common SequenceSummary class 2019-07-04 00:25:30 +02:00
thomwolf c22545aa40 fix xlm torchscript 2019-07-03 23:03:57 +02:00
thomwolf 3b23a846b6 Merge branch 'xlnet' of https://github.com/huggingface/pytorch-pretrained-BERT into xlnet 2019-07-03 22:54:58 +02:00
thomwolf 8fa3a1f0d8 updating tests 2019-07-03 22:54:53 +02:00
thomwolf c41f2bad69 WIP XLM + refactoring 2019-07-03 22:54:39 +02:00
thomwolf 288be7b7ea xlm 2019-07-02 23:42:31 +02:00
thomwolf 7ed5bf706f add tests 2019-07-02 16:42:22 +02:00
thomwolf 708877958a updating tests and models, adding weights initialization test 2019-07-02 16:35:29 +02:00
thomwolf 99ae5ab883 update config tests and circle-ci 2019-07-02 12:40:39 +02:00
thomwolf 1484d67de9 [LARGE] updating all tests and API 2019-07-02 12:13:17 +02:00
thomwolf 4f8b5f687c add fix for serialization of tokenizer 2019-06-29 23:35:21 +02:00
thomwolf d9184620f9 fix tests and new API 2019-06-29 23:10:40 +02:00
thomwolf 213981d8cb updating bert API 2019-06-28 16:45:24 +02:00
thomwolf 2b56e98892 standardizing API across models - XLNetForSeqClass working 2019-06-28 16:35:09 +02:00
thomwolf 3a00674cbf fix imports 2019-06-27 17:18:46 +02:00
thomwolf d939d6fd02 fix hidden-state extraction 2019-06-27 09:39:44 +02:00
thomwolf 0c2ff34815 extracting double hidden-state from xlnet 2019-06-27 09:27:50 +02:00
thomwolf 3deea56c07 fixing loading fucntion 2019-06-26 13:41:12 +02:00
thomwolf f56b8033f0 more versatile loading 2019-06-26 13:13:15 +02:00
thomwolf 4d47f4985d slight refactoring, add abstract class for model loading 2019-06-26 12:52:44 +02:00
thomwolf 59cefd4f98 fix #726 - get_lr in examples 2019-06-26 11:28:27 +02:00
thomwolf ddc2cc61a6 fix python2 tests 2019-06-26 11:17:42 +02:00
thomwolf 7e3070ae4f add from_pretrained method to all configuration classes 2019-06-26 11:12:00 +02:00
thomwolf 93e9971c54 fix tests 2019-06-26 10:02:45 +02:00
thomwolf 092dacfd62 changing is_regression to unified API 2019-06-26 09:54:05 +02:00
thomwolf e55d4c4ede various updates to conversion, models and examples 2019-06-26 00:57:53 +02:00
thomwolf 603c513b35 update main conversion script and readme 2019-06-25 10:45:07 +02:00
thomwolf 7de1740490 add ability to restore fine-tuned TF mdoel 2019-06-25 10:27:58 +02:00
thomwolf 7334bf6c21 pad on left for xlnet 2019-06-24 15:05:11 +02:00
thomwolf c888663f18 overwrite output directories if needed 2019-06-24 14:38:24 +02:00
thomwolf 62d78aa37e updating GLUE utils for compatibility with XLNet 2019-06-24 14:36:11 +02:00
thomwolf 24ed0b9346 updating run_xlnet_classifier 2019-06-24 12:00:09 +02:00
thomwolf f6081f2255 add xlnetforsequence classif and run_classifier example for xlnet 2019-06-24 10:01:07 +02:00
thomwolf c946bb51a6 fix xlnet tokenizer and python2 2019-06-22 22:28:49 +02:00
thomwolf 181075635d updating model loading and adding special tokens ids 2019-06-21 23:23:37 +02:00
thomwolf ebd2cb8d74 update from_pretrained to load XLNetModel as well 2019-06-21 21:08:44 +02:00
thomwolf 483cbc36a9 test deviation with tf model: max ~1e-3 should be ok 2019-06-21 16:38:01 +02:00
thomwolf 24d8068982 weights loading script ok 2019-06-21 12:33:44 +02:00
thomwolf 32da75486b add tokenizer and tests 2019-06-21 11:09:51 +02:00
thomwolf 45709d7532 model running with simple inputs 2019-06-21 00:28:42 +02:00
thomwolf b407972e27 update gitignore 2019-06-20 13:52:56 +02:00
thomwolf c2ea5aef77 work in progress on xlnet 2019-06-20 13:52:21 +02:00
thomwolf de713fa9b4 starting 2019-06-20 10:54:19 +02:00
thomwolf c304593d8f BERTology details in readme 2019-06-20 10:05:06 +02:00
thomwolf 411981a080 remove slow circle-ci 2019-06-20 08:54:18 +02:00
thomwolf edfe91c36e first version bertology ok 2019-06-19 23:43:04 +02:00
thomwolf 7766ce66dd update bertology 2019-06-19 22:29:51 +02:00
thomwolf 7f00a36e27 pruning should keep on device 2019-06-19 22:23:12 +02:00
thomwolf e4b46d86ce update head pruning 2019-06-19 22:16:30 +02:00
thomwolf 0f40e8d6a6 debugger 2019-06-19 15:38:46 +02:00
thomwolf 0e1e8128bf more logging 2019-06-19 15:35:49 +02:00
thomwolf 909d4f1af2 cuda again 2019-06-19 15:32:10 +02:00
thomwolf 14f0e8e557 fix cuda 2019-06-19 15:29:28 +02:00
thomwolf 34d706a0e1 pruning in bertology 2019-06-19 15:25:49 +02:00
thomwolf dc8e0019b7 updating examples 2019-06-19 13:23:20 +02:00
thomwolf 68ab9599ce small fix and updates to readme 2019-06-19 09:38:38 +02:00
thomwolf f7e2ac01ea update barrier 2019-06-18 22:43:35 +02:00
thomwolf 4d8c4337ae test barrier in distrib training 2019-06-18 22:41:28 +02:00
thomwolf 3359955622 updating run_classif 2019-06-18 22:23:10 +02:00
thomwolf 29b7b30eaa updating evaluation on a single gpu 2019-06-18 22:20:21 +02:00
thomwolf 7d2001aa44 overwrite_output_dir 2019-06-18 22:13:30 +02:00
thomwolf 16a1f338c4 fixing 2019-06-18 17:06:31 +02:00
thomwolf 92e0ad5aba no numpy 2019-06-18 17:00:52 +02:00