Commit Graph
100 Commits
Author SHA1 Message Date
thomwolf 1849aa7d39 update readme and pretrained model weight files 2019-07-16 15:11:29 +02:00
thomwolf 43e0e8fa04 updates to readme and doc 2019-07-16 13:56:47 +02:00
thomwolf f31154cb9d Merge branch 'xlnet' 2019-07-16 11:51:13 +02:00
thomwolf 1b35d05d4b update conversion scripts and __main__ 2019-07-16 09:41:55 +02:00
thomwolf 352e3ff998 added migration guide to readme 2019-07-16 09:03:49 +02:00
thomwolf 8ad7e5b4f2 indeed 2019-07-16 00:29:15 +02:00
thomwolf 064d0a0b76 update readme 2019-07-16 00:21:33 +02:00
thomwolf 3b8b0e01bb update readme 2019-07-16 00:12:55 +02:00
thomwolf 76da9765b6 fix run_generation test 2019-07-15 17:52:35 +02:00
thomwolf e691fc0963 update QA models tests + run_generation 2019-07-15 17:45:24 +02:00
thomwolf 15d8b1266c update tokenizer - update squad example for xlnet 2019-07-15 17:30:42 +02:00
thomwolf 3b469cb422 updating squad for compatibility with XLNet 2019-07-15 15:28:37 +02:00
thomwolf 8ca767f13c clean up optimization 2019-07-15 13:49:07 +02:00
thomwolf 74a24f0fe9 clean up file_utils 2019-07-15 13:49:01 +02:00
thomwolf ab49fafc04 update tokenization docstrings for #328 2019-07-15 12:51:23 +02:00
thomwolf a9ab15174c fix #328 2019-07-15 12:42:12 +02:00
thomwolf f7cd7392fd fixed tests 2019-07-15 12:32:19 +02:00
thomwolf e28d8bde0d doc on base classes 2019-07-15 12:08:06 +02:00
thomwolf 44c985facd update doc for XLM and XLNet 2019-07-15 11:36:50 +02:00
thomwolf 0201d86015 added doc for transformer-xl 2019-07-15 10:11:09 +02:00
thomwolf 4cb489457f added doc for openai GPT 2019-07-15 09:58:01 +02:00
thomwolf 62b8eb43c1 fix add_start_docstrings on python 2 (removed) 2019-07-15 09:49:02 +02:00
thomwolf 5bc3d0cc5b added gpt2 doc 2019-07-15 09:40:05 +02:00
thomwolf 183fedfed5 fix doc on python2 2019-07-15 09:00:09 +02:00
thomwolf 0e9825e252 small fix to run_glue 2019-07-14 23:43:28 +02:00
thomwolf 2397f958f9 updating examples and doc 2019-07-14 23:20:10 +02:00
thomwolf c490f5ce87 added generation examples in tests 2019-07-13 15:26:58 +02:00
thomwolf 8bb02c27e2 Merge branch 'xlnet' of https://github.com/huggingface/pytorch-pretrained-BERT into xlnet 2019-07-13 15:25:06 +02:00
thomwolf 7d4b200e40 good quality generation example for GPT, GPT-2, Transfo-XL, XLNet 2019-07-13 15:25:03 +02:00
thomwolf 7322c314a6 remove python2 testing for examples 2019-07-12 14:24:08 +02:00
thomwolf 936e813c84 clean up examples - added squad example and test 2019-07-12 14:16:06 +02:00
thomwolf 699bc7e86e fix gpt-2 unk token test 2019-07-12 11:46:57 +02:00
thomwolf 762ded9b1c wip examples 2019-07-12 11:28:52 +02:00
thomwolf 7442956361 save config file 2019-07-12 11:26:16 +02:00
thomwolf 2918b7d2a0 updating tests 2019-07-12 10:57:58 +02:00
thomwolf bd404735a7 embeddings resizing + tie_weights 2019-07-12 00:02:49 +02:00
thomwolf 273617b86d update config - fix gpt/gpt-2 from pretrained 2019-07-11 22:45:03 +02:00
thomwolf 6b13f4cb3a update circle-ci 2019-07-11 22:36:35 +02:00
thomwolf 2b644785f0 add tests on examples and large circle ci config 2019-07-11 22:31:50 +02:00
thomwolf c6bf1a400d fix test examples et model pretrained 2019-07-11 22:29:08 +02:00
thomwolf 92a782b108 fix run_glue test 2019-07-11 22:20:10 +02:00
thomwolf ccb6947dc1 optimization tests 2019-07-11 17:39:47 +02:00
thomwolf 6135de2fa3 readme update 2019-07-11 15:39:49 +02:00
thomwolf b21d84b027 update examples 2019-07-11 15:37:34 +02:00
thomwolf ec07cf5a66 rewamp optimization 2019-07-11 14:48:22 +02:00
thomwolf 4fef5919a5 updating examples 2019-07-11 12:03:08 +02:00
thomwolf 50b7e52a7f WIP examples 2019-07-10 15:33:34 +02:00
thomwolf ed6c8d37f4 fix merge 2019-07-09 17:14:52 +02:00
thomwolf e468192e2f Merge branch 'pytorch-transformers' into xlnet 2019-07-09 17:05:37 +02:00
thomwolf 4ce237c880 update run_glue 2019-07-09 17:00:32 +02:00
thomwolf 3b7cb7bf44 small update to run_glue 2019-07-09 16:12:15 +02:00
thomwolf d743f2f34e updating test 2019-07-09 15:58:58 +02:00
thomwolf d0efbd3cd1 update sequencesummary module 2019-07-09 15:46:43 +02:00
thomwolf d5481cbe1b adding tests to examples - updating summary module - coverage update 2019-07-09 15:29:42 +02:00
thomwolf c079d7ddff fix python 2 tests 2019-07-09 10:40:59 +02:00
thomwolf b19786985d unified tokenizer api and serialization + tests 2019-07-09 10:25:18 +02:00
thomwolf 3d5f291386 updates to run_glue 2019-07-05 17:22:15 +02:00
thomwolf 99b90edab1 cleaning up run_glue example 2019-07-05 17:09:35 +02:00
thomwolf 1113f97f33 clean up glue example 2019-07-05 16:31:13 +02:00
thomwolf 162ba383b0 fix model loading 2019-07-05 15:57:14 +02:00
thomwolf 6dacc79d39 fix python2 tests 2019-07-05 15:11:59 +02:00
thomwolf 36bca545ff tokenization abstract class - tests for examples 2019-07-05 15:02:59 +02:00
thomwolf a4f980547f remove circle ci parallelism 2019-07-05 12:31:34 +02:00
thomwolf eb91f6437e update readme and setup 2019-07-05 12:30:15 +02:00
thomwolf 0231ba291e circle-ci 2019-07-05 11:59:04 +02:00
thomwolf 0bab55d5d5 [BIG] name change 2019-07-05 11:55:36 +02:00
thomwolf 9113b50c96 hubs [WIP] 2019-07-05 11:31:51 +02:00
thomwolf e75c3f70aa standardizing tokenizers API and adding tests 2019-07-05 11:20:27 +02:00
thomwolf c0239e09e6 first commit 2019-07-04 17:06:30 +02:00
thomwolf cf86d23eff parallelism in circlci 2019-07-04 17:02:21 +02:00
thomwolf 15b70338ba adding squad model to xlnet and xlm 2019-07-04 16:50:42 +02:00
thomwolf fbe04423b6 Common SequenceSummary class 2019-07-04 00:25:30 +02:00
thomwolf c22545aa40 fix xlm torchscript 2019-07-03 23:03:57 +02:00
thomwolf 3b23a846b6 Merge branch 'xlnet' of https://github.com/huggingface/pytorch-pretrained-BERT into xlnet 2019-07-03 22:54:58 +02:00
thomwolf 8fa3a1f0d8 updating tests 2019-07-03 22:54:53 +02:00
thomwolf c41f2bad69 WIP XLM + refactoring 2019-07-03 22:54:39 +02:00
thomwolf 288be7b7ea xlm 2019-07-02 23:42:31 +02:00
thomwolf 7ed5bf706f add tests 2019-07-02 16:42:22 +02:00
thomwolf 708877958a updating tests and models, adding weights initialization test 2019-07-02 16:35:29 +02:00
thomwolf 99ae5ab883 update config tests and circle-ci 2019-07-02 12:40:39 +02:00
thomwolf 1484d67de9 [LARGE] updating all tests and API 2019-07-02 12:13:17 +02:00
thomwolf 4f8b5f687c add fix for serialization of tokenizer 2019-06-29 23:35:21 +02:00
thomwolf d9184620f9 fix tests and new API 2019-06-29 23:10:40 +02:00
thomwolf 213981d8cb updating bert API 2019-06-28 16:45:24 +02:00
thomwolf 2b56e98892 standardizing API across models - XLNetForSeqClass working 2019-06-28 16:35:09 +02:00
thomwolf 3a00674cbf fix imports 2019-06-27 17:18:46 +02:00
thomwolf d939d6fd02 fix hidden-state extraction 2019-06-27 09:39:44 +02:00
thomwolf 0c2ff34815 extracting double hidden-state from xlnet 2019-06-27 09:27:50 +02:00
thomwolf 3deea56c07 fixing loading fucntion 2019-06-26 13:41:12 +02:00
thomwolf f56b8033f0 more versatile loading 2019-06-26 13:13:15 +02:00
thomwolf 4d47f4985d slight refactoring, add abstract class for model loading 2019-06-26 12:52:44 +02:00
thomwolf 59cefd4f98 fix #726 - get_lr in examples 2019-06-26 11:28:27 +02:00
thomwolf ddc2cc61a6 fix python2 tests 2019-06-26 11:17:42 +02:00
thomwolf 7e3070ae4f add from_pretrained method to all configuration classes 2019-06-26 11:12:00 +02:00
thomwolf 93e9971c54 fix tests 2019-06-26 10:02:45 +02:00
thomwolf 092dacfd62 changing is_regression to unified API 2019-06-26 09:54:05 +02:00
thomwolf e55d4c4ede various updates to conversion, models and examples 2019-06-26 00:57:53 +02:00
thomwolf 603c513b35 update main conversion script and readme 2019-06-25 10:45:07 +02:00
thomwolf 7de1740490 add ability to restore fine-tuned TF mdoel 2019-06-25 10:27:58 +02:00
thomwolf 7334bf6c21 pad on left for xlnet 2019-06-24 15:05:11 +02:00