Commit Graph
100 Commits
Author SHA1 Message Date
thomwolf 4ce5f36f78 update readmes 2019-08-28 12:14:31 +02:00
thomwolf e00b4ff1de fix #1017 2019-08-21 22:22:17 +02:00
thomwolf fdc487d8b3 Add max length 2019-08-21 02:35:01 +02:00
thomwolf aa05dc8935 adding gpt-2 large 2019-08-21 02:29:34 +02:00
thomwolf 43489756ad adding proxies options for the from_pretrained methods 2019-08-20 16:59:11 +02:00
thomwolf 6d0aa73981 fix #1034 2019-08-20 12:20:21 +02:00
thomwolf 53c8f700f4 fix #808 2019-08-20 11:29:26 +02:00
thomwolf 901dde0e45 fix #1014 2019-08-20 11:05:51 +02:00
thomwolf e239a4a20f close #984 2019-08-20 11:02:00 +02:00
thomwolf fecaed0ed4 add force_download option to from_pretrained methods 2019-08-20 10:56:12 +02:00
thomwolf aaedfc35a8 Merge branch 'master' of https://github.com/huggingface/pytorch-transformers 2019-08-10 20:04:37 +02:00
thomwolf c683c3d5a5 fix #993 2019-08-10 20:04:35 +02:00
thomwolf 0b524b0848 remove derived classes for now 2019-08-05 19:08:19 +02:00
thomwolf 13936a9621 update doc and tests 2019-08-05 18:48:16 +02:00
thomwolf ed4e542260 adding tests 2019-08-05 18:14:07 +02:00
thomwolf 3a126e73dd fix #950 2019-08-05 17:26:29 +02:00
thomwolf 7223886dc9 fix #944 2019-08-05 17:16:56 +02:00
thomwolf 70c10caa06 add option mentioned in #940 2019-08-05 17:09:37 +02:00
thomwolf 077ad693e9 tweak issue templates wordings 2019-08-05 16:46:29 +02:00
thomwolf 02d4087cb8 Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT 2019-08-05 16:26:01 +02:00
thomwolf 7c524d631e add issue templates 2019-08-05 16:25:54 +02:00
thomwolf b90e29d52c working on automodels 2019-08-05 16:06:34 +02:00
thomwolf 58830807d1 inidicate we only support pytorch 1.0.0+ now 2019-08-05 14:38:59 +02:00
thomwolf 328afb7097 cleaning up tokenizer tests structure (at last) - last remaining ppb refs 2019-08-05 14:08:56 +02:00
thomwolf 00132b7a7a updating docs - adding few tests to tokenizers 2019-08-04 22:42:55 +02:00
thomwolf 009273dbdd big doc update [WIP] 2019-08-04 12:14:57 +02:00
thomwolf bfbe52ec39 cleaning up example docstrings 2019-07-27 20:25:39 +02:00
thomwolf 4cc1bf81ee typos 2019-07-27 12:08:21 +02:00
thomwolf ac27548b25 fix unk_token test 2019-07-27 11:50:47 +02:00
thomwolf c717d38573 dictionnary => dictionary 2019-07-26 23:30:48 +02:00
thomwolf 7b6e474c9a fix #901 2019-07-26 21:26:44 +02:00
thomwolf 632d711411 fix #908 2019-07-26 21:14:37 +02:00
thomwolf 27b0f86d36 clean up pretrained 2019-07-26 17:09:21 +02:00
thomwolf 57e54ec070 add unk_token to gpt2 2019-07-26 17:09:07 +02:00
thomwolf ac42049c08 add auto models and auto tokenizer 2019-07-26 17:08:59 +02:00
thomwolf 1383c7b87a Fix #869 2019-07-23 17:52:20 +02:00
thomwolf 6070b55443 fix #868 2019-07-23 17:46:01 +02:00
thomwolf 2c9a3115b7 fix #858 2019-07-23 16:45:55 +02:00
thomwolf 0740e63e49 updating schedules for state_dict saving 2019-07-23 15:57:18 +02:00
thomwolf ba52fe69d5 update breaking change section regarding from_pretrained keyword arguments 2019-07-23 15:10:02 +02:00
thomwolf 0227b4a940 fix #827 2019-07-23 14:06:43 +02:00
thomwolf 71d597dad0 fix #800 2019-07-17 13:51:09 +02:00
thomwolf 5fe0b378d8 adding missing docstring fix #793 2019-07-16 21:35:53 +02:00
thomwolf e848b54730 fix #792 2019-07-16 21:22:19 +02:00
thomwolf c5b3d86a91 Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT 2019-07-16 21:21:05 +02:00
thomwolf 6b70760204 typos 2019-07-16 21:21:03 +02:00
thomwolf ed7549bb1a release version 1.0 2019-07-16 16:10:58 +02:00
thomwolf 6a72d9aa52 updated examples in readme 2019-07-16 16:09:29 +02:00
thomwolf b59043bf8f update readme 2019-07-16 16:03:48 +02:00
thomwolf edc79acb3b simpler quick tour 2019-07-16 16:02:32 +02:00
thomwolf 5c82d3488f indicate default evaluation in breaking changes 2019-07-16 15:45:58 +02:00
thomwolf 4acaa65068 model in evaluation mode by default after from_pretrained 2019-07-16 15:41:57 +02:00
thomwolf f289e6cfe4 fix docstrings 2019-07-16 15:31:21 +02:00
thomwolf 9726b229cf model name typo 2019-07-16 15:17:45 +02:00
thomwolf 1849aa7d39 update readme and pretrained model weight files 2019-07-16 15:11:29 +02:00
thomwolf 43e0e8fa04 updates to readme and doc 2019-07-16 13:56:47 +02:00
thomwolf f31154cb9d Merge branch 'xlnet' 2019-07-16 11:51:13 +02:00
thomwolf 1b35d05d4b update conversion scripts and __main__ 2019-07-16 09:41:55 +02:00
thomwolf 352e3ff998 added migration guide to readme 2019-07-16 09:03:49 +02:00
thomwolf 8ad7e5b4f2 indeed 2019-07-16 00:29:15 +02:00
thomwolf 064d0a0b76 update readme 2019-07-16 00:21:33 +02:00
thomwolf 3b8b0e01bb update readme 2019-07-16 00:12:55 +02:00
thomwolf 76da9765b6 fix run_generation test 2019-07-15 17:52:35 +02:00
thomwolf e691fc0963 update QA models tests + run_generation 2019-07-15 17:45:24 +02:00
thomwolf 15d8b1266c update tokenizer - update squad example for xlnet 2019-07-15 17:30:42 +02:00
thomwolf 3b469cb422 updating squad for compatibility with XLNet 2019-07-15 15:28:37 +02:00
thomwolf 8ca767f13c clean up optimization 2019-07-15 13:49:07 +02:00
thomwolf 74a24f0fe9 clean up file_utils 2019-07-15 13:49:01 +02:00
thomwolf ab49fafc04 update tokenization docstrings for #328 2019-07-15 12:51:23 +02:00
thomwolf a9ab15174c fix #328 2019-07-15 12:42:12 +02:00
thomwolf f7cd7392fd fixed tests 2019-07-15 12:32:19 +02:00
thomwolf e28d8bde0d doc on base classes 2019-07-15 12:08:06 +02:00
thomwolf 44c985facd update doc for XLM and XLNet 2019-07-15 11:36:50 +02:00
thomwolf 0201d86015 added doc for transformer-xl 2019-07-15 10:11:09 +02:00
thomwolf 4cb489457f added doc for openai GPT 2019-07-15 09:58:01 +02:00
thomwolf 62b8eb43c1 fix add_start_docstrings on python 2 (removed) 2019-07-15 09:49:02 +02:00
thomwolf 5bc3d0cc5b added gpt2 doc 2019-07-15 09:40:05 +02:00
thomwolf 183fedfed5 fix doc on python2 2019-07-15 09:00:09 +02:00
thomwolf 0e9825e252 small fix to run_glue 2019-07-14 23:43:28 +02:00
thomwolf 2397f958f9 updating examples and doc 2019-07-14 23:20:10 +02:00
thomwolf c490f5ce87 added generation examples in tests 2019-07-13 15:26:58 +02:00
thomwolf 8bb02c27e2 Merge branch 'xlnet' of https://github.com/huggingface/pytorch-pretrained-BERT into xlnet 2019-07-13 15:25:06 +02:00
thomwolf 7d4b200e40 good quality generation example for GPT, GPT-2, Transfo-XL, XLNet 2019-07-13 15:25:03 +02:00
thomwolf 7322c314a6 remove python2 testing for examples 2019-07-12 14:24:08 +02:00
thomwolf 936e813c84 clean up examples - added squad example and test 2019-07-12 14:16:06 +02:00
thomwolf 699bc7e86e fix gpt-2 unk token test 2019-07-12 11:46:57 +02:00
thomwolf 762ded9b1c wip examples 2019-07-12 11:28:52 +02:00
thomwolf 7442956361 save config file 2019-07-12 11:26:16 +02:00
thomwolf 2918b7d2a0 updating tests 2019-07-12 10:57:58 +02:00
thomwolf bd404735a7 embeddings resizing + tie_weights 2019-07-12 00:02:49 +02:00
thomwolf 273617b86d update config - fix gpt/gpt-2 from pretrained 2019-07-11 22:45:03 +02:00
thomwolf 6b13f4cb3a update circle-ci 2019-07-11 22:36:35 +02:00
thomwolf 2b644785f0 add tests on examples and large circle ci config 2019-07-11 22:31:50 +02:00
thomwolf c6bf1a400d fix test examples et model pretrained 2019-07-11 22:29:08 +02:00
thomwolf 92a782b108 fix run_glue test 2019-07-11 22:20:10 +02:00
thomwolf ccb6947dc1 optimization tests 2019-07-11 17:39:47 +02:00
thomwolf 6135de2fa3 readme update 2019-07-11 15:39:49 +02:00
thomwolf b21d84b027 update examples 2019-07-11 15:37:34 +02:00
thomwolf ec07cf5a66 rewamp optimization 2019-07-11 14:48:22 +02:00
thomwolf 4fef5919a5 updating examples 2019-07-11 12:03:08 +02:00