100 Commits
Author SHA1 Message Date
thomwolf c6c5c3fd4e style and quality 2020-02-07 08:58:06 +01:00
thomwolf 961c69776f @julien-c proposal for TF/PT compat in hf_buckets 2020-02-07 08:53:17 +01:00
thomwolf d311f87bca cleanup 2020-02-07 00:05:28 +01:00
thomwolf 7d99e05f76 file_cache has options to extract archives 2020-02-07 00:03:12 +01:00
thomwolf e0849a66ac adding in the doc 2020-01-27 14:27:07 -05:00
thomwolf 6b081f04e6 style and quality 2020-01-27 14:27:07 -05:00
thomwolf 0e31e06a75 Add AutoModelForPreTraining 2020-01-27 14:27:07 -05:00
thomwolf 258ed2eaa8 adding details in readme 2020-01-16 13:21:30 +01:00
thomwolf 50ee59578d update formating - make flake8 happy 2020-01-16 13:21:30 +01:00
thomwolf 1c9333584a formating 2020-01-16 13:21:30 +01:00
thomwolf e25b6fe354 updating readme 2020-01-16 13:21:30 +01:00
thomwolf 27c7b99015 adding details in readme - moving file 2020-01-16 13:21:30 +01:00
thomwolf 1b59b57b57 ignore_index equal -100 in T5 model 2020-01-08 09:52:10 +01:00
thomwolf 3e0cf49514 adding back last dropout in TF 2.0 T5 2019-12-24 11:30:56 +01:00
thomwolf 35d32308de adding back final dropout in T5 2019-12-24 11:29:49 +01:00
thomwolf 59b123bc50 fix tqdm logging level 2019-12-23 16:47:24 +01:00
thomwolf 77676c27d2 adding positional embeds masking to TFRoBERTa 2019-12-21 15:24:48 +01:00
thomwolf 344126fe58 move example to mm-imdb folder 2019-12-21 15:06:52 +01:00
thomwolf 1ab25c49d3 Merge branch 'master' into pr/2115 2019-12-21 14:54:30 +01:00
thomwolf b03872aae0 fix merge 2019-12-21 14:49:54 +01:00
thomwolf f86ed23189 update doc 2019-12-21 14:13:06 +01:00
thomwolf cfa0380515 Merge branch 'master' into generation_sampler 2019-12-21 14:12:52 +01:00
thomwolf 300ec3003c fixing run_generation example - using torch.no_grad 2019-12-21 14:02:19 +01:00
thomwolf 1c37746892 fixing run_generation 2019-12-21 13:52:49 +01:00
thomwolf 8a2be93b4e fix merge 2019-12-21 13:31:28 +01:00
thomwolf 655fd06853 clean up 2019-12-20 21:57:49 +01:00
thomwolf e5812462fc clean up debug and less verbose tqdm 2019-12-20 21:51:48 +01:00
thomwolf 4775ec354b add overwrite - fix ner decoding 2019-12-20 21:47:15 +01:00
thomwolf f79a7dc661 fix NER pipeline 2019-12-20 20:57:45 +01:00
thomwolf a241011057 fix pipeline NER 2019-12-20 20:43:48 +01:00
thomwolf e37ca8e11a fix camembert and XLM-R tokenizer 2019-12-20 20:43:42 +01:00
thomwolf ceae85ad60 fix mc loading 2019-12-20 19:52:24 +01:00
thomwolf 71883b6ddc update link in readme 2019-12-20 19:40:23 +01:00
thomwolf 79e4a6a25c update serving API 2019-12-20 19:33:12 +01:00
thomwolf bbaaec046c fixing CLI pipeline 2019-12-20 19:19:20 +01:00
thomwolf 1c12ee0e55 fixing xlm-roberta tokenizer max_length and automodels 2019-12-20 18:28:27 +01:00
thomwolf db0795b5d0 defaults models for tf and pt - update tests 2019-12-20 15:07:00 +01:00
thomwolf c37815f130 clean up PT <=> TF 2.0 conversion and config loading 2019-12-20 14:35:40 +01:00
thomwolf 73fcebf7ec update serving command 2019-12-20 13:47:35 +01:00
thomwolf 15dda5ea32 remove python 2 tests for circle-ci cc @aaugustin @julien-c @LysandreJik 2019-12-20 13:20:41 +01:00
thomwolf 01ffc65e9b update tests to remove unittest.patch 2019-12-20 13:16:23 +01:00
thomwolf 825697cad4 fix tests 2019-12-20 12:51:10 +01:00
thomwolf 1fa93ca1ea Clean up framework handling 2019-12-20 12:34:19 +01:00
thomwolf ca6bdb28f6 fix pipelines and rename model_card => modelcard 2019-12-20 12:10:40 +01:00
thomwolf e4baa68ddb tick-tock cc @julien-c 2019-12-19 20:37:26 +01:00
thomwolf 149dc376aa fix tests 2019-12-19 20:34:28 +01:00
thomwolf 407093b3fa Merge branch 'cli' of https://github.com/huggingface/transformers into cli 2019-12-19 20:26:51 +01:00
thomwolf c7be096c39 Merge branch 'master' into cli 2019-12-19 20:26:08 +01:00
thomwolf 3d2096f516 further cleanup 2019-12-18 11:50:54 +01:00
thomwolf 8e5587fb79 few fixes on sampling 2019-12-18 11:32:37 +01:00
thomwolf 641a8decdc clean up code and add arbitrary number of return sequences 2019-12-18 10:43:48 +01:00
thomwolf 77d397202b clean up dead code 2019-12-17 23:28:46 +01:00
thomwolf bbc0c86f9b beam search + single beam decoding 2019-12-17 23:27:02 +01:00
thomwolf b6938916ac adding beam search 2019-12-17 17:23:36 +01:00
thomwolf 2f1c745cde update conversion script 2019-12-17 11:47:54 +01:00
thomwolf 83bc5235cf Merge branch 'master' into pr/2189 2019-12-17 11:47:32 +01:00
thomwolf 3cb51299c3 Fix #2109 2019-12-16 16:58:44 -05:00
thomwolf a468870fd2 refactoring generation 2019-12-16 22:22:30 +01:00
thomwolf 1bbdbacd5b update __init__ and saving 2019-12-16 14:38:20 +01:00
thomwolf 031ad4eb37 improving JSON error messages (for model card and configurations) 2019-12-16 14:20:57 +01:00
thomwolf db0a9ee6e0 adding albert to TF auto models cc @LysandreJik 2019-12-16 14:08:08 +01:00
thomwolf a4d07b983a dict of all config and model files cc @LysandreJik 2019-12-16 14:00:32 +01:00
thomwolf d3418a94ff update tests 2019-12-16 13:52:41 +01:00
thomwolf 56e98ba81a add model cards cc @mfuntowicz 2019-12-16 11:07:27 +01:00
thomwolf 8669598abd update t5 tf 2019-12-16 09:59:36 +01:00
thomwolf 1b8613acb3 updating t5 config class 2019-12-16 09:51:42 +01:00
thomwolf dc667ce1a7 double check cc @LysandreJik 2019-12-14 09:56:27 +01:00
thomwolf 7140363e09 update bertabs 2019-12-14 09:44:53 +01:00
thomwolf cbb368ca06 distilbert tests 2019-12-14 09:31:18 +01:00
thomwolf 5c00e344c1 update model doc - swith 3B/11B to 3b/11b 2019-12-13 16:33:29 +01:00
thomwolf 8ade204098 fix tf 2019-12-13 14:48:47 +01:00
thomwolf 47f0e3cfb7 cleaning up configuration classes 2019-12-13 14:33:24 +01:00
thomwolf 33e72b08d5 fix inner dimensions for 3B/11B models 2019-12-13 11:33:05 +01:00
thomwolf f19dad61c7 fixing XLM conversion tests with dummy input 2019-12-12 14:46:30 +01:00
thomwolf 413f41921b fix merge 2019-12-12 07:34:42 +01:00
thomwolf 6709739a05 allowing from_pretrained to load from url directly 2019-12-11 18:15:45 +01:00
thomwolf 29570db25b allowing from_pretrained to load from url directly 2019-12-11 17:19:18 +01:00
thomwolf fafd4c86ec fix TF 2.0 version of T5 - update conversion script 2019-12-11 13:47:27 +01:00
thomwolf 67a8be8e90 fix backward in tests 2019-12-10 17:50:32 +01:00
thomwolf f2538c1274 all tests in torch no grad 2019-12-10 16:33:11 +01:00
thomwolf a5df980c5b updating distilbert test 2019-12-10 16:01:15 +01:00
thomwolf 7c3a15ace9 Merge branch 'master' into t5 2019-12-10 15:36:54 +01:00
thomwolf 981a5c8c17 updating models urls 2019-12-10 15:36:19 +01:00
thomwolf 8ae1044f80 updating tests and TF 2.0 model 2019-12-10 15:11:07 +01:00
thomwolf 0558c9cb9b Merge branch 'master' into t5 2019-12-10 12:58:48 +01:00
thomwolf 31a3a73ee3 updating CLI 2019-12-10 12:18:59 +01:00
thomwolf 7c1697562a compatibility with sklearn and keras 2019-12-10 12:12:22 +01:00
thomwolf b81ab431f2 updating AutoModels and AutoConfiguration - adding pipelines 2019-12-10 12:11:33 +01:00
thomwolf 2d8559731a add pipeline - train 2019-12-10 11:34:16 +01:00
thomwolf 72c36b9ea2 [WIP] - CLI 2019-12-10 11:33:14 +01:00
thomwolf 608a8f5b56 updating tf 2.0 layer_norm to T5 layer norm 2019-12-10 10:01:01 +01:00
thomwolf 8e651f56b7 fix tf tests 2019-12-09 22:13:57 +01:00
thomwolf 808bb8da7e fix transfo xl tests 2019-12-09 21:48:34 +01:00
thomwolf b016dd16c9 fix tests on python 3.5 2019-12-09 21:38:07 +01:00
thomwolf 169fea6855 updating T5 2019-12-09 16:25:33 +01:00
thomwolf 1d87b37d10 updating 2019-12-06 15:30:09 +01:00
thomwolf f8fb4335c9 clean up a little bit PT <=> TF conversion 2019-12-05 15:19:32 +01:00
thomwolf 18fb93530b fixing #2042 - Nicer error message 2019-12-05 14:36:34 +01:00
thomwolf 2d5d86e037 fix #2031 2019-12-05 14:06:29 +01:00
thomwolf 3268ebd229 fix xlnet test 2019-12-05 13:35:29 +01:00