Commit Graph
1345 Commits
Author SHA1 Message Date
Thomas Wolf e753f249e1 Merge pull request #806 from wschin/fix-a-path
Fix a path so that a test can run on Windows
2019-08-21 01:14:40 +02:00
Peng Qi 3bffd2e8e5 more fixes 2019-08-20 10:59:28 -07:00
Thomas Wolf c3619f5536 Merge pull request #1060 from CrafterKolyan/patch-1
Fix typo. configuratoin -> configuration
2019-08-20 17:39:06 +02:00
Thomas Wolf 3b56427a1e Merge pull request #1040 from FeiWang96/multi_gpu
Fix bug of multi-gpu training in lm finetuning
2019-08-20 17:13:44 +02:00
thomwolf 43489756ad adding proxies options for the from_pretrained methods 2019-08-20 16:59:11 +02:00
Nikolay Korolev ad6e62cd82 Fix typo. configuratoin -> configuration 2019-08-20 15:43:06 +03:00
Guillem García Subies 388e3251fa Update tokenization_xlm.py 2019-08-20 14:19:39 +02:00
Guillem García Subies f5e2ed0fd8 Update tokenization_openai.py 2019-08-20 14:19:25 +02:00
Guillem García Subies 562b998366 Update tokenization_openai.py 2019-08-20 14:10:19 +02:00
Guillem García Subies bb04446285 Update tokenization_openai.py 2019-08-20 14:07:40 +02:00
Guillem García Subies bfd75056b0 Update tokenization_xlm.py 2019-08-20 14:06:17 +02:00
Thomas Wolf 933841d903 Merge pull request #1056 from Morizeyao/master
Swap of optimizer.step and scheduler.step for lm finetuning examples
2019-08-20 12:42:24 +02:00
thomwolf 6d0aa73981 fix #1034 2019-08-20 12:20:21 +02:00
Julien Chaumond b0b9b8091b minor typo 2019-08-20 11:33:46 +02:00
thomwolf 53c8f700f4 fix #808 2019-08-20 11:29:26 +02:00
thomwolf 901dde0e45 fix #1014 2019-08-20 11:05:51 +02:00
thomwolf e239a4a20f close #984 2019-08-20 11:02:00 +02:00
thomwolf fecaed0ed4 add force_download option to from_pretrained methods 2019-08-20 10:56:12 +02:00
Duzeyao d86b49ac86 swap optimizer.step and scheduler.step 2019-08-20 16:46:34 +08:00
Duzeyao 45ab8bf60e Revert "Update finetune_on_pregenerated.py"
This reverts commit a1359b970c.
2019-08-20 16:40:39 +08:00
Zeyao Du a1359b970c Update finetune_on_pregenerated.py 2019-08-20 16:00:07 +08:00
Zeyao Du 28f7ca1f80 swap optimizer.step and scheduler.step 2019-08-20 15:58:42 +08:00
Peng Qi a368b87791 Fix #1015 2019-08-19 13:07:00 -07:00
Lysandre c589862b78 Doc: loading from config alone does not load the model weights 2019-08-19 10:17:47 -04:00
Thomas Wolf 5a49b793d9 Merge pull request #1023 from tuvuumass/patch-1
fix issue #824
2019-08-19 15:31:46 +02:00
Chi-Liang Liu 40acf6b52a don't save model without training 2019-08-18 05:02:25 -04:00
wangfei 856a63da4d Fix: save model/model.module 2019-08-18 11:03:47 +08:00
wangfei 1ef41b8337 Revert "Fix: save model/model.module"
This reverts commit 00e9c4cc96.
2019-08-18 11:03:12 +08:00
wangfei 00e9c4cc96 Fix: save model/model.module 2019-08-18 11:02:02 +08:00
Christophe Bourguignat 189ff9b664 Update README after RoBERTa addition 2019-08-17 13:18:37 -04:00
Jason Phang d8923270e6 Correct truncation for RoBERTa in 2-input GLUE 2019-08-16 16:30:38 -04:00
LysandreJik 7e7fc53da5 Fixing run_glue example with RoBERTa 2019-08-16 11:53:10 -04:00
LysandreJik ab05280666 Order of strings in AutoModel/AutoTokenizer updated. 2019-08-16 09:53:26 -04:00
wangfei b8ff56896c Fix bug of multi-gpu training in lm finetuning 2019-08-16 12:11:05 +08:00
LysandreJik 9d0029e215 Added RoBERTa example to README 2019-08-15 17:17:35 -04:00
LysandreJik 83dba0b67b Added RoBERTa tokenizer to AutoTokenizer 2019-08-15 17:07:07 -04:00
LysandreJik e24e19ce3b Added RoBERTa to AutoModel/AutoConfig 2019-08-15 14:02:11 -04:00
LysandreJik fe02e45e48 Release: 1.1.0 1.1.0 2019-08-15 11:15:08 -04:00
Lysandre Debut 88efc65bac Merge pull request #964 from huggingface/RoBERTa
RoBERTa: model conversion, inference, tests 🔥
2019-08-15 11:11:10 -04:00
LysandreJik 8308170156 Warning for RoBERTa sequences encoded without special tokens. 2019-08-15 10:29:04 -04:00
LysandreJik 572dcfd1db Doc 2019-08-14 14:56:14 -04:00
Julien ChaumondandMyle Ott c4ef103447 [RoBERTa] First 4 authors
cf. https://github.com/huggingface/pytorch-transformers/pull/964#discussion_r313574354

Co-Authored-By: Myle Ott <myleott@fb.com>
2019-08-14 12:31:09 -04:00
samvelyan 9ce36e3e4b Re-implemented tokenize() iteratively in PreTrainedTokenizer. 2019-08-14 08:57:09 +00:00
LysandreJik 39f426be65 Added special tokens <pad> and <mask> to RoBERTa. 2019-08-13 15:19:50 -04:00
Julien Chaumond baf08ca1d4 [RoBERTa] run_glue: correct pad_token + reorder labels 2019-08-13 12:51:15 -04:00
LysandreJik 3d87991f60 Fixed error with encoding 2019-08-13 12:00:24 -04:00
tuvuumass ba4bce2581 fix issue #824 2019-08-13 11:26:27 -04:00
LysandreJik 634a3172d8 Added integration tests for sequence builders. 2019-08-12 15:14:15 -04:00
LysandreJik 22ac004a7c Added documentation and changed parameters for special_tokens_sentences_pair. 2019-08-12 15:13:53 -04:00
Julien Chaumond 912fdff899 [RoBERTa] Update run_glue for RoBERTa 2019-08-12 13:49:50 -04:00