c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,821 Commits 171 Branches 49 Tags
78ef1a99306213599d4eab8ae48f17a81d1ee2b8
Commit Graph
1821 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf 78ef1a9930 fixes 2019-10-04 17:59:44 -04:00
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
thomwolf 92c0f2fb90 Merge remote-tracking branch 'origin/julien_multiple-choice' into encoding-qol 2019-10-04 15:48:06 -04:00
Julien Chaumond 9e136ff57c Honor args.overwrite_cache (h/t @erenup) 2019-10-04 15:00:56 -04:00
LysandreJik aebd83230f Update naming + remove f string in run_lm_finetuning example 2019-10-03 11:31:36 -04:00
LysandreJik 651bfb7ad5 always_truncate by default 2019-10-03 11:31:36 -04:00
LysandreJik 5ed50a93fb LM finetuning won't mask special tokens anymore 2019-10-03 11:31:36 -04:00
LysandreJik cc412edd42 Supports already existing special tokens 2019-10-03 11:31:36 -04:00
LysandreJik 2f259b228e Sequence IDS 2019-10-03 11:31:36 -04:00
LysandreJik 7c789c337d Always truncate argument in the encode method 2019-10-03 11:31:36 -04:00
Brian Ma 7af0777910 Update run_glue.py 
add DistilBert model shortcut into ALL_MODELS
 2019-10-03 15:31:11 +00:00
VictorSanh c1689ac301 fix name 2019-10-03 10:56:39 -04:00
VictorSanh 4a790c40b1 update doc for distil* 2019-10-03 10:54:02 -04:00
VictorSanh 6be46a6e64 update links to new weights 2019-10-03 10:27:11 -04:00
VictorSanh 5f07d8f11a prepare release 2019-10-03 10:27:11 -04:00
VictorSanh 35071007cb incoming release 🔥 update links to arxiv preprint 2019-10-03 10:27:11 -04:00
VictorSanh f1f23ad171 fix buf in convert_pt_chkpt_to_tf2 2019-10-03 10:27:11 -04:00
VictorSanh 2a91f6071f upddate README - TODO updadte link to paper 2019-10-03 10:27:11 -04:00
VictorSanh c51e533a5f update train.py 2019-10-03 10:27:11 -04:00
VictorSanh a76c3f9cb0 update requirements 2019-10-03 10:27:11 -04:00
VictorSanh bb9c5ead54 update distiller 2019-10-03 10:27:11 -04:00
VictorSanh a12ab0a8db update binarized_data 2019-10-03 10:27:11 -04:00
VictorSanh 4d6dfbd376 update extract 2019-10-03 10:27:11 -04:00
VictorSanh 23edebc079 update extract_distilbert 2019-10-03 10:27:11 -04:00
VictorSanh cbfcfce205 update token_counts 2019-10-03 10:27:11 -04:00
VictorSanh 19e4ebbe3f grouped_batch_sampler 2019-10-03 10:27:11 -04:00
VictorSanh 594202a934 lm_seqs_dataset 2019-10-03 10:27:11 -04:00
VictorSanh 38084507c4 add distillation_configs 2019-10-03 10:27:11 -04:00
LysandreJik ebb32261b1 fix #1401 2019-10-02 17:52:56 -04:00
Santiago Castro 63ed224b7c initialy -> initially 2019-10-02 15:04:18 +00:00
thomwolf 391db836ab fix #1260 - remove special logic for decoding pairs of sequence 2019-10-01 19:09:13 -04:00
Thomas Wolf 963529e29b Merge pull request #1288 from echan00/master 
Typo with LM Fine tuning script
 2019-10-01 18:46:07 -04:00
thomwolf f7978f70ec use format instead of f-strings 2019-10-01 18:45:38 -04:00
Thomas Wolf 1e4a191366 Merge pull request #1284 from slayton58/pooler_end_logits_fp16_fix 
Fix fp16 masking in PoolerEndLogits
 2019-10-01 18:40:22 -04:00
thomwolf c50783e388 Merge branch 'pooler_end_logits_fp16_fix' of https://github.com/slayton58/pytorch-transformers into pr/1284 2019-10-01 18:17:48 -04:00
DenysNahurnyi 6971556ab8 Fix syntax typo in README.md 2019-10-01 14:59:31 -04:00
Julien ChaumondandLysandre Debut b350662955 overflowing_tokens do not really make sense here, let's just return a number 
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2019-09-30 16:37:09 -04:00
Julien Chaumond f5bcde0b2f [multiple-choice] Simplify and use tokenizer.encode_plus 2019-09-30 16:04:55 -04:00
Santosh Gupta 5c3b32d44d Update README.md 
Lines 183 - 200, fixed indentation. Line 198, replaced `tokenizer_class` with `BertTokenizer`, since `tokenizer_class` is not defined in the loop it belongs to.
 2019-09-30 18:48:01 +00:00
VictorSanh 2dc8cb8734 fix unknown imports (*ForMultipleChoice) in run_multiple_choice 2019-09-29 19:51:01 -04:00
Thomas Wolf ae50ad91ea Merge pull request #1362 from FeiWang96/doc 
fix link
 2019-09-28 10:26:42 +02:00
wangfei 60f791631b Fix link in readme 2019-09-28 16:20:17 +08:00
Ikuya Yamada a6a6d9e638 fix padding_idx of RoBERTa model 2019-09-27 19:03:55 -04:00
Julien Chaumond d8b641c839 6 -> 8 models 2019-09-27 17:22:01 -04:00
Julien Chaumond c6acbdd50a Close #1304 2019-09-27 17:02:53 -04:00
Thomas Wolf df7cd9e4e4 Merge pull request #1353 from wendingp/patch-1 
Fix some typos
 2019-09-27 23:00:34 +02:00
Thomas Wolf 6a17b3c51b Merge pull request #1355 from agrinh/master 
Fix tensorflow_dataset glue support
 2019-09-27 22:59:54 +02:00
Thomas Wolf 04e9a6f512 Merge pull request #1359 from dennymarcels/patch-1 
Update run_lm_finetuning.py
 2019-09-27 22:58:19 +02:00
Denny 9478590630 Update run_lm_finetuning.py 
The previous method, just as phrased, did not exist in the class.
 2019-09-27 15:18:42 -03:00
Agrin Hilmkil 795b3e76ff Add docstring for processor method 2019-09-27 17:32:28 +02:00