c-my/transformers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,204 Commits 171 Branches 49 Tags
master
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Victor SANH 969ccac2e9 adding model cards for distilled models (#8300) 
* adding model cards for distil models

* forgot the languages
 2020-11-04 11:41:45 -05:00
Victor SANH 0513f8d275 correct label extraction + add note on discrepancies on trained MNLI model and HANS (#6221) 2020-08-03 15:02:51 -04:00
Victor SANHandJulien Chaumond 778e635fc9 [model_cards] roberta-base-finetuned-yelp-polarity (#6009) 
* [model_cards] roberta-base-finetuned-yelp-polarity

* Update model_cards/VictorSanh/roberta-base-finetuned-yelp-polarity/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-24 09:45:21 -04:00
Victor SANH 4965aee064 [HANS] Fix label_list for RoBERTa/BART (class flipping) (#5196) 
* fix weirdness in roberta/bart for mnli trained checkpoints

* black compliance

* isort code check
 2020-06-24 14:38:15 -04:00
VictorSanh 473808da0d update mvmt-pruning/saving_prunebert (updating torch to 1.5) 2020-06-11 19:42:45 +00:00
Victor SANH bf760c80b5 finish README 2020-06-01 09:23:31 -04:00
Victor SANH 9d7d9b3ae0 weird import 2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 2a3c88a659 Update examples/movement-pruning/README.md 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 4ac462bfb8 Update examples/movement-pruning/README.md 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-06-01 09:23:31 -04:00
Victor SANH 35fa0bbca0 clarify README 2020-06-01 09:23:31 -04:00
Victor SANH cc746a5020 flake8 compliance 2020-06-01 09:23:31 -04:00
Victor SANH b11386e158 less prints in saving prunebert 2020-06-01 09:23:31 -04:00
Victor SANH 8b5d4003ab complete README 2020-06-01 09:23:31 -04:00
Victor SANH 5c8e5b3709 commplying with isort 2020-06-01 09:23:31 -04:00
Victor SANH db2a3b2e01 space 2020-06-01 09:23:31 -04:00
Victor SANH 5f8f2d849a add floppy bert model notebok 2020-06-01 09:23:31 -04:00
Victor SANH b41948f5cd add requirements 2020-06-01 09:23:31 -04:00
Victor SANH fb8f4277b2 add scripts 2020-06-01 09:23:31 -04:00
Victor SANH d489a6d3d5 add masked_run_* 2020-06-01 09:23:31 -04:00
Victor SANH e4c07faf0a add sparsity modules 2020-06-01 09:23:31 -04:00
Victor SANH 6b1ff25084 fix n_gpu count when no_cuda flag is activated (#3077) 
* fix n_gpu count when no_cuda flag is activated

* someone was left behind
 2020-03-02 10:20:21 -05:00
VictorSanh 852e032ca6 include roberta in run_squad_w_distillation - cc @graviraja 2020-03-01 01:56:50 +00:00
VictorSanh b5509abb36 --do_lower_case will always trick me... 2020-03-01 01:39:24 +00:00
VictorSanh 2ae98336d1 fix vocab size in binarized_data (distil): int16 vs int32 2020-02-18 16:17:35 +00:00
VictorSanh 0dbddba6d2 fix typo in hans example call 2020-02-17 20:19:57 +00:00
VictorSanh 0d3aa3c04c styling 2020-02-07 15:28:13 -05:00
VictorSanh d8b43600fd omission 2020-02-07 15:28:13 -05:00
VictorSanh ee5a6856ca distilbert-base-cased weights + Readmes + omissions 2020-02-07 15:28:13 -05:00
VictorSanh 1ce3fb5cc7 update correct eval metrics (distilbert & co) 2020-01-24 11:45:22 -05:00
VictorSanh e83d9f1c1d cleaning - change ' to " (black requirements) 2020-01-10 19:34:25 -05:00
VictorSanh ebba9e929d minor spring cleaning - missing configs + processing 2020-01-10 19:14:58 -05:00
Victor SANH 331065e62d missing import 2020-01-10 11:42:53 +01:00
Victor SANH 414e9e7122 indents test 2020-01-10 11:42:53 +01:00
Victor SANH 3cdb38a7c0 indents 2020-01-10 11:42:53 +01:00
Victor SANH ebd45980a0 Align with run_squad + fix some errors 2020-01-10 11:42:53 +01:00
Victor SANH 45634f87f8 fix Sampler in distributed training - evaluation 2020-01-10 11:42:53 +01:00
Victor SANH af1ee9e648 Move torch.nn.utils.clip_grad_norm_ 2020-01-10 11:42:53 +01:00
VictorSanh 35ff345fc9 update requirements 2019-12-05 12:07:04 -05:00
VictorSanh 552c44a9b1 release distilm-bert 2019-12-05 10:14:58 -05:00
VictorSanh fb0d2f1da1 preparing release distil-mBERT 2019-12-05 03:00:16 -05:00
VictorSanh 48cbf267c9 Use full dataset for eval (SequentialSampler in Distributed setting) 2019-12-03 11:01:37 -05:00
VictorSanh 10bd1ddb39 soft launch distilbert multilingual 2019-11-27 11:07:22 -05:00
VictorSanh d5478b939d add distilbert + update run_xnli wrt run_glue 2019-11-27 11:07:22 -05:00
VictorSanh 07ab8d7af6 fix bug 2019-11-27 11:07:22 -05:00
VictorSanh d474022639 cleaning simple_accuracy since not used anymore 2019-11-27 11:07:22 -05:00
VictorSanh bcd8dc6b48 move xnli_compute_metrics to data/metrics 2019-11-27 11:07:22 -05:00
VictorSanh 73fe2e7385 remove fstrings 2019-11-27 11:07:22 -05:00
VictorSanh 3e7656f7ac update readme 2019-11-27 11:07:22 -05:00
VictorSanh abd397e954 uniformize w/ the cache_dir update 2019-11-27 11:07:22 -05:00
VictorSanh d75d49a51d add XnliProcessor to doc 2019-11-27 11:07:22 -05:00
VictorSanh d5910b312f move xnli processor (and utils) to transformers/data/processors 2019-11-27 11:07:22 -05:00
VictorSanh 289cf4d2b7 change default for XNLI: dev --> test 2019-11-27 11:07:22 -05:00
VictorSanh cb7b77a8a2 fix some typos 2019-11-27 11:07:22 -05:00
VictorSanh 84a0b522cf mbert reproducibility results 2019-11-27 11:07:22 -05:00
VictorSanh c4336ecbbd xnli - output_mode consistency 2019-11-27 11:07:22 -05:00
VictorSanh d52e98ff9a add xnli examples/README.md 2019-11-27 11:07:22 -05:00
VictorSanh 71f71ddb3e run_xnli + utils_xnli 2019-11-27 11:07:22 -05:00
Victor SANH fa735208c9 update readme - fix example command distil* 2019-10-30 14:27:28 -04:00
VictorSanh 5b6cafb11b [release] fix table weirdness 2019-10-23 10:35:16 -04:00
VictorSanh 8ad5c591cd [RELEASE] DistilRoBERTa 2019-10-23 10:29:47 -04:00
VictorSanh fd97761c5a soft launch distilroberta 2019-10-17 15:28:58 -04:00
VictorSanh d844db4005 Add citation bibtex 2019-10-11 16:55:42 -04:00
VictorSanh 7ce83b4931 update weights for distilgpt2 2019-10-07 12:30:27 -04:00
VictorSanh 9f81f1cba8 fix convert pt_to_tf2 for custom weights 2019-10-07 12:30:19 -04:00
VictorSanh 0820bb0555 unecessary carriage return 2019-10-04 17:23:15 -04:00
VictorSanh f5891c3821 run_squad --> run_squad_w_distillation 2019-10-04 17:23:15 -04:00
VictorSanh 764a7923ec add distillation+finetuning option in run_squad 2019-10-04 17:23:15 -04:00
VictorSanh e2ae9c0b73 fix links in doc index 2019-10-03 11:42:21 -04:00
VictorSanh c1689ac301 fix name 2019-10-03 10:56:39 -04:00
VictorSanh 4a790c40b1 update doc for distil* 2019-10-03 10:54:02 -04:00
VictorSanh 6be46a6e64 update links to new weights 2019-10-03 10:27:11 -04:00
VictorSanh 5f07d8f11a prepare release 2019-10-03 10:27:11 -04:00
VictorSanh 35071007cb incoming release 🔥 update links to arxiv preprint 2019-10-03 10:27:11 -04:00
VictorSanh f1f23ad171 fix buf in convert_pt_chkpt_to_tf2 2019-10-03 10:27:11 -04:00
VictorSanh 2a91f6071f upddate README - TODO updadte link to paper 2019-10-03 10:27:11 -04:00
VictorSanh c51e533a5f update train.py 2019-10-03 10:27:11 -04:00
VictorSanh a76c3f9cb0 update requirements 2019-10-03 10:27:11 -04:00
VictorSanh bb9c5ead54 update distiller 2019-10-03 10:27:11 -04:00
VictorSanh a12ab0a8db update binarized_data 2019-10-03 10:27:11 -04:00
VictorSanh 4d6dfbd376 update extract 2019-10-03 10:27:11 -04:00
VictorSanh 23edebc079 update extract_distilbert 2019-10-03 10:27:11 -04:00
VictorSanh cbfcfce205 update token_counts 2019-10-03 10:27:11 -04:00
VictorSanh 19e4ebbe3f grouped_batch_sampler 2019-10-03 10:27:11 -04:00
VictorSanh 594202a934 lm_seqs_dataset 2019-10-03 10:27:11 -04:00
VictorSanh 38084507c4 add distillation_configs 2019-10-03 10:27:11 -04:00
VictorSanh 2dc8cb8734 fix unknown imports (*ForMultipleChoice) in run_multiple_choice 2019-09-29 19:51:01 -04:00
VictorSanh 702f589848 fix input in run_glue for distilbert 2019-09-27 00:20:14 -04:00
VictorSanh 9f995b99d4 minor fixes 2019-09-19 21:36:06 +00:00
VictorSanh 3fe5c8e8a8 update bert-base-uncased rslts 2019-09-19 19:34:22 +00:00
VictorSanh 354944e607 [distillation] big update w/ new weights 2019-09-19 19:25:21 +00:00
VictorSanh 32e1332acf [distil] fix once for all general logger for scripts 2019-09-11 14:19:07 +00:00
VictorSanh 364920e216 fix small bug/typo 2019-09-10 21:45:01 +00:00
VictorSanh a95ced6260 [Distillation] save last chkpt as pytorch_model.bin 2019-09-09 19:53:35 +00:00
VictorSanh 04b50cabf6 gitignore 2019-09-05 18:49:28 +00:00
VictorSanh dddd6b9927 Update DistilBERT training code 2019-09-05 18:26:14 +00:00
VictorSanh 282c276e09 typos + file name coherence in distillation README 2019-08-30 12:02:29 -04:00
VictorSanh 803c1cc4ea fix relative import bug cf Issue #1140 2019-08-30 12:01:27 -04:00
VictorSanh a5fe16687b fix typo 2019-08-28 07:22:54 +00:00
VictorSanh 497f73c964 add DilBERT to master REAME 2019-08-28 07:16:30 +00:00
VictorSanh 93e82ab424 Write README for DilBERT 2019-08-28 06:26:09 +00:00