c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,822 Commits 171 Branches 49 Tags
b3cfd979460d6ff828741eddffc72c34417b5046
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
VictorSanh e2ae9c0b73 fix links in doc index 2019-10-03 11:42:21 -04:00
VictorSanh c1689ac301 fix name 2019-10-03 10:56:39 -04:00
VictorSanh 4a790c40b1 update doc for distil* 2019-10-03 10:54:02 -04:00
VictorSanh 6be46a6e64 update links to new weights 2019-10-03 10:27:11 -04:00
VictorSanh 5f07d8f11a prepare release 2019-10-03 10:27:11 -04:00
VictorSanh 35071007cb incoming release 🔥 update links to arxiv preprint 2019-10-03 10:27:11 -04:00
VictorSanh f1f23ad171 fix buf in convert_pt_chkpt_to_tf2 2019-10-03 10:27:11 -04:00
VictorSanh 2a91f6071f upddate README - TODO updadte link to paper 2019-10-03 10:27:11 -04:00
VictorSanh c51e533a5f update train.py 2019-10-03 10:27:11 -04:00
VictorSanh a76c3f9cb0 update requirements 2019-10-03 10:27:11 -04:00
VictorSanh bb9c5ead54 update distiller 2019-10-03 10:27:11 -04:00
VictorSanh a12ab0a8db update binarized_data 2019-10-03 10:27:11 -04:00
VictorSanh 4d6dfbd376 update extract 2019-10-03 10:27:11 -04:00
VictorSanh 23edebc079 update extract_distilbert 2019-10-03 10:27:11 -04:00
VictorSanh cbfcfce205 update token_counts 2019-10-03 10:27:11 -04:00
VictorSanh 19e4ebbe3f grouped_batch_sampler 2019-10-03 10:27:11 -04:00
VictorSanh 594202a934 lm_seqs_dataset 2019-10-03 10:27:11 -04:00
VictorSanh 38084507c4 add distillation_configs 2019-10-03 10:27:11 -04:00
VictorSanh 2dc8cb8734 fix unknown imports (*ForMultipleChoice) in run_multiple_choice 2019-09-29 19:51:01 -04:00
VictorSanh 702f589848 fix input in run_glue for distilbert 2019-09-27 00:20:14 -04:00
VictorSanh 9f995b99d4 minor fixes 2019-09-19 21:36:06 +00:00
VictorSanh 3fe5c8e8a8 update bert-base-uncased rslts 2019-09-19 19:34:22 +00:00
VictorSanh 354944e607 [distillation] big update w/ new weights 2019-09-19 19:25:21 +00:00
VictorSanh 32e1332acf [distil] fix once for all general logger for scripts 2019-09-11 14:19:07 +00:00
VictorSanh 364920e216 fix small bug/typo 2019-09-10 21:45:01 +00:00
VictorSanh a95ced6260 [Distillation] save last chkpt as pytorch_model.bin 2019-09-09 19:53:35 +00:00
VictorSanh 04b50cabf6 gitignore 2019-09-05 18:49:28 +00:00
VictorSanh dddd6b9927 Update DistilBERT training code 2019-09-05 18:26:14 +00:00
VictorSanh 282c276e09 typos + file name coherence in distillation README 2019-08-30 12:02:29 -04:00
VictorSanh 803c1cc4ea fix relative import bug cf Issue #1140 2019-08-30 12:01:27 -04:00
VictorSanh a5fe16687b fix typo 2019-08-28 07:22:54 +00:00
VictorSanh 497f73c964 add DilBERT to master REAME 2019-08-28 07:16:30 +00:00
VictorSanh 93e82ab424 Write README for DilBERT 2019-08-28 06:26:09 +00:00
VictorSanh 19b7c9b0b7 add DilBert model for squad 2019-08-28 06:25:44 +00:00
VictorSanh fea921d382 add licensing 2019-08-28 04:45:39 +00:00
VictorSanh da1e4e53fc some fixes in train.py for loading previous checkpoint 2019-08-28 04:01:03 +00:00
VictorSanh 0d8f8848d5 add scripts/extract_for_distil.py 2019-08-28 04:00:19 +00:00
VictorSanh 7f2c384c80 add scripts/token_counts.py 2019-08-28 04:00:03 +00:00
VictorSanh 4d16b279e5 add scripts/binarized_data.py 2019-08-28 03:59:48 +00:00
VictorSanh 74d78beeb4 fix: add qa_dropout and seq_classif_dropout 2019-08-28 03:13:11 +00:00
VictorSanh 7f5d85347e fix small typo 2019-08-28 02:44:51 +00:00
VictorSanh 906581ae3c add s3 links for dilbert (+fix small typo) 2019-08-28 02:43:33 +00:00
VictorSanh b247b0d880 add train.py for distillation 2019-08-28 02:12:47 +00:00
VictorSanh 780f183e55 add requirements 2019-08-28 01:39:52 +00:00
VictorSanh e424d2e45d add README 2019-08-28 01:10:10 +00:00
VictorSanh 1ae81e4aa1 add dataset. distiller, utils 2019-08-28 01:10:05 +00:00
VictorSanh 5d29f8e99b fix bugs 2019-08-28 00:57:16 +00:00
VictorSanh a8ad83040d fix bugs 2019-08-28 00:45:33 +00:00
VictorSanh 60c984da6c fix bugs 2019-08-27 22:25:55 +00:00
VictorSanh 42968138c8 wip wouf 2019-08-27 22:00:38 +00:00
VictorSanh 1d23240068 wip 2019-08-27 14:27:47 +00:00
VictorSanh 57272d5ddf fix for glue 2019-08-22 00:25:49 -04:00
VictorSanh b006a7a12f fix for squad 2019-08-22 00:25:42 -04:00
VictorSanh 6f877d9daf Update dev results on GLUE (bert-base-uncased) w/ median on 5 runs 2019-08-21 03:43:29 +00:00
VictorSanh ee0308f79d fix typo 2019-06-06 17:30:49 +02:00
VictorSanh 2d07f945ad fix error with torch.no_grad and loss computation 2019-06-06 17:10:24 +02:00
VictorSanh 6b8d227092 some cleaning 2019-06-06 17:07:03 +02:00
VictorSanh 122d5c52ac distinguish was is not trained 2019-06-06 17:02:51 +02:00
VictorSanh 2647ac3294 forgot bertForPreTraining 2019-06-06 16:57:40 +02:00
VictorSanh cf44d98392 Add more examples to BERT models for torchhub 2019-06-06 16:36:02 +02:00
VictorSanh 826496580b Revert "add output_attentions for BertModel" 
This reverts commit de5e5682a1.
 2019-06-03 17:10:25 -04:00
VictorSanh de5e5682a1 add output_attentions for BertModel 2019-06-03 17:05:24 -04:00
VictorSanh 312fdd7752 fix doc error 2019-06-01 17:43:26 -04:00
VictorSanh cdf0f2fec3 fix typo/presentation 2019-06-01 17:42:00 -04:00
VictorSanh 8f97f6c57f fix typo 
cc @thomwolf
 2019-06-01 17:29:07 -04:00
VictorSanh 466a96543a fix bug/typos 2019-06-01 17:28:56 -04:00
VictorSanh c198ff5f1f fix typos/bugs 2019-06-01 16:28:42 -04:00
VictorSanh 592d1e3aae fix typos 2019-06-01 16:19:32 -04:00
VictorSanh f836130bff update hubconf 2019-06-01 16:08:29 -04:00
VictorSanh c0c7ff5751 add transformer xl compatibility for torchhub 2019-06-01 16:08:24 -04:00
VictorSanh 48a58646e8 small fix in doc 2019-06-01 16:06:50 -04:00
VictorSanh 2576a5c6db update hubconf for gpt2 torchhub compatibility 2019-06-01 15:28:01 -04:00
VictorSanh a92b6dc3c1 add GPT2 torchhub compatibility 2019-06-01 15:27:43 -04:00
VictorSanh 45d21502f0 update doc 2019-05-31 01:04:16 -04:00
VictorSanh 98f5c7864f decorelate dependencies + fix bug 2019-05-31 01:00:29 -04:00
VictorSanh c8bd026ef6 move dependecies list to hubconf 2019-05-31 00:36:58 -04:00
VictorSanh 19ef2b0a66 Fix typo in hubconf 2019-05-31 00:33:33 -04:00
VictorSanh d0f591051c gpt_hubconf 2019-05-31 00:28:10 -04:00
VictorSanh 4a210c9fc6 Move bert_hubconf to hubconfs 2019-05-31 00:28:00 -04:00
VictorSanh 0c5a4fe9c9 modify from_pretrained for OpenAIGPT 2019-05-31 00:27:18 -04:00
VictorSanh 372a5c1cee Hubconf doc - Specia case loading 2019-05-30 16:06:21 -04:00
Victor SANH 96592b544b default in __init__s for classification BERT models (#650) 2019-05-30 15:53:13 -04:00
VictorSanh 4cda86b08f Update hubconf for torchhub: paths+examples+doc 2019-05-30 18:38:00 +00:00
VictorSanh 290633b882 Fix args.gradient_accumulation_steps used before assigment. 2018-11-04 17:31:50 -05:00
VictorSanh 649e9774cd Fix bug train_batch_size not an int. 
Division makes args.train_batch_size becoming a float.
cc @thomwolf
 2018-11-04 17:19:40 -05:00
VictorSanh d55c3ae83f Small logger bug (multi-gpu, distribution) in training 2018-11-04 16:28:10 -05:00
VictorSanh 3c24e4bef1 Multi-Gpu loss - Cleaning 2018-11-03 18:03:17 -04:00
VictorSanh 1ba5b58c20 fix typo 2018-11-03 17:10:23 -04:00
VictorSanh 5858e8e4dd Fix both loss and eval metrics -> more coherence on the loss (eval vs train and tf vs pt) 2018-11-03 16:48:24 -04:00
VictorSanh cd09cd5b40 Fix import on initalization 2018-11-03 15:38:30 -04:00
VictorSanh a1af5247e1 Add seed in initialization 2018-11-03 14:00:36 -04:00
VictorSanh 8bd6b235b7 typo on tokenization 2018-11-03 10:27:59 -04:00
VictorSanh 2c55568c40 scatter_ and scatter 2018-11-03 10:27:38 -04:00
VictorSanh a6efe1235f Merge pull request #1 from huggingface/multi-gpu-support 
Create DataParallel model if several GPUs
 2018-11-03 10:10:34 -04:00
VictorSanh 5f432480c0 Create DataParallel model if several GPUs 2018-11-03 10:10:01 -04:00
VictorSanh 5889765a7c Update README.md 2018-11-03 09:18:44 -04:00
VictorSanh 8c932e37f9 Update the comparison notebook 2018-11-03 09:08:05 -04:00
VictorSanh 391a4ec2f3 Small typo in trange 
I seriously don't understand why they defined num_train_epochs as a float in the originial tf code.
I Will change it at the end to avoir merge conflicts for now.
 2018-11-03 08:25:15 -04:00
VictorSanh 5676d6f799 Remove BERT pretraining files for now 2018-11-03 08:17:22 -04:00
VictorSanh 72ab10399f Fix loss 
Please review @thomwolf but i think this is equivqlent (and it mimics the loss computation of the original loss)
 2018-11-02 18:06:21 -04:00