Commit Graph
1537 Commits
Author SHA1 Message Date
Thomas Wolf 0ecfd17f49 Merge pull request #987 from huggingface/generative-finetuning
Generative finetuning
2019-08-28 16:51:50 +02:00
Thomas Wolf 50792dbdcc Merge pull request #1127 from huggingface/dilbert
DilBERT
2019-08-28 16:43:09 +02:00
thomwolf e7706f514b update again 2019-08-28 16:37:22 +02:00
thomwolf b5eb283aaa update credits 2019-08-28 16:36:55 +02:00
LysandreJik f753d4e32b Removed typings for Python 2 2019-08-28 10:15:02 -04:00
LysandreJik 75bc2a03cc Updated article link 2019-08-28 10:05:15 -04:00
LysandreJik 1dc43e56c9 Documentation additions 2019-08-28 09:37:27 -04:00
thomwolf 912a377e90 dilbert -> distilbert 2019-08-28 13:59:42 +02:00
thomwolf c9bce1811c fixing model to add torchscript, embedding resizing, head pruning and masking + tests 2019-08-28 13:22:45 +02:00
thomwolf 62df4ba59a add dilbert tokenizer and tests 2019-08-28 12:22:56 +02:00
thomwolf 4ce5f36f78 update readmes 2019-08-28 12:14:31 +02:00
VictorSanh a5fe16687b fix typo 2019-08-28 07:22:54 +00:00
VictorSanh 497f73c964 add DilBERT to master REAME 2019-08-28 07:16:30 +00:00
VictorSanh 93e82ab424 Write README for DilBERT 2019-08-28 06:26:09 +00:00
VictorSanh 19b7c9b0b7 add DilBert model for squad 2019-08-28 06:25:44 +00:00
VictorSanh fea921d382 add licensing 2019-08-28 04:45:39 +00:00
VictorSanh da1e4e53fc some fixes in train.py for loading previous checkpoint 2019-08-28 04:01:03 +00:00
VictorSanh 0d8f8848d5 add scripts/extract_for_distil.py 2019-08-28 04:00:19 +00:00
VictorSanh 7f2c384c80 add scripts/token_counts.py 2019-08-28 04:00:03 +00:00
VictorSanh 4d16b279e5 add scripts/binarized_data.py 2019-08-28 03:59:48 +00:00
LysandreJik c513415b19 Dilbert tests from CommonTests 2019-08-27 23:59:00 -04:00
LysandreJik 778a263f09 GilBert added to AutoModels 2019-08-27 23:14:00 -04:00
VictorSanh 74d78beeb4 fix: add qa_dropout and seq_classif_dropout 2019-08-28 03:13:11 +00:00
VictorSanh 7f5d85347e fix small typo 2019-08-28 02:44:51 +00:00
VictorSanh 906581ae3c add s3 links for dilbert (+fix small typo) 2019-08-28 02:43:33 +00:00
VictorSanh b247b0d880 add train.py for distillation 2019-08-28 02:12:47 +00:00
VictorSanh 780f183e55 add requirements 2019-08-28 01:39:52 +00:00
VictorSanh e424d2e45d add README 2019-08-28 01:10:10 +00:00
VictorSanh 1ae81e4aa1 add dataset. distiller, utils 2019-08-28 01:10:05 +00:00
VictorSanh 5d29f8e99b fix bugs 2019-08-28 00:57:16 +00:00
VictorSanh a8ad83040d fix bugs 2019-08-28 00:45:33 +00:00
Shijie Wu ca4baf8ca1 Match order of casing in OSS XLM; Improve document; Clean up dependency 2019-08-27 20:03:18 -04:00
VictorSanh 60c984da6c fix bugs 2019-08-27 22:25:55 +00:00
VictorSanh 42968138c8 wip wouf 2019-08-27 22:00:38 +00:00
VictorSanh 1d23240068 wip 2019-08-27 14:27:47 +00:00
Thomas Wolf d06c5a2a0a Merge pull request #1120 from CrafterKolyan/patch-3
Change attention mask dtype to be bool. Fix #1119
2019-08-27 15:01:01 +02:00
Thomas Wolf edc5222fc3 Merge pull request #1118 from CrafterKolyan/patch-2
Documentation fix #1117
2019-08-27 14:58:50 +02:00
Thomas Wolf 9cf298dfc1 Merge pull request #1116 from CrafterKolyan/patch-1
Delete nonexistent parameter from documentation fix #1115
2019-08-27 14:56:43 +02:00
thomwolf 0d288727b8 fix #1106 2019-08-27 14:50:22 +02:00
thomwolf 447afe9cdf updating docstring for AutoModel 2019-08-27 14:42:03 +02:00
thomwolf a175a9dc01 add kwargs to base encode function 2019-08-27 14:05:59 +02:00
Nikolay Korolev 53282b5bd0 Change attention mask dtype to be bool. Fix #1119 2019-08-27 14:19:03 +03:00
Nikolay Korolev 26bda77225 Fix documentation #1117
Rename parameter in documentation + Delete its second occurrence.
2019-08-27 12:22:42 +03:00
Nikolay Korolev c8933bb2d9 Delete nonexistent parameter from documentation
Changed documentation of GPT2Model, GPT2LMHeadModel and GPT2DoubleHeadsModel
2019-08-27 12:10:36 +03:00
LysandreJik e08c01aa1a fix #1102 2019-08-26 18:13:06 -04:00
LysandreJik 84a3a9689d Pytorch Hub & AutoModels 2019-08-26 16:08:43 -04:00
LysandreJik f68339639a Tests for added AutoModels 2019-08-26 16:02:23 -04:00
LysandreJik cb60ce59dd Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-26 15:44:30 -04:00
LysandreJik 529a16dec6 Generic encoding implementation. 2019-08-26 15:00:43 -04:00
Shijie Wu f1b018740c Add use_lang_emb to config 2019-08-23 20:33:01 -04:00