Commit Graph
649 Commits
Author SHA1 Message Date
piero 4f2164e40e First cleanup step, changing function names and passing parameters all the way through without using args. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 821de121e8 Minor changes 2019-12-03 10:14:02 -05:00
w4nderlust 7469d03b1c Fixed minor bug when running training on cuda 2019-12-03 10:14:02 -05:00
piero 0b51fba20b Added script for training a discriminator for pplm to use 2019-12-03 10:14:02 -05:00
Piero Molino 34a83faabe Let's make PPLM great again 2019-12-03 10:14:02 -05:00
Julien Chaumond d5faa74cd6 tokenizer white space: revert to previous behavior 2019-12-03 10:14:02 -05:00
Julien Chaumond 0b77d66a6d rm extraneous import 2019-12-03 10:14:02 -05:00
Rosanne Liu 83b1e6ac9e fix the loss backward issue
(cherry picked from commit 566468cc984c6ec7e10dfc62b5b4191781a99cd2)
2019-12-03 10:14:02 -05:00
572c24cfa2 PPLM (squashed)
Co-authored-by: piero <piero@uber.com>
Co-authored-by: Rosanne Liu <mimosavvy@gmail.com>
2019-12-03 10:14:02 -05:00
Thomas Wolf f19a78a634 Merge pull request #1903 from valohai/master
Valohai integration
2019-12-03 16:13:01 +01:00
maxvidal b0ee7c7df3 Added Camembert to available models 2019-11-29 14:17:02 -05:00
Juha Kiili 41aa0e8003 Refactor logs and fix loss bug 2019-11-29 15:33:25 +02:00
Stefan Schweter 8c276b9c92 Merge branch 'master' into distilbert-german 2019-11-27 18:11:49 +01:00
VictorSanh d5478b939d add distilbert + update run_xnli wrt run_glue 2019-11-27 11:07:22 -05:00
VictorSanh 73fe2e7385 remove fstrings 2019-11-27 11:07:22 -05:00
VictorSanh 3e7656f7ac update readme 2019-11-27 11:07:22 -05:00
VictorSanh abd397e954 uniformize w/ the cache_dir update 2019-11-27 11:07:22 -05:00
VictorSanh d5910b312f move xnli processor (and utils) to transformers/data/processors 2019-11-27 11:07:22 -05:00
VictorSanh 289cf4d2b7 change default for XNLI: dev --> test 2019-11-27 11:07:22 -05:00
VictorSanh 84a0b522cf mbert reproducibility results 2019-11-27 11:07:22 -05:00
VictorSanh c4336ecbbd xnli - output_mode consistency 2019-11-27 11:07:22 -05:00
VictorSanh d52e98ff9a add xnli examples/README.md 2019-11-27 11:07:22 -05:00
VictorSanh 71f71ddb3e run_xnli + utils_xnli 2019-11-27 11:07:22 -05:00
Julien Chaumond b5d884d25c Uniformize #1952 2019-11-27 11:05:55 -05:00
Lysandre 4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
manansanghi 5d3b8daad2 Minor bug fixes on run_ner.py 2019-11-25 16:48:03 -05:00
İbrahim Ethem Demirci aa92a184d2 resize model when special tokenizer present 2019-11-25 15:06:32 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Julien Chaumond 176cd1ce1b [doc] homogenize instructions slightly 2019-11-23 11:18:54 -05:00
Rémi Louf 26db31e0c0 update the documentation 2019-11-21 14:41:19 -05:00
Juha Kiili 2cf3447e0a Glue: log in Valohai-compatible JSON format too 2019-11-21 12:35:25 +02:00
Thomas Wolf 0cdfcca24b Merge pull request #1860 from stefan-it/camembert-for-token-classification
[WIP] Add support for CamembertForTokenClassification
2019-11-21 10:56:07 +01:00
Jin Young Sohn e70cdf083d Cleanup TPU bits from run_glue.py
TPU runner is currently implemented in:
https://github.com/pytorch-tpu/transformers/blob/tpu/examples/run_glue_tpu.py.

We plan to upstream this directly into `huggingface/transformers`
(either `master` or `tpu`) branch once it's been more thoroughly tested.
2019-11-20 17:54:34 -05:00
Lysandre 454455c695 fix #1879 2019-11-20 09:42:48 -05:00
Stefan Schweter e7cf2ccd15 distillation: add German distilbert model 2019-11-19 19:55:19 +01:00
Kazutoshi Shinoda f3386d9383 typo "deay" -> "decay" 2019-11-18 11:50:06 -05:00
Stefan Schweter 56c84863a1 camembert: add support for CamemBERT in run_ner example 2019-11-18 17:06:57 +01:00
Julien Chaumond 26858f27cb [camembert] Upload to s3 + rename script 2019-11-16 00:11:07 -05:00
Louis MARTIN 3e20c2e871 Update demo_camembert.py with new classes 2019-11-16 00:11:07 -05:00
Louis MARTIN f12e4d8da7 Move demo_camembert.py to examples/contrib 2019-11-16 00:11:07 -05:00
Louis MARTIN 6e72fd094c Add demo_camembert.py 2019-11-16 00:11:07 -05:00
Thomas Wolf 74ce8de7d8 Merge pull request #1792 from stefan-it/distilbert-for-token-classification
DistilBERT for token classification
2019-11-14 22:47:53 +01:00
Thomas Wolf 05db5bc1af added small comparison between BERT, RoBERTa and DistilBERT 2019-11-14 22:40:22 +01:00
Thomas Wolf 9629e2c676 Merge pull request #1804 from ronakice/master
fix multi-gpu eval in torch examples
2019-11-14 22:24:05 +01:00
Thomas Wolf df99f8c5a1 Merge pull request #1832 from huggingface/memory-leak-schedulers
replace LambdaLR scheduler wrappers by function
2019-11-14 22:10:31 +01:00
Rémi Louf 2276bf69b7 update the examples, docs and template 2019-11-14 20:38:02 +01:00
Lysandre d7929899da Specify checkpoint in saved file for run_lm_finetuning.py 2019-11-14 10:49:00 -05:00
ronakice 2e31176557 fix multi-gpu eval 2019-11-12 05:55:11 -05:00
Stefan Schweter 2b07b9e5ee examples: add DistilBert support for NER fine-tuning 2019-11-11 16:19:34 +01:00