Commit Graph
667 Commits
Author SHA1 Message Date
Piero Molino a59fdd1627 generate_text_pplm now works with batch_size > 1 2019-12-03 10:14:02 -05:00
w4nderlust 893d0d64fe Changed order of some parameters to be more consistent. Identical results. 2019-12-03 10:14:02 -05:00
w4nderlust f42816e7fc Added additional check for url and path in discriminator model params 2019-12-03 10:14:02 -05:00
w4nderlust f10b925015 Imrpovements: model_path renamed pretrained_model, tokenizer loaded from pretrained_model, pretrained_model set to discriminator's when discrim is specified, sample = False by default but cli parameter introduced. To obtain identical samples call the cli with --sample 2019-12-03 10:14:02 -05:00
w4nderlust 75904dae66 Removed global variable device 2019-12-03 10:14:02 -05:00
piero 7fd54b55a3 Added support for generic discriminators 2019-12-03 10:14:02 -05:00
piero b0eaff36e6 Added a +1 to epoch when saving weights 2019-12-03 10:14:02 -05:00
piero 611961ade7 Added tqdm to preprocessing 2019-12-03 10:14:02 -05:00
piero afc7dcd94d Now run_pplm works on cpu. Identical output as before (when using gpu). 2019-12-03 10:14:02 -05:00
piero 61399e5afe Cleaned perturb_past. Identical output as before. 2019-12-03 10:14:02 -05:00
piero ffc2935405 Fix for making unditioned generation work. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 9f693a0c48 Cleaned generate_text_pplm. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 61a12f790d Renamed SmallConst to SMALL_CONST and introduced BIG_CONST. Identical output as before. 2019-12-03 10:14:02 -05:00
piero ef47b2c03a Removed commented code. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 7ea12db3f5 Removed commented code. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 08c6e456a3 Cleaned full_text_generation. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 6c9c131780 More cleanup for run_model. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 7ffe47c888 Improved device specification 2019-12-03 10:14:02 -05:00
piero 4f2164e40e First cleanup step, changing function names and passing parameters all the way through without using args. Identical output as before. 2019-12-03 10:14:02 -05:00
piero 821de121e8 Minor changes 2019-12-03 10:14:02 -05:00
w4nderlust 7469d03b1c Fixed minor bug when running training on cuda 2019-12-03 10:14:02 -05:00
piero 0b51fba20b Added script for training a discriminator for pplm to use 2019-12-03 10:14:02 -05:00
Piero Molino 34a83faabe Let's make PPLM great again 2019-12-03 10:14:02 -05:00
Julien Chaumond d5faa74cd6 tokenizer white space: revert to previous behavior 2019-12-03 10:14:02 -05:00
Julien Chaumond 0b77d66a6d rm extraneous import 2019-12-03 10:14:02 -05:00
Rosanne Liu 83b1e6ac9e fix the loss backward issue
(cherry picked from commit 566468cc984c6ec7e10dfc62b5b4191781a99cd2)
2019-12-03 10:14:02 -05:00
572c24cfa2 PPLM (squashed)
Co-authored-by: piero <piero@uber.com>
Co-authored-by: Rosanne Liu <mimosavvy@gmail.com>
2019-12-03 10:14:02 -05:00
Thomas Wolf f19a78a634 Merge pull request #1903 from valohai/master
Valohai integration
2019-12-03 16:13:01 +01:00
maxvidal b0ee7c7df3 Added Camembert to available models 2019-11-29 14:17:02 -05:00
Juha Kiili 41aa0e8003 Refactor logs and fix loss bug 2019-11-29 15:33:25 +02:00
Stefan Schweter 8c276b9c92 Merge branch 'master' into distilbert-german 2019-11-27 18:11:49 +01:00
VictorSanh d5478b939d add distilbert + update run_xnli wrt run_glue 2019-11-27 11:07:22 -05:00
VictorSanh 73fe2e7385 remove fstrings 2019-11-27 11:07:22 -05:00
VictorSanh 3e7656f7ac update readme 2019-11-27 11:07:22 -05:00
VictorSanh abd397e954 uniformize w/ the cache_dir update 2019-11-27 11:07:22 -05:00
VictorSanh d5910b312f move xnli processor (and utils) to transformers/data/processors 2019-11-27 11:07:22 -05:00
VictorSanh 289cf4d2b7 change default for XNLI: dev --> test 2019-11-27 11:07:22 -05:00
VictorSanh 84a0b522cf mbert reproducibility results 2019-11-27 11:07:22 -05:00
VictorSanh c4336ecbbd xnli - output_mode consistency 2019-11-27 11:07:22 -05:00
VictorSanh d52e98ff9a add xnli examples/README.md 2019-11-27 11:07:22 -05:00
VictorSanh 71f71ddb3e run_xnli + utils_xnli 2019-11-27 11:07:22 -05:00
Julien Chaumond b5d884d25c Uniformize #1952 2019-11-27 11:05:55 -05:00
Lysandre 4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
manansanghi 5d3b8daad2 Minor bug fixes on run_ner.py 2019-11-25 16:48:03 -05:00
İbrahim Ethem Demirci aa92a184d2 resize model when special tokenizer present 2019-11-25 15:06:32 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Julien Chaumond 176cd1ce1b [doc] homogenize instructions slightly 2019-11-23 11:18:54 -05:00
Rémi Louf 26db31e0c0 update the documentation 2019-11-21 14:41:19 -05:00
Juha Kiili 2cf3447e0a Glue: log in Valohai-compatible JSON format too 2019-11-21 12:35:25 +02:00