Commit Graph
58 Commits
Author SHA1 Message Date
maxvidal b0ee7c7df3 Added Camembert to available models 2019-11-29 14:17:02 -05:00
İbrahim Ethem Demirci aa92a184d2 resize model when special tokenizer present 2019-11-25 15:06:32 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Thomas Wolf 9629e2c676 Merge pull request #1804 from ronakice/master
fix multi-gpu eval in torch examples
2019-11-14 22:24:05 +01:00
Thomas Wolf df99f8c5a1 Merge pull request #1832 from huggingface/memory-leak-schedulers
replace LambdaLR scheduler wrappers by function
2019-11-14 22:10:31 +01:00
Rémi Louf 2276bf69b7 update the examples, docs and template 2019-11-14 20:38:02 +01:00
Lysandre d7929899da Specify checkpoint in saved file for run_lm_finetuning.py 2019-11-14 10:49:00 -05:00
ronakice 2e31176557 fix multi-gpu eval 2019-11-12 05:55:11 -05:00
thomwolf 89d6272898 Fix #1623 2019-11-04 16:21:12 +01:00
altsoph 079bfb32fb Evaluation fixed. 2019-10-28 10:18:58 -04:00
altsoph 438f2730a0 Evaluation code fixed. 2019-10-28 10:18:58 -04:00
Luran He f382a8decd convert int to str before adding to a str 2019-10-10 19:20:39 -04:00
Thomas Wolf 6596e3d566 Merge pull request #1454 from bkkaggle/pytorch-built-in-tensorboard
Change tensorboard imports to use built-in tensorboard if available
2019-10-10 11:56:55 +02:00
Lysandre Debut e84470ef81 Merge pull request #1384 from huggingface/encoding-qol
Quality of life enhancements in encoding + patch MLM masking
2019-10-09 11:18:24 -04:00
jinoobaek-qz 69629c4f0f Improve naming and only do regex when necessary 2019-10-09 08:48:40 -04:00
jinoobaek-qz bf34a252b8 Golden path 2019-10-09 08:48:40 -04:00
jinoobaek-qz 528d3f327b Improve readability and improve make less assumptions about checkpoint format 2019-10-09 08:48:40 -04:00
jinoobaek-qz 56301bd9e8 Extract method 2019-10-09 08:48:40 -04:00
jinoobaek-qz d6c5469712 Delete older checkpoint after saving new checkpoint 2019-10-09 08:48:40 -04:00
jinoobaek-qz 54a31f50fb Add save_total_limit 2019-10-09 08:48:40 -04:00
Bilal Khan 5ce8d29abe Change tensorboard imports to use built-in tensorboard if available 2019-10-08 16:29:43 -05:00
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
LysandreJik aebd83230f Update naming + remove f string in run_lm_finetuning example 2019-10-03 11:31:36 -04:00
LysandreJik 5ed50a93fb LM finetuning won't mask special tokens anymore 2019-10-03 11:31:36 -04:00
Brian Ma 2195c0d5f9 Evaluation result.txt path changing #1286 2019-10-03 12:49:12 +08:00
Thomas Wolf 963529e29b Merge pull request #1288 from echan00/master
Typo with LM Fine tuning script
2019-10-01 18:46:07 -04:00
thomwolf f7978f70ec use format instead of f-strings 2019-10-01 18:45:38 -04:00
Denny 9478590630 Update run_lm_finetuning.py
The previous method, just as phrased, did not exist in the class.
2019-09-27 15:18:42 -03:00
mgrankin f71a4577b8 faster dataset building 2019-09-26 16:53:13 +03:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
LysandreJik bf503158c5 Sentence -> Sequence. Removed output_mask from the special token addition methods. 2019-09-19 10:55:06 +02:00
LysandreJik 88368c2a16 Added DistilBERT to run_lm_finetuning 2019-09-19 10:55:06 +02:00
Erik Chan f0340eccf9 Typo
Typo
2019-09-18 13:42:11 -07:00
Rohit Kumar Singh e5df36397b changes in return statement of evaluate function
changed `results` to `result` and removed `results` dict defined previously
2019-09-09 19:55:57 +05:30
LysandreJik 593c070435 Better examples 2019-09-06 12:00:12 -04:00
thomwolf 06510ccb53 typo 2019-08-23 22:08:10 +02:00
thomwolf ab7bd5ef98 fixing tokenization and training 2019-08-23 17:31:21 +02:00
Lysandre 2d042274ac Sequence special token handling for BERT and RoBERTa 2019-08-20 14:15:28 -04:00
thomwolf a690edab17 various fix and clean up on run_lm_finetuning 2019-08-20 15:52:12 +02:00
Matthew Carrigan f19ba35b2b Move old finetuning script into the new folder 2019-03-20 16:47:06 +00:00
thomwolf 5c85fc3977 fix typo - logger info 2019-03-06 10:05:21 +01:00
Davide Fiocco 65df0d78ed --do_lower_case is duplicated in parser args
Deleting one repetition (please review!)
2019-02-13 15:30:05 +01:00
Thomas Wolf 03cdb2a390 Merge pull request #254 from huggingface/python_2
Adding OpenAI GPT and Transformer-XL models, compatibility with Python 2
2019-02-11 14:19:26 +01:00
tholor 9aebc711c9 adjust error message related to args.do_eval 2019-02-07 11:49:38 +01:00
tholor 4a450b25d5 removing unused argument eval_batch_size from LM finetuning #256 2019-02-07 10:06:38 +01:00
Thomas Wolf 848aae49e1 Merge branch 'master' into python_2 2019-02-06 00:13:20 +01:00
thomwolf 448937c00d python 2 compatibility 2019-02-06 00:07:46 +01:00
Thomas Wolf e9e77cd3c4 Merge pull request #218 from matej-svejda/master
Fix learning rate problems in run_classifier.py
2019-02-05 15:40:44 +01:00
thomwolf 1579c53635 more explicit notation: num_train_step => num_train_optimization_steps 2019-02-05 15:36:33 +01:00
tholor ce75b169bd avoid confusion of inplace masking of tokens_a / tokens_b 2019-01-31 11:42:06 +01:00