Commit Graph
2099 Commits
Author SHA1 Message Date
Oren Amsalem d7906165a3 add progress bar for convert_examples_to_features
It takes considerate amount of time (~10 min) to parse the examples to features, it is good to have a progress-bar to track this
2019-11-05 10:34:27 +02:00
Thomas Wolf d2e2577dd3 Merge pull request #1723 from huggingface/fix-1623
Fix #1623
2019-11-05 08:36:30 +01:00
LysandreandSantosh-Gupta 68f7064a3e Add model.train() line to ReadMe training example
Co-Authored-By: Santosh-Gupta <San.Gupta.ML@gmail.com>
2019-11-04 11:52:35 -05:00
Thomas Wolf c8f2712199 Merge pull request #1721 from huggingface/common_attributes
Add common getter and setter for input_embeddings & output_embeddings
2019-11-04 16:21:52 +01:00
thomwolf 89d6272898 Fix #1623 2019-11-04 16:21:12 +01:00
thomwolf b340a910ed fix tests - flagged as slow all the tests downloading from AWS 2019-11-04 16:03:36 +01:00
thomwolf f02805da6f fix tests 2019-11-04 15:42:23 +01:00
Thomas Wolf 1d4d070256 Merge pull request #1549 from hlums/master
Fix token order in xlnet preprocessing for SQuAD
2019-11-04 15:37:15 +01:00
thomwolf 1724cee8c4 switch from properties to methods 2019-11-04 15:34:10 +01:00
thomwolf 9b45d0f878 Add common properties input_embeddings and output_embeddings 2019-11-04 12:28:56 +01:00
Thomas Wolf 9a3b173cd3 Merge branch 'master' into master 2019-11-04 11:41:26 +01:00
thomwolf ad90868627 Update example readme 2019-11-04 11:27:22 +01:00
Thomas Wolf 8a62835577 Merge pull request #1679 from cregouby/master
Fix https://github.com/huggingface/transformers/issues/1673
2019-11-01 22:02:24 +01:00
Julien Chaumond 93d2fff071 Close #1654 2019-11-01 09:47:38 -04:00
Lysandre 1a2b40cb53 run_tf_glue MRPC evaluation only for MRPC 2019-10-31 18:00:51 -04:00
Timothy Liu be36cf92fb Added mixed precision support to benchmarks.py 2019-10-31 17:24:37 -04:00
Julien Chaumond 2a5663c280 Merge branch 'mataney-fix_top_k_top_p_filtering' 2019-10-31 18:28:34 +00:00
Julien Chaumond f96ce1c241 [run_generation] Fix generation with batch_size>1 2019-10-31 18:27:11 +00:00
Julien Chaumond 3c1b6f594e Merge branch 'master' into fix_top_k_top_p_filtering 2019-10-31 13:53:51 -04:00
cregouby ac29353abe Fix https://github.com/huggingface/transformers/issues/1673 2019-10-31 10:04:40 +01:00
Victor SANH fa735208c9 update readme - fix example command distil* 2019-10-30 14:27:28 -04:00
Thomas Wolf c7058d8224 Merge pull request #1608 from focox/master
Error raised by "tmp_eval_loss += tmp_eval_loss.item()" when using multi-gpu
2019-10-30 17:14:07 +01:00
Thomas Wolf 22838f19fd Merge pull request #1668 from tlkh/fix-tf-xlm
Fixed training for TF XLM
2019-10-30 17:08:00 +01:00
Thomas Wolf 7f84fc571a Merge pull request #1670 from huggingface/templates
Templates and explanation for adding a new model and example script
2019-10-30 17:05:58 +01:00
Thomas Wolf 04c69db399 Merge pull request #1628 from huggingface/tfglue
run_tf_glue works with all tasks
2019-10-30 17:04:03 +01:00
Thomas Wolf 5c6a19a94a Merge pull request #1604 from huggingface/deploy_doc
Versioning in documentation
2019-10-30 17:03:14 +01:00
Thomas Wolf 3df4367244 Merge pull request #1601 from huggingface/clean-roberta
Clean roberta model & all tokenizers now add special tokens by default (breaking change)
2019-10-30 17:00:40 +01:00
Thomas Wolf 6d73c92cae Merge pull request #1455 from huggingface/conditional-generation
[WIP] Sequence generation using pretrained BERT
2019-10-30 16:54:18 +01:00
Thomas Wolf 36174696cc Merge branch 'master' into clean-roberta 2019-10-30 16:51:06 +01:00
Thomas Wolf 228cdd6a6e Merge branch 'master' into conditional-generation 2019-10-30 16:40:35 +01:00
Rémi Louf 3cf2020c6b change kwargs processing 2019-10-30 16:27:51 +01:00
Rémi Louf a88a0e4413 add tests to encoder-decoder model 2019-10-30 16:06:29 +01:00
Rémi Louf 3f07cd419c update test on Bert to include decoder mode 2019-10-30 15:09:53 +01:00
Thomas WolfandStefan Schweter 55fbfea369 Update CONTRIBUTING.md
Co-Authored-By: Stefan Schweter <stefan.schweter@bsb-muenchen.de>
2019-10-30 12:25:40 +01:00
Thomas WolfandStefan Schweter cef2a8f900 Update CONTRIBUTING.md
Co-Authored-By: Stefan Schweter <stefan.schweter@bsb-muenchen.de>
2019-10-30 12:25:31 +01:00
thomwolf 328a86d2af adding links to the templates in readme and contributing 2019-10-30 11:37:55 +01:00
thomwolf 7f4226f9e6 adding templates 2019-10-30 11:31:56 +01:00
Rémi Louf 070507df1f format utils for summarization 2019-10-30 11:24:12 +01:00
Rémi Louf da10de8466 fix bug with padding mask + add corresponding test 2019-10-30 11:19:58 +01:00
Rémi Louf 3b0d2fa30e rename seq2seq to encoder_decoder 2019-10-30 10:54:46 +01:00
Rémi Louf 9c1bdb5b61 revert renaming of lm_labels to ltr_lm_labels 2019-10-30 10:43:13 +01:00
Timothy Liu 842f3bf049 Fixed training for TF XLM 2019-10-30 01:32:15 +00:00
Rémi Louf 098a89f312 update docstrings; rename lm_labels to more explicit ltr_lm_labels 2019-10-29 20:08:03 +01:00
Rémi Louf dfce409691 resolve PR comments 2019-10-29 17:10:20 +01:00
altsoph 079bfb32fb Evaluation fixed. 2019-10-28 10:18:58 -04:00
altsoph 438f2730a0 Evaluation code fixed. 2019-10-28 10:18:58 -04:00
Rémi Louf 4c3ac4a7d8 here's one big commit 2019-10-28 10:49:50 +01:00
Rémi Louf 932543f77e fix test of truncation function 2019-10-28 10:49:49 +01:00
Rémi Louf a67413ccc8 extend works in-place 2019-10-28 10:49:49 +01:00
Rémi Louf cb26b035c6 remove potential UndefinedError 2019-10-28 10:49:49 +01:00