Commit Graph
1004 Commits
Author SHA1 Message Date
sshleifer 59c658de2f fixes 2020-05-20 15:28:05 -04:00
sshleifer 5947812374 add files 2020-05-20 15:08:41 -04:00
sshleifer 09cc1e64cf save preds 2020-05-20 15:04:38 -04:00
sshleifer 5fbf42258c summaries for file 2020-05-20 12:56:26 -04:00
sshleifer af315c157e boom boom 2020-05-20 09:55:53 -04:00
sshleifer 2c7294830e val check test passing with smaller batch size 2020-05-20 09:31:11 -04:00
sshleifer 2b7132c25e metrics saving, but no val_check_interval honored 2020-05-20 09:20:55 -04:00
sshleifer bef77fc211 boom boom 2020-05-19 15:59:22 -04:00
sshleifer abb81df15f boom boom 2020-05-19 15:58:04 -04:00
sshleifer 51221fbbf8 boom boom 2020-05-19 15:57:04 -04:00
sshleifer 2ee9388492 boom boom 2020-05-19 15:54:12 -04:00
sshleifer c4530f91ab batch 2020-05-19 15:22:13 -04:00
sshleifer bbc4e52d3b assert student small 2020-05-19 15:18:50 -04:00
sshleifer 74704cedab boom boom 2020-05-19 14:46:35 -04:00
sshleifer bf5782e080 boom boom 2020-05-19 14:38:41 -04:00
sshleifer 3cebd56848 boom boom 2020-05-19 14:35:05 -04:00
sshleifer 696c8c28f2 boom boom 2020-05-19 14:34:20 -04:00
sshleifer 04a8ace0df boom boom 2020-05-19 14:32:41 -04:00
sshleifer 0ed41562eb boom boom 2020-05-19 14:30:36 -04:00
sshleifer 7081d0f3fd add rouge 2020-05-19 14:29:14 -04:00
sshleifer ca9c685453 rouge 2020-05-19 14:05:46 -04:00
sshleifer 70cf536ae2 Merge branch 'distilbart' of github.com:sshleifer/transformers_fork into distilbart 2020-05-19 11:35:22 -04:00
sshleifer 5a3ed998f0 Cache tokenized 2020-05-19 11:35:17 -04:00
sshleifer 6302fb02ef bs=8 2020-05-19 14:44:21 +00:00
sshleifer 5a35811635 boom boom 2020-05-19 09:55:26 -04:00
sshleifer 174aaf374d Fast dev run 2020-05-19 09:54:43 -04:00
sshleifer 1edc50f670 bash 2020-05-19 13:50:01 +00:00
sshleifer d2cc12b182 boom boom 2020-05-19 09:16:02 -04:00
sshleifer 8afb88ce24 relatif importschlossen 2020-05-19 09:09:15 -04:00
sshleifer 4be1287671 real data test passes 2020-05-19 09:00:33 -04:00
sshleifer 4f5790f652 passing 2020-05-18 15:16:41 -04:00
sshleifer fcc49a0c5c can import 2020-05-18 14:31:36 -04:00
sshleifer b01f1d594c Failing test 2020-05-18 14:19:46 -04:00
sshleifer 71850ad26b copy decoder layers 2020-05-18 13:33:30 -04:00
sshleifer 1368969930 passing 2020-05-18 11:55:30 -04:00
sshleifer f2de528d04 passing 2020-05-18 11:49:12 -04:00
sshleifer eabb3c5f9a test passing, loss doesnt change 2020-05-18 11:13:54 -04:00
sshleifer 762dd832f1 boom boom 2020-05-17 15:43:35 -04:00
sshleifer 8280dad80e roberta extract test works 2020-05-16 11:09:26 -04:00
Julien Chaumond 15550ce0d1 [skip ci] remove local rank 2020-05-15 17:08:38 -04:00
Lysandre Debut edf9ac11d4 Should return overflowing information for the log (#4385) 2020-05-15 09:49:11 -04:00
Julien Chaumond af2e6bf87c [examples] Streamline doc 2020-05-14 20:34:31 -04:00
Julien Chaumond 448c467256 Fix: unpin flake8 and fix cs errors (#4367)
* Fix: unpin flake8 and fix cs errors

* Ok we still need to quote those
2020-05-14 13:14:26 -04:00
Julien Chaumond c547f15a17 Use Filelock to ensure distributed barriers
see context in https://github.com/huggingface/transformers/pull/4223
2020-05-14 11:58:32 -04:00
Julien Plu ca13618681 Question Answering for TF trainer (#4320)
* Add QA trainer example for TF

* Make data_dir optional

* Fix parameter logic

* Fix feature convert

* Update the READMEs to add the question-answering task

* Apply style

* Change 'sequence-classification' to 'text-classification' and prefix with 'eval' all the metric names

* Apply style

* Apply style
2020-05-13 09:22:31 -04:00
241759101e (v2) Improvements to the wandb integration (#4324)
* Improvements to the wandb integration

* small reorg + no global necessary

* feat(trainer): log epoch and final metrics

* Simplify logging a bit

* Fixup

* Fix crash when just running eval

Co-authored-by: Chris Van Pelt <vanpelt@gmail.com>
Co-authored-by: Boris Dayma <boris.dayma@gmail.com>
2020-05-12 21:52:01 -04:00
e4512aab3b Add MultipleChoice to TFTrainer [WIP] (#4270)
* catch gpu len 1 set to gpu0

* Add mpc to trainer

* Add MPC for TF

* fix TF automodel for MPC and add Albert

* Apply style

* Fix import

* Note to self: double check

* Make shape None, None for datasetgenerator output shapes

* Add from_pt bool which doesnt seem to work

* Original checkpoint dir

* Fix docstrings for automodel

* Update readme and apply style

* Colab should probably not be from users

* Colabs should probably not be from users

* Add colab

* Update README.md

* Update README.md

* Cleanup __intit__

* Cleanup flake8 trailing comma

* Update src/transformers/training_args_tf.py

* Update src/transformers/modeling_tf_auto.py

Co-authored-by: Viktor Alm <viktoralm@pop-os.localdomain>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-05-12 08:48:48 -04:00
Stefan Schweter 3f42eb979f Documentation: fix links to NER examples (#4279)
* docs: fix link to token classification (NER) example

* examples: fix links to NER scripts
2020-05-11 12:48:21 -04:00
Julien Chaumond 7b75aa9fa5 [TPU] Doc, fix xla_spawn.py, only preprocess dataset once (#4223)
* [TPU] Doc, fix xla_spawn.py, only preprocess dataset once

* Update examples/README.md

* [xla_spawn] Add `_mp_fn` to other Trainer scripts

* [TPU] Fix: eval dataloader was None
2020-05-08 14:10:05 -04:00
Julien Chaumond c99fe0386b [doc] Fix broken links + remove crazy big notebook 2020-05-07 18:44:18 -04:00