Commit Graph
1136 Commits
Author SHA1 Message Date
sshleifer cc83d34a7d boom boom 2020-06-05 15:13:24 -04:00
sshleifer 3e47e61a1a Disable cos loss 2020-06-05 12:51:13 -04:00
sshleifer 20aedfbcf7 boom boom 2020-06-04 09:45:47 -04:00
sshleifer 440744a111 Distiller brewer does not break 2020-06-04 09:38:02 -04:00
sshleifer df0b28a581 boom boom 2020-06-04 02:09:27 -04:00
sshleifer 8c6769ee41 boom boom 2020-06-03 13:04:02 +00:00
sshleifer fb6adb2a47 backup rouge dfs 2020-06-03 12:53:05 +00:00
sshleifer 789f06e9d8 less annoying requirements 2020-06-02 18:59:11 -04:00
sshleifer e17df7499c merged master 2020-06-02 13:45:10 -04:00
sshleifer 82a6b8345f Merge branch 'master' into distilbart 2020-06-02 13:44:40 -04:00
sshleifer 60a90143ee rouge tracker fix 2020-06-02 11:17:09 -04:00
Julien Chaumond b42586ea56 Fix CI after killing archive maps (#4724)
* 🐛 Fix model ids for BART and Flaubert
2020-06-02 10:21:09 -04:00
Julien Chaumond d4c2cb402d Kill model archive maps (#4636)
* Kill model archive maps

* Fixup

* Also kill model_archive_map for MaskedBertPreTrainedModel

* Unhook config_archive_map

* Tokenizers: align with model id changes

* make style && make quality

* Fix CI
2020-06-02 09:39:33 -04:00
Lysandre Debut 88762a2f8c Specify PyTorch versions for examples (#4710) 2020-06-02 04:29:28 -04:00
Victor SANH bf760c80b5 finish README 2020-06-01 09:23:31 -04:00
Victor SANH 9d7d9b3ae0 weird import 2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 2a3c88a659 Update examples/movement-pruning/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 4ac462bfb8 Update examples/movement-pruning/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-06-01 09:23:31 -04:00
Victor SANH 35fa0bbca0 clarify README 2020-06-01 09:23:31 -04:00
Victor SANH cc746a5020 flake8 compliance 2020-06-01 09:23:31 -04:00
Victor SANH b11386e158 less prints in saving prunebert 2020-06-01 09:23:31 -04:00
Victor SANH 8b5d4003ab complete README 2020-06-01 09:23:31 -04:00
Victor SANH 5c8e5b3709 commplying with isort 2020-06-01 09:23:31 -04:00
Victor SANH db2a3b2e01 space 2020-06-01 09:23:31 -04:00
Victor SANH 5f8f2d849a add floppy bert model notebok 2020-06-01 09:23:31 -04:00
Victor SANH b41948f5cd add requirements 2020-06-01 09:23:31 -04:00
Victor SANH fb8f4277b2 add scripts 2020-06-01 09:23:31 -04:00
Victor SANH d489a6d3d5 add masked_run_* 2020-06-01 09:23:31 -04:00
Victor SANH e4c07faf0a add sparsity modules 2020-06-01 09:23:31 -04:00
sshleifer 7b9557fbf5 boom boom 2020-05-31 09:16:20 -04:00
sshleifer 105d83d595 undo rename 2020-05-31 08:52:04 -04:00
sshleifer bd361eae11 rename generic_train -> build_trainer 2020-05-31 08:38:36 -04:00
Patrick von PlatenandLysandre Debut 96f57c9ccb [Benchmark] Memory benchmark utils (#4198)
* improve memory benchmarking

* correct typo

* fix current memory

* check torch memory allocated

* better pytorch function

* add total cached gpu memory

* add total gpu required

* improve torch gpu usage

* update memory usage

* finalize memory tracing

* save intermediate benchmark class

* fix conflict

* improve benchmark

* improve benchmark

* finalize

* make style

* improve benchmarking

* correct typo

* make train function more flexible

* fix csv save

* better repr of bytes

* better print

* fix __repr__ bug

* finish plot script

* rename plot file

* delete csv and small improvements

* fix in plot

* fix in plot

* correct usage of timeit

* remove redundant line

* remove redundant line

* fix bug

* add hf parser tests

* add versioning and platform info

* make style

* add gpu information

* ensure backward compatibility

* finish adding all tests

* Update src/transformers/benchmark/benchmark_args.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/benchmark/benchmark_args_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* delete csv files

* fix isort ordering

* add out of memory handling

* add better train memory handling

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2020-05-27 23:22:16 +02:00
sshleifer 8fb24ce3ce boom boom 2020-05-27 15:49:36 -04:00
sshleifer 6689b594fc boom boom 2020-05-27 15:46:50 -04:00
sshleifer 25edee17ed boom boom 2020-05-27 14:22:36 -04:00
sshleifer 7c52e73dfe boom boom 2020-05-27 14:19:08 -04:00
sshleifer d53236c840 boom boom 2020-05-27 14:17:34 -04:00
sshleifer eb4b3cce7a boom boom 2020-05-27 13:50:07 -04:00
sshleifer 324d4dcfce No wandb if ddp 2020-05-27 12:49:11 -04:00
sshleifer 3f6463a895 attempt logger.name fix 2020-05-27 11:51:49 -04:00
sshleifer 3c34cae08a distrib hacks 2020-05-27 15:47:45 +00:00
Lysandre DebutandJulien Chaumond 6a17688021 per_device instead of per_gpu/error thrown when argument unknown (#4618)
* per_device instead of per_gpu/error thrown when argument unknown

* [docs] Restore examples.md symlink

* Correct absolute links so that symlink to the doc works correctly

* Update src/transformers/hf_argparser.py

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Warning + reorder

* Docs

* Style

* not for squad

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-05-27 11:36:55 -04:00
sshleifer 516bbcabd0 boom boom 2020-05-27 10:28:34 -04:00
sshleifer 0c3d6d8cbf boom boom 2020-05-27 10:19:14 -04:00
sshleifer 84ea9fac23 Fixed tests 2020-05-27 09:37:52 -04:00
sshleifer 44743e8dff fix ckpt bug maybe 2020-05-27 08:49:18 -04:00
sshleifer 7f1af24a05 freeze decoder 2020-05-27 01:10:20 -04:00
sshleifer 99e7161eb2 boom boom 2020-05-26 21:23:47 -04:00
sshleifer d92a69f223 boom boom 2020-05-26 21:22:08 -04:00