c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,310 Commits 171 Branches 49 Tags
ac47dbdfdff586cbb0d97997ef688960c021fbde
Commit Graph
1185 Commits
Author SHA1 Message Date
sshleifer 3e47e61a1a Disable cos loss 2020-06-05 12:51:13 -04:00
sshleifer 20aedfbcf7 boom boom 2020-06-04 09:45:47 -04:00
sshleifer 440744a111 Distiller brewer does not break 2020-06-04 09:38:02 -04:00
sshleifer df0b28a581 boom boom 2020-06-04 02:09:27 -04:00
sshleifer 8c6769ee41 boom boom 2020-06-03 13:04:02 +00:00
sshleifer fb6adb2a47 backup rouge dfs 2020-06-03 12:53:05 +00:00
sshleifer 789f06e9d8 less annoying requirements 2020-06-02 18:59:11 -04:00
sshleifer e17df7499c merged master 2020-06-02 13:45:10 -04:00
sshleifer 82a6b8345f Merge branch 'master' into distilbart 2020-06-02 13:44:40 -04:00
sshleifer 60a90143ee rouge tracker fix 2020-06-02 11:17:09 -04:00
Julien Chaumond b42586ea56 Fix CI after killing archive maps (#4724) 
* 🐛 Fix model ids for BART and Flaubert
 2020-06-02 10:21:09 -04:00
Julien Chaumond d4c2cb402d Kill model archive maps (#4636) 
* Kill model archive maps

* Fixup

* Also kill model_archive_map for MaskedBertPreTrainedModel

* Unhook config_archive_map

* Tokenizers: align with model id changes

* make style && make quality

* Fix CI
 2020-06-02 09:39:33 -04:00
Lysandre Debut 88762a2f8c Specify PyTorch versions for examples (#4710) 2020-06-02 04:29:28 -04:00
Victor SANH bf760c80b5 finish README 2020-06-01 09:23:31 -04:00
Victor SANH 9d7d9b3ae0 weird import 2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 2a3c88a659 Update examples/movement-pruning/README.md 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-06-01 09:23:31 -04:00
Victor SANHandJulien Chaumond 4ac462bfb8 Update examples/movement-pruning/README.md 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-06-01 09:23:31 -04:00
Victor SANH 35fa0bbca0 clarify README 2020-06-01 09:23:31 -04:00
Victor SANH cc746a5020 flake8 compliance 2020-06-01 09:23:31 -04:00
Victor SANH b11386e158 less prints in saving prunebert 2020-06-01 09:23:31 -04:00
Victor SANH 8b5d4003ab complete README 2020-06-01 09:23:31 -04:00
Victor SANH 5c8e5b3709 commplying with isort 2020-06-01 09:23:31 -04:00
Victor SANH db2a3b2e01 space 2020-06-01 09:23:31 -04:00
Victor SANH 5f8f2d849a add floppy bert model notebok 2020-06-01 09:23:31 -04:00
Victor SANH b41948f5cd add requirements 2020-06-01 09:23:31 -04:00
Victor SANH fb8f4277b2 add scripts 2020-06-01 09:23:31 -04:00
Victor SANH d489a6d3d5 add masked_run_* 2020-06-01 09:23:31 -04:00
Victor SANH e4c07faf0a add sparsity modules 2020-06-01 09:23:31 -04:00
sshleifer 7b9557fbf5 boom boom 2020-05-31 09:16:20 -04:00
sshleifer 105d83d595 undo rename 2020-05-31 08:52:04 -04:00
sshleifer bd361eae11 rename generic_train -> build_trainer 2020-05-31 08:38:36 -04:00
Patrick von PlatenandLysandre Debut 96f57c9ccb [Benchmark] Memory benchmark utils (#4198) 
* improve memory benchmarking

* correct typo

* fix current memory

* check torch memory allocated

* better pytorch function

* add total cached gpu memory

* add total gpu required

* improve torch gpu usage

* update memory usage

* finalize memory tracing

* save intermediate benchmark class

* fix conflict

* improve benchmark

* improve benchmark

* finalize

* make style

* improve benchmarking

* correct typo

* make train function more flexible

* fix csv save

* better repr of bytes

* better print

* fix __repr__ bug

* finish plot script

* rename plot file

* delete csv and small improvements

* fix in plot

* fix in plot

* correct usage of timeit

* remove redundant line

* remove redundant line

* fix bug

* add hf parser tests

* add versioning and platform info

* make style

* add gpu information

* ensure backward compatibility

* finish adding all tests

* Update src/transformers/benchmark/benchmark_args.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/benchmark/benchmark_args_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* delete csv files

* fix isort ordering

* add out of memory handling

* add better train memory handling

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-05-27 23:22:16 +02:00
sshleifer 8fb24ce3ce boom boom 2020-05-27 15:49:36 -04:00
sshleifer 6689b594fc boom boom 2020-05-27 15:46:50 -04:00
sshleifer 25edee17ed boom boom 2020-05-27 14:22:36 -04:00
sshleifer 7c52e73dfe boom boom 2020-05-27 14:19:08 -04:00
sshleifer d53236c840 boom boom 2020-05-27 14:17:34 -04:00
sshleifer eb4b3cce7a boom boom 2020-05-27 13:50:07 -04:00
sshleifer 324d4dcfce No wandb if ddp 2020-05-27 12:49:11 -04:00
sshleifer 3f6463a895 attempt logger.name fix 2020-05-27 11:51:49 -04:00
sshleifer 3c34cae08a distrib hacks 2020-05-27 15:47:45 +00:00
Lysandre DebutandJulien Chaumond 6a17688021 per_device instead of per_gpu/error thrown when argument unknown (#4618) 
* per_device instead of per_gpu/error thrown when argument unknown

* [docs] Restore examples.md symlink

* Correct absolute links so that symlink to the doc works correctly

* Update src/transformers/hf_argparser.py

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Warning + reorder

* Docs

* Style

* not for squad

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-05-27 11:36:55 -04:00
sshleifer 516bbcabd0 boom boom 2020-05-27 10:28:34 -04:00
sshleifer 0c3d6d8cbf boom boom 2020-05-27 10:19:14 -04:00
sshleifer 84ea9fac23 Fixed tests 2020-05-27 09:37:52 -04:00
sshleifer 44743e8dff fix ckpt bug maybe 2020-05-27 08:49:18 -04:00
sshleifer 7f1af24a05 freeze decoder 2020-05-27 01:10:20 -04:00
sshleifer 99e7161eb2 boom boom 2020-05-26 21:23:47 -04:00
sshleifer d92a69f223 boom boom 2020-05-26 21:22:08 -04:00
sshleifer 4f19747960 boom boom 2020-05-26 21:20:53 -04:00