c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
890 Commits 171 Branches 49 Tags
9710b68dbcdfc2b94264a68d35885ee70faaeb2f
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf 9710b68dbc fix pickles 2019-06-18 16:01:15 +02:00
thomwolf 15ebd67d4e cache in run_classifier + various fixes to the examples 2019-06-18 15:58:22 +02:00
thomwolf e6e5f19257 fix 2019-06-18 14:45:14 +02:00
thomwolf a432b3d466 distributed traing t_total 2019-06-18 14:39:09 +02:00
thomwolf c5407f343f split squad example in two 2019-06-18 14:29:03 +02:00
thomwolf 335f57baf8 only on main process 2019-06-18 14:03:46 +02:00
thomwolf 326944d627 add tensorboard to run_squad 2019-06-18 14:02:42 +02:00
thomwolf d82e5deeb1 set find_unused_parameters=True in DDP 2019-06-18 12:13:14 +02:00
thomwolf a59abedfb5 DDP update 2019-06-18 12:06:26 +02:00
thomwolf 2ef5e0de87 switch to pytorch DistributedDataParallel 2019-06-18 12:03:13 +02:00
thomwolf 9ce37af99b oups 2019-06-18 11:47:54 +02:00
thomwolf a40955f071 no need to duplicate models anymore 2019-06-18 11:46:14 +02:00
thomwolf f964753090 explanation on the current location of the caching folder 2019-06-18 11:36:28 +02:00
thomwolf 868de8d1d7 updating weights loading 2019-06-18 10:58:20 +02:00
thomwolf 64e0adda81 better error message 2019-06-18 10:51:31 +02:00
thomwolf 382e2d1e50 spliting config and weight files for bert also 2019-06-18 10:37:16 +02:00
thomwolf 4447f270b2 updating hub 2019-06-17 16:21:28 +02:00
thomwolf 33d3db5c43 updating head masking, readme and docstrings 2019-06-17 15:51:28 +02:00
thomwolf 965f172de6 output all hidden layers states in GPT/GPT-2 2019-06-17 14:34:12 +02:00
thomwolf f12007e421 add head masking and pruning to openai GPT 2019-06-17 14:19:40 +02:00
thomwolf b860e47cf5 add head masking and pruning to gpt-2 2019-06-17 14:12:10 +02:00
thomwolf 7220d47a1c adding head pruning and tests 2019-06-17 13:20:45 +02:00
thomwolf 8415a38b23 better error messages 2019-06-17 13:03:48 +02:00
thomwolf 96c4d3d988 add head masking tests 2019-06-17 12:17:26 +02:00
thomwolf 34858ae1d9 adding bert whole words, bertgerman and gpt-2 medium models, head masking 2019-06-17 11:02:39 +02:00
thomwolf 44e9ddd7fe fix num_special_tokens in GPT 2 test 2019-06-14 17:17:43 +02:00
thomwolf 5e1207b8ad add attention to all bert models and add test 2019-06-14 16:28:25 +02:00
thomwolf bcc9e93e6f fix test 2019-06-14 15:38:20 +02:00
thomwolf a3274ac40b adding attention outputs in bert 2019-06-03 16:11:45 -05:00
thomwolf 275179a003 output attentions in GPT-2 2019-05-08 22:24:42 +02:00
thomwolf 366a3b0285 clean up in tokenization 2019-05-08 21:43:51 +02:00
thomwolf 0efc4ab632 adding dropout to GPT-2 and embedding dropout to GPT 2019-05-08 10:41:35 +02:00
thomwolf ea9dbea9d5 update GPT2 loss computation for more flexbility 2019-05-07 23:27:18 +02:00
thomwolf ce86336545 add predict_special_tokens option to GPT also 2019-05-07 16:47:22 +02:00
thomwolf d1b6979aa5 GPT-2 option to avoid predicting special tokens 2019-05-07 16:25:53 +02:00
thomwolf e211785ada extract attention weights from GPT 2019-05-02 18:31:26 +02:00
thomwolf db98a4a48b gpt-2 tokenizer 2019-05-01 11:40:48 +02:00
thomwolf cd110835a0 coverage in circle-ci 2019-04-30 11:35:40 +02:00
thomwolf 80f53f7380 gpt-2 from_pretrained can use special tokens 2019-04-30 11:10:22 +02:00
thomwolf e79ceb1533 gpt-2 special tokens 2019-04-30 11:05:54 +02:00
thomwolf 1f5fc95b68 add code coverage 2019-04-30 11:05:26 +02:00
thomwolf c30139a013 add special tokens to gpt-2 2019-04-30 10:45:26 +02:00
thomwolf b832d5bb8a Release: 0.6.2 2019-04-25 21:37:47 +02:00
thomwolf 80f995a141 revert BertForMultipleChoice linear classifier 2019-04-24 16:51:54 +02:00
thomwolf d94c6b0144 fix training schedules in examples to match new API 2019-04-23 11:17:06 +02:00
thomwolf 34ae5bf838 small clean up in tests 2019-04-17 14:52:12 +02:00
thomwolf 23d4554ec0 is python 2 happy now 2019-04-17 14:48:34 +02:00
thomwolf 265550ec34 relax network connection requirements 2019-04-17 14:22:35 +02:00
thomwolf fa76520240 fix file_utils on python 2 2019-04-17 13:32:22 +02:00
thomwolf bcde2c61cb fix #497 2019-04-17 12:35:38 +02:00
thomwolf 929579f3b5 fix #497 2019-04-17 12:35:08 +02:00
thomwolf 31d387604c adding s3 model tests with --runslow 2019-04-17 11:58:27 +02:00
thomwolf 5afa497cbf fix GPT-2 tokenization to work also on python 3... 2019-04-17 11:04:41 +02:00
thomwolf bc70779bf0 fixed GPT-2 tokenization on python 2 2019-04-17 10:56:15 +02:00
thomwolf bdaba1897c updating GPT tokenization 2019-04-16 17:44:06 +02:00
thomwolf 18a8a15f78 improving GPT2 tokenization and adding tests 2019-04-16 17:00:55 +02:00
thomwolf 3571187ef6 fix saving models in distributed setting examples 2019-04-15 16:43:56 +02:00
thomwolf d616022455 fix openai special tokens loading 2019-04-15 16:07:45 +02:00
thomwolf df5d9c3551 load all models on cpu 2019-04-15 15:43:01 +02:00
thomwolf 2499b0a5fc add ptvsd to run_squad 2019-04-15 15:33:04 +02:00
thomwolf 7816f7921f clean up distributed training logging in run_squad example 2019-04-15 15:27:10 +02:00
thomwolf 1135f2384a clean up logger in examples for distributed case 2019-04-15 15:22:40 +02:00
thomwolf cc43307023 update readme 2019-04-15 15:06:10 +02:00
thomwolf 60ea6c59d2 added best practices for serialization in README and examples 2019-04-15 15:00:33 +02:00
thomwolf 179a2c2ff6 update example to work with new serialization semantic 2019-04-15 14:33:23 +02:00
thomwolf b3c6ee0ac1 tokenization updates 2019-04-15 14:24:52 +02:00
thomwolf 20577d8a7c add configuration serialization to readme 2019-04-15 14:21:41 +02:00
thomwolf 9761aa4845 add to_json_file method to configuration classes 2019-04-15 14:12:08 +02:00
thomwolf b17963d82f update readme 2019-04-15 13:44:30 +02:00
thomwolf e8568a3b17 fixing tests 2019-04-15 12:55:38 +02:00
thomwolf 870b734bfd added tokenizers serialization tests 2019-04-15 12:03:56 +02:00
thomwolf 3e65f255dc add serialization semantics to tokenizers - fix transfo-xl tokenizer 2019-04-15 11:47:25 +02:00
thomwolf fe2756ff41 update double head model 2019-04-15 10:04:05 +02:00
thomwolf b509bf7655 updating loss computation 2019-04-12 12:12:33 +02:00
thomwolf 1d203a34c0 back to simple indexing 2019-04-11 23:51:03 +02:00
thomwolf 074c869bbe fix OpenAIGPTMultipleChoiceHead 2019-04-11 20:53:50 +02:00
thomwolf 724eb45cef add stale bot 2019-04-11 17:12:00 +02:00
thomwolf 4bc4c69af9 finetuning any BERT model - fixes #455 2019-04-11 16:57:59 +02:00
thomwolf a05fad8dce fix typo 2019-04-11 13:16:17 +02:00
thomwolf 4a82f4f856 update special token addition 2019-04-11 13:11:22 +02:00
thomwolf 991b8e65f4 Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT 2019-04-11 11:43:15 +02:00
thomwolf e99b2014cc fixes #471 2019-04-11 11:43:13 +02:00
thomwolf 19666dcb3b Should fix #438 2019-04-03 11:01:01 +02:00
thomwolf 1d8c232324 Fix #436 2019-04-03 10:51:03 +02:00
thomwolf 846b1fd6f8 Fix #419 2019-04-03 10:50:38 +02:00
thomwolf 34561e61a5 update main readme also 2019-03-27 12:00:04 +01:00
thomwolf 361aff6de5 typos 2019-03-27 11:54:59 +01:00
thomwolf cea8ba1d59 adjusted formating and some wording in the readme 2019-03-27 11:53:44 +01:00
thomwolf a98dfe4ced fixing #377 (empty nbest_predictions.json) 2019-03-14 09:57:06 +01:00
thomwolf e5f2d9122c adding absolute imports to gpt2, openai and transfo-xl 2019-03-14 09:55:01 +01:00
thomwolf 7cc35c3104 fix openai gpt example and updating readme 2019-03-06 11:43:21 +01:00
thomwolf 906b638efa updating readme 2019-03-06 10:24:19 +01:00
thomwolf 994d86609b fixing PYTORCH_PRETRAINED_BERT_CACHE use in examples 2019-03-06 10:21:24 +01:00
thomwolf 2dd8f524f5 removing test for long sequences error following #337 2019-03-06 10:10:41 +01:00
thomwolf 5c85fc3977 fix typo - logger info 2019-03-06 10:05:21 +01:00
thomwolf 0202da0271 remove unnecessary example 2019-02-18 13:51:42 +01:00
thomwolf e0855e8929 forgot to add regex to requirements :( 2019-02-18 11:54:51 +01:00
thomwolf ab7f5d2943 simple 2019-02-18 11:33:54 +01:00
thomwolf b450a7faf2 clean up tokenization - fix python 2 tests 2019-02-18 11:27:18 +01:00
thomwolf d44db1145c update readme 2019-02-18 11:12:09 +01:00