Commit Graph
2445 Commits
Author SHA1 Message Date
Lysandre d9daad98c7 Re-ordering of group_idx/layer_idx + Python 2 tests 2019-11-26 13:08:12 -05:00
Lysandre 9d5c49546f Tests for AlbertForQuestionAnswering AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 16263f9685 Headmasking 2019-11-26 13:08:12 -05:00
Lysandre abb23a78ba Head pruning for ALBERT 2019-11-26 13:08:12 -05:00
Lysandre 4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre 70d99980de ALBERT-V2 2019-11-26 13:08:12 -05:00
Lysandre c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
Lysandre 6637a77f80 AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 0d07a23c04 LAMB implementation 2019-11-26 13:08:12 -05:00
Lysandre c987545592 Converting script 2019-11-26 13:08:12 -05:00
Lysandre 4f3a54bfc8 ALBERT can load pre-trained models. Doesn't inherit from BERT anymore. 2019-11-26 13:08:12 -05:00
Lysandre c4403006b8 External MLM head 2019-11-26 13:08:12 -05:00
Lysandre b21402fc86 Python 2 tests + licence 2019-11-26 13:08:12 -05:00
Lysandre c14a22272f ALBERT passes all tests 2019-11-26 13:08:12 -05:00
Lysandre 870320a24e Early tests 2019-11-26 13:08:12 -05:00
Lysandre 25a31953e8 Output Attentions + output hidden states 2019-11-26 13:08:12 -05:00
Lysandre ce9eade29c Initializer range using BertPreTrainedModel 2019-11-26 13:08:12 -05:00
Lysandre 5680a11063 Activation function managed from the config file 2019-11-26 13:08:12 -05:00
Lysandre 1e5b31c388 Several fixes and improvements 2019-11-26 13:08:12 -05:00
Lysandre ee20201d33 Tokenization tests + fixes + init 2019-11-26 13:08:12 -05:00
Lysandre e3ea5d1d8d Docstrings 2019-11-26 13:08:12 -05:00
Lysandre fedac786d4 Tokenization + small fixes 2019-11-26 13:08:12 -05:00
Lysandre 67b422662c Documentation + improved AlbertForMaskedLM 2019-11-26 13:08:12 -05:00
Lysandre 1b92564330 Reorganize and cleanup 2019-11-26 13:08:12 -05:00
Lysandre 12290c0d5c Handles multi layer and multi groups 2019-11-26 13:08:12 -05:00
Lysandre 139affaa8d Albert layer/layer groups 2019-11-26 13:08:12 -05:00
Lysandre 91ccbae788 Accepts multiple sizes 2019-11-26 13:08:12 -05:00
Lysandre c0c2088333 ALBERT model 2019-11-26 13:08:12 -05:00
v_sboliu 8e5d84fcc1 Fixed typo 2019-11-26 09:01:32 -05:00
Lysandre 0669c1fcd1 SQuAD v2 BERT + XLNet 2019-11-25 19:22:21 -05:00
manansanghi 5d3b8daad2 Minor bug fixes on run_ner.py 2019-11-25 16:48:03 -05:00
İbrahim Ethem Demirci aa92a184d2 resize model when special tokenizer present 2019-11-25 15:06:32 -05:00
Bilal Khan 07bf43074f Fix GPT2 docstring 2019-11-25 11:32:00 -05:00
Evpok Padding fa963ecc59 if→elif 2019-11-25 10:21:03 -05:00
Evpok Padding c8eb8157b8 fix docstrings 2019-11-25 10:21:03 -05:00
Evpok Padding 99f750d64e add Camembert models to modeling_auto 2019-11-25 10:21:03 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Julien Chaumond afaa335851 [doc] Fix assets urls 2019-11-23 11:34:45 -05:00
Julien Chaumond 176cd1ce1b [doc] homogenize instructions slightly 2019-11-23 11:18:54 -05:00
Nikolay Korolev 041a901f32 Fix typo in documentation. toto -> to 2019-11-23 10:55:16 -05:00
Lysandre e0e55bc550 Manage training example & refactor the refactor 2019-11-22 16:27:45 -05:00
Lysandre c3ba645237 Works for XLNet 2019-11-22 16:27:37 -05:00
LysandreJik a5a8a6175f Works for BERT 2019-11-22 16:27:31 -05:00
LysandreJik a7dafe2f41 Padding strategy (left and right) rather than boolean flag 2019-11-22 16:27:25 -05:00
LysandreJik 9f374c8252 encode and encode_plus handle attention masks and padding 2019-11-22 16:27:15 -05:00
Lysandre 72e506b22e wip 2019-11-22 16:26:00 -05:00
Lysandre ea52f82455 Moved some SQuAD logic to /data 2019-11-22 16:25:52 -05:00
Rémi Louf 26db31e0c0 update the documentation 2019-11-21 14:41:19 -05:00
Rémi Louf 6f70bb8c69 add instructions to run the examples 2019-11-21 14:41:19 -05:00
Juha Kiili 05d4232f63 Add valohai.yaml 2019-11-21 12:38:17 +02:00