c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,510 Commits 171 Branches 49 Tags
110394b2ba33d2a739e06e8da8b44a29a80cdef6
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LysandreJik 7296f1010b Cleanup squad and add allow train_file and predict_file usage 2019-12-12 13:01:04 -05:00
LysandreJik fe92755b99 Fix special tokens mask in encode 2019-12-12 11:37:19 -05:00
LysandreJik 3d57c51111 Fix encode plus 2019-12-11 15:10:17 -05:00
LysandreJik 4c12860f7a Remove misleading documentation 2019-12-11 09:22:37 -05:00
LysandreJik 6a73382706 Complete warning + cleanup 2019-12-10 14:33:24 -05:00
Lysandre dc4e9e5cb3 DataParallel for SQuAD + fix XLM 2019-12-10 19:21:20 +00:00
LysandreJik 2a4ef098d6 Add ALBERT and XLM to SQuAD script 2019-12-09 10:46:47 -05:00
LysandreJik e9217da5ff Cleanup 
Improve global visibility on the run_squad script, remove unused files and fixes related to XLNet.
 2019-12-05 16:01:51 -05:00
LysandreJik 9ecd83dace Patch evaluation for impossible values + cleanup 2019-12-05 14:44:57 -05:00
LysandreJik ce158a076f Return dataset (pytorch) 2019-12-04 17:55:52 -05:00
LysandreJik 7a03519975 Documentation 2019-12-04 17:24:35 -05:00
LysandreJik 33508ae310 Remove only_first 2019-12-04 16:26:45 -05:00
LysandreJik f7e4a7cdfa Cleanup 2019-12-04 16:24:15 -05:00
LysandreJik a7ca6d738b Padding side is tokenizer-dependant 2019-12-04 15:43:34 -05:00
LysandreJik cca75e7884 Kill the demon spawn 2019-12-04 15:42:29 -05:00
LysandreJik bf119c0568 TFDS dataset can now be evaluated 2019-12-04 11:34:59 -05:00
LysandreJik 9ddc3f1a12 Naming update + XLNet/XLM evaluation 2019-12-04 10:37:00 -05:00
LysandreJik de276de1c1 Working evaluation 2019-12-03 17:15:51 -05:00
LysandreJik c835bc85c2 Compute predictions 2019-12-03 15:28:16 -05:00
LysandreJik 285b1241e3 Added SquadResult 2019-12-03 15:00:49 -05:00
LysandreJik 8101924a68 Patch: v2.2.1 2019-12-03 11:20:26 -05:00
LysandreJik fbaf05bd92 Remove annoying tokenization message 2019-12-02 18:23:00 -05:00
Lysandre e85855f2c4 Fix ALBERT exports with pretraining + sp classifier; Fix naming for ALBERT TF models 2019-12-02 18:00:19 -05:00
Lysandre b3d834ae11 Reorganize ALBERT conversion script 2019-12-02 15:01:52 -05:00
Lysandre 1e9ac5a7cf New -> normal 2019-11-28 17:43:47 -05:00
Lysandre 0b84b9fd8a Add processors to __init__ 2019-11-28 17:38:52 -05:00
Lysandre f671997ef7 Interface with TFDS 2019-11-28 17:17:20 -05:00
Lysandre bd41e8292a Cleanup & Evaluation now works 2019-11-28 16:03:56 -05:00
Lysandre 45d767297a Updated v2.2.0 doc 2019-11-27 10:12:20 -05:00
Lysandre 361620954a Remove TFBertForPreTraining from ALBERT doc 2019-11-27 10:11:37 -05:00
Lysandre cc7968227e Updated v2.2.0 doc 2019-11-26 15:52:25 -05:00
Lysandre ce02550d50 Fix pretrained models table 2019-11-26 15:47:02 -05:00
Lysandre cf26a0c85e Fix pretrained models table 2019-11-26 15:40:03 -05:00
Lysandre 44b82c777f Updated v2.2.0 doc 2019-11-26 15:15:11 -05:00
Lysandre ee4647bd5c CamemBERT & ALBERT doc 2019-11-26 15:10:51 -05:00
Lysandre 7c6000e412 Updated v2.2.0 doc 2019-11-26 14:55:29 -05:00
Lysandre 668aac45d2 Pretrained models 2019-11-26 14:52:42 -05:00
Lysandre ae98d45991 Release: v2.2.0 2019-11-26 14:12:44 -05:00
Lysandre f2f329408d Fix input embeddings 2019-11-26 13:08:12 -05:00
LysandreJik c536c2a480 ALBERT Input Embeds 2019-11-26 13:08:12 -05:00
LysandreJik f873b55e43 Warning for ALBERT-v2 models 2019-11-26 13:08:12 -05:00
Lysandreandwassname c9cb7f8a0f Torch 1.1.0 compatibility + FP16 O1 + TF checkpoints 
Co-authored-by: wassname
 2019-11-26 13:08:12 -05:00
Lysandre b18509c208 Tests for ALBERT in TF2 + fixes 2019-11-26 13:08:12 -05:00
Lysandre 7bddbf5961 TFAlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre f6f382532b ALBERT in TF2 2019-11-26 13:08:12 -05:00
Lysandre d9daad98c7 Re-ordering of group_idx/layer_idx + Python 2 tests 2019-11-26 13:08:12 -05:00
Lysandre 9d5c49546f Tests for AlbertForQuestionAnswering AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 16263f9685 Headmasking 2019-11-26 13:08:12 -05:00
Lysandre abb23a78ba Head pruning for ALBERT 2019-11-26 13:08:12 -05:00
Lysandre 4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre 70d99980de ALBERT-V2 2019-11-26 13:08:12 -05:00
Lysandre c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
Lysandre 6637a77f80 AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 0d07a23c04 LAMB implementation 2019-11-26 13:08:12 -05:00
Lysandre c987545592 Converting script 2019-11-26 13:08:12 -05:00
Lysandre 4f3a54bfc8 ALBERT can load pre-trained models. Doesn't inherit from BERT anymore. 2019-11-26 13:08:12 -05:00
Lysandre c4403006b8 External MLM head 2019-11-26 13:08:12 -05:00
Lysandre b21402fc86 Python 2 tests + licence 2019-11-26 13:08:12 -05:00
Lysandre c14a22272f ALBERT passes all tests 2019-11-26 13:08:12 -05:00
Lysandre 870320a24e Early tests 2019-11-26 13:08:12 -05:00
Lysandre 25a31953e8 Output Attentions + output hidden states 2019-11-26 13:08:12 -05:00
Lysandre ce9eade29c Initializer range using BertPreTrainedModel 2019-11-26 13:08:12 -05:00
Lysandre 5680a11063 Activation function managed from the config file 2019-11-26 13:08:12 -05:00
Lysandre 1e5b31c388 Several fixes and improvements 2019-11-26 13:08:12 -05:00
Lysandre ee20201d33 Tokenization tests + fixes + init 2019-11-26 13:08:12 -05:00
Lysandre e3ea5d1d8d Docstrings 2019-11-26 13:08:12 -05:00
Lysandre fedac786d4 Tokenization + small fixes 2019-11-26 13:08:12 -05:00
Lysandre 67b422662c Documentation + improved AlbertForMaskedLM 2019-11-26 13:08:12 -05:00
Lysandre 1b92564330 Reorganize and cleanup 2019-11-26 13:08:12 -05:00
Lysandre 12290c0d5c Handles multi layer and multi groups 2019-11-26 13:08:12 -05:00
Lysandre 139affaa8d Albert layer/layer groups 2019-11-26 13:08:12 -05:00
Lysandre 91ccbae788 Accepts multiple sizes 2019-11-26 13:08:12 -05:00
Lysandre c0c2088333 ALBERT model 2019-11-26 13:08:12 -05:00
Lysandre 0669c1fcd1 SQuAD v2 BERT + XLNet 2019-11-25 19:22:21 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Lysandre e0e55bc550 Manage training example & refactor the refactor 2019-11-22 16:27:45 -05:00
Lysandre c3ba645237 Works for XLNet 2019-11-22 16:27:37 -05:00
LysandreJik a5a8a6175f Works for BERT 2019-11-22 16:27:31 -05:00
LysandreJik a7dafe2f41 Padding strategy (left and right) rather than boolean flag 2019-11-22 16:27:25 -05:00
LysandreJik 9f374c8252 encode and encode_plus handle attention masks and padding 2019-11-22 16:27:15 -05:00
Lysandre 72e506b22e wip 2019-11-22 16:26:00 -05:00
Lysandre ea52f82455 Moved some SQuAD logic to /data 2019-11-22 16:25:52 -05:00
Lysandre 454455c695 fix #1879 2019-11-20 09:42:48 -05:00
Lysandre 3de31f8d28 mean does not exist in TF2 2019-11-19 18:14:14 -05:00
Lysandre be7f2aacce [CI][DOC] Don't rebuild if folder exists - Correct directory. 2019-11-14 14:54:44 -05:00
Lysandre 8f8d69716a [CI][DOC] Don't rebuild if folder exists. 2019-11-14 14:48:21 -05:00
Lysandre d7929899da Specify checkpoint in saved file for run_lm_finetuning.py 2019-11-14 10:49:00 -05:00
Lysandre a67e747889 Reorganized max_len warning 2019-11-14 10:30:22 -05:00
Lysandre e18f786cd5 Quickstart example showcasing past 2019-11-14 10:06:00 -05:00
Lysandre 74d0bcb6ff Fix special tokens addition in decoder 2019-11-12 15:27:57 -05:00
Lysandre d409aca326 Clarify the use of past in GPT2 and CTRL 2019-11-12 10:59:37 -05:00
Lysandre b5d330d118 Fix #1784 2019-11-11 10:15:14 -05:00
Lysandre d7d36181fd GPT-2 XL 2019-11-05 13:31:58 -05:00
LysandreJik 151e4ab4e7 Fix CTRL past 2019-11-05 16:26:51 +00:00
LysandreandSantosh-Gupta 68f7064a3e Add model.train() line to ReadMe training example 
Co-Authored-By: Santosh-Gupta <San.Gupta.ML@gmail.com>
 2019-11-04 11:52:35 -05:00
Lysandre 1a2b40cb53 run_tf_glue MRPC evaluation only for MRPC 2019-10-31 18:00:51 -04:00
Lysandre beaf66b1f3 Remove break 2019-10-24 21:43:28 +00:00
Lysandre bab6ad01aa run_tf_glue works with all tasks 2019-10-24 21:41:45 +00:00
Lysandre b82bfbd0c3 Updated README to show all available documentation 2019-10-24 15:55:31 +00:00
Lysandre fbcc5ff9fb Change branch to master 2019-10-22 18:01:10 -04:00