c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,334 Commits 171 Branches 49 Tags
48cbf267c988b56c71a2380f748a3e6092ccaed3
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LysandreJik fbaf05bd92 Remove annoying tokenization message 2019-12-02 18:23:00 -05:00
Lysandre e85855f2c4 Fix ALBERT exports with pretraining + sp classifier; Fix naming for ALBERT TF models 2019-12-02 18:00:19 -05:00
Lysandre b3d834ae11 Reorganize ALBERT conversion script 2019-12-02 15:01:52 -05:00
Lysandre 45d767297a Updated v2.2.0 doc 2019-11-27 10:12:20 -05:00
Lysandre 361620954a Remove TFBertForPreTraining from ALBERT doc 2019-11-27 10:11:37 -05:00
Lysandre cc7968227e Updated v2.2.0 doc 2019-11-26 15:52:25 -05:00
Lysandre ce02550d50 Fix pretrained models table 2019-11-26 15:47:02 -05:00
Lysandre cf26a0c85e Fix pretrained models table 2019-11-26 15:40:03 -05:00
Lysandre 44b82c777f Updated v2.2.0 doc 2019-11-26 15:15:11 -05:00
Lysandre ee4647bd5c CamemBERT & ALBERT doc 2019-11-26 15:10:51 -05:00
Lysandre 7c6000e412 Updated v2.2.0 doc 2019-11-26 14:55:29 -05:00
Lysandre 668aac45d2 Pretrained models 2019-11-26 14:52:42 -05:00
Lysandre ae98d45991 Release: v2.2.0 2019-11-26 14:12:44 -05:00
Lysandre f2f329408d Fix input embeddings 2019-11-26 13:08:12 -05:00
LysandreJik c536c2a480 ALBERT Input Embeds 2019-11-26 13:08:12 -05:00
LysandreJik f873b55e43 Warning for ALBERT-v2 models 2019-11-26 13:08:12 -05:00
Lysandreandwassname c9cb7f8a0f Torch 1.1.0 compatibility + FP16 O1 + TF checkpoints 
Co-authored-by: wassname
 2019-11-26 13:08:12 -05:00
Lysandre b18509c208 Tests for ALBERT in TF2 + fixes 2019-11-26 13:08:12 -05:00
Lysandre 7bddbf5961 TFAlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre f6f382532b ALBERT in TF2 2019-11-26 13:08:12 -05:00
Lysandre d9daad98c7 Re-ordering of group_idx/layer_idx + Python 2 tests 2019-11-26 13:08:12 -05:00
Lysandre 9d5c49546f Tests for AlbertForQuestionAnswering AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 16263f9685 Headmasking 2019-11-26 13:08:12 -05:00
Lysandre abb23a78ba Head pruning for ALBERT 2019-11-26 13:08:12 -05:00
Lysandre 4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre 70d99980de ALBERT-V2 2019-11-26 13:08:12 -05:00
Lysandre c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
Lysandre 6637a77f80 AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre 0d07a23c04 LAMB implementation 2019-11-26 13:08:12 -05:00
Lysandre c987545592 Converting script 2019-11-26 13:08:12 -05:00
Lysandre 4f3a54bfc8 ALBERT can load pre-trained models. Doesn't inherit from BERT anymore. 2019-11-26 13:08:12 -05:00
Lysandre c4403006b8 External MLM head 2019-11-26 13:08:12 -05:00
Lysandre b21402fc86 Python 2 tests + licence 2019-11-26 13:08:12 -05:00
Lysandre c14a22272f ALBERT passes all tests 2019-11-26 13:08:12 -05:00
Lysandre 870320a24e Early tests 2019-11-26 13:08:12 -05:00
Lysandre 25a31953e8 Output Attentions + output hidden states 2019-11-26 13:08:12 -05:00
Lysandre ce9eade29c Initializer range using BertPreTrainedModel 2019-11-26 13:08:12 -05:00
Lysandre 5680a11063 Activation function managed from the config file 2019-11-26 13:08:12 -05:00
Lysandre 1e5b31c388 Several fixes and improvements 2019-11-26 13:08:12 -05:00
Lysandre ee20201d33 Tokenization tests + fixes + init 2019-11-26 13:08:12 -05:00
Lysandre e3ea5d1d8d Docstrings 2019-11-26 13:08:12 -05:00
Lysandre fedac786d4 Tokenization + small fixes 2019-11-26 13:08:12 -05:00
Lysandre 67b422662c Documentation + improved AlbertForMaskedLM 2019-11-26 13:08:12 -05:00
Lysandre 1b92564330 Reorganize and cleanup 2019-11-26 13:08:12 -05:00
Lysandre 12290c0d5c Handles multi layer and multi groups 2019-11-26 13:08:12 -05:00
Lysandre 139affaa8d Albert layer/layer groups 2019-11-26 13:08:12 -05:00
Lysandre 91ccbae788 Accepts multiple sizes 2019-11-26 13:08:12 -05:00
Lysandre c0c2088333 ALBERT model 2019-11-26 13:08:12 -05:00
Lysandre 7485caefb0 fix #1894 2019-11-25 09:33:39 -05:00
Lysandre 454455c695 fix #1879 2019-11-20 09:42:48 -05:00
Lysandre 3de31f8d28 mean does not exist in TF2 2019-11-19 18:14:14 -05:00
Lysandre be7f2aacce [CI][DOC] Don't rebuild if folder exists - Correct directory. 2019-11-14 14:54:44 -05:00
Lysandre 8f8d69716a [CI][DOC] Don't rebuild if folder exists. 2019-11-14 14:48:21 -05:00
Lysandre d7929899da Specify checkpoint in saved file for run_lm_finetuning.py 2019-11-14 10:49:00 -05:00
Lysandre a67e747889 Reorganized max_len warning 2019-11-14 10:30:22 -05:00
Lysandre e18f786cd5 Quickstart example showcasing past 2019-11-14 10:06:00 -05:00
Lysandre 74d0bcb6ff Fix special tokens addition in decoder 2019-11-12 15:27:57 -05:00
Lysandre d409aca326 Clarify the use of past in GPT2 and CTRL 2019-11-12 10:59:37 -05:00
Lysandre b5d330d118 Fix #1784 2019-11-11 10:15:14 -05:00
Lysandre d7d36181fd GPT-2 XL 2019-11-05 13:31:58 -05:00
LysandreJik 151e4ab4e7 Fix CTRL past 2019-11-05 16:26:51 +00:00
LysandreandSantosh-Gupta 68f7064a3e Add model.train() line to ReadMe training example 
Co-Authored-By: Santosh-Gupta <San.Gupta.ML@gmail.com>
 2019-11-04 11:52:35 -05:00
Lysandre 1a2b40cb53 run_tf_glue MRPC evaluation only for MRPC 2019-10-31 18:00:51 -04:00
Lysandre beaf66b1f3 Remove break 2019-10-24 21:43:28 +00:00
Lysandre bab6ad01aa run_tf_glue works with all tasks 2019-10-24 21:41:45 +00:00
Lysandre b82bfbd0c3 Updated README to show all available documentation 2019-10-24 15:55:31 +00:00
Lysandre fbcc5ff9fb Change branch to master 2019-10-22 18:01:10 -04:00
Lysandre 69eba0ab19 Edit script path 2019-10-22 17:53:52 -04:00
Lysandre bc3e57d551 Multi version doc deployment 2019-10-22 17:51:30 -04:00
Lysandre 7d709e55ed Remove 2019-10-22 14:12:33 -04:00
Lysandre 44286b94d3 RoBERTa doesn't print a warning when no special tokens are passed. 2019-10-22 13:46:48 -04:00
Lysandre 1cfd974868 Option to benchmark only one of the two libraries 2019-10-22 13:32:23 -04:00
Lysandre 777faa8ae7 Fix #1597 2019-10-22 11:26:42 -04:00
LysandreJik 82f6abd98a Benchmark section added to the documentation 2019-10-18 17:27:10 -04:00
LysandreJik 7dd29ed2f1 Benchmarks example script 2019-10-18 10:53:04 -04:00
Lysandre a701c9b321 CTRL to tf automodels 2019-10-11 16:05:30 -04:00
Lysandre 3ddce1d74c Release: 2.1.1 2019-10-11 06:37:49 -04:00
Lysandre 639f4b7190 Don't save/load when on TPU 2019-10-10 19:17:25 +00:00
Lysandre d4e7934ac3 GLUE on TPU 2019-10-10 19:03:06 +00:00
LysandreJik 036483fae5 Temporary CTRL tokenizer fix 2019-10-09 16:33:15 -04:00
LysandreJik 9c2e0a4acf Release: 2.1.0 2019-10-09 12:14:03 -04:00
LysandreJik 7fe98d8c18 Update CTRL documentation 2019-10-09 12:12:36 -04:00
LysandreJik 89f86f9661 CTRL added to the documentation 2019-10-09 12:04:06 -04:00
LysandreJik e17ea08e24 Pycharm folder added to gitignore 2019-10-09 11:32:21 -04:00
LysandreJik 8fcc6507ce Multilingual 2019-10-07 15:02:42 -04:00
LysandreJik f3e0218fbb Correct device assignment in run_generation 2019-10-05 21:05:16 -04:00
LysandreJik 7bddb45a6f Decode documentaton 2019-10-04 14:27:38 -04:00
LysandreJik ecc4f1bdfa XLM use_lang_embedding flag in run_generation 2019-10-03 17:42:16 -04:00
LysandreJik c2c2ca0fdb Added XLM to run_generation, with prompt language selection. 2019-10-03 17:18:48 -04:00
LysandreJik aebd83230f Update naming + remove f string in run_lm_finetuning example 2019-10-03 11:31:36 -04:00
LysandreJik 651bfb7ad5 always_truncate by default 2019-10-03 11:31:36 -04:00
LysandreJik 5ed50a93fb LM finetuning won't mask special tokens anymore 2019-10-03 11:31:36 -04:00
LysandreJik cc412edd42 Supports already existing special tokens 2019-10-03 11:31:36 -04:00
LysandreJik 2f259b228e Sequence IDS 2019-10-03 11:31:36 -04:00
LysandreJik 7c789c337d Always truncate argument in the encode method 2019-10-03 11:31:36 -04:00
LysandreJik ebb32261b1 fix #1401 2019-10-02 17:52:56 -04:00
LysandreJik ecfddc6034 Update RoBERTa and GPT-2 Tokenizer documentation (fix #1343) 2019-09-26 16:49:03 -04:00
LysandreJik 93f0c5fc72 Repository link in the documentation 2019-09-26 11:45:00 -04:00
LysandreJik 7e957237e4 [Doc] XLM + Torch in documentation 2019-09-26 10:08:56 -04:00
LysandreJik 302a4813a5 Doc building requirements [TF2] 2019-09-26 09:57:30 -04:00