c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,737 Commits 171 Branches 49 Tags
36f592cc828c77cb651dc1c17a2c5d6ad41451aa
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LysandreJik 36f592cc82 Updated doc for InputExample and InputFeatures 2019-09-26 07:45:40 -04:00
LysandreJik ad4a393e2e Changed processor documentation architecture. Added documentation for GLUE 2019-09-26 07:45:40 -04:00
LysandreJik c4ac7a76db GLUE processors 2019-09-26 07:45:40 -04:00
LysandreJik 4acd87ff4e TF models added to documentation 2019-09-26 07:45:40 -04:00
LysandreJik cf5c5c9e1c Documentation 2019-09-26 07:43:13 -04:00
LysandreJik 1761d2091a Check to see if the models have the same results when in eval mode (pt) or when training=False (tf) 2019-09-24 14:59:10 -04:00
LysandreJik 0b82e3d0d9 Relative imports 2019-09-24 09:52:25 -04:00
LysandreJik f09e5ecef0 [Proposal] GLUE processors included in library 2019-09-24 09:47:34 -04:00
LysandreJik 72402d1acd Fixed DistilBERT tokenizer 2019-09-24 09:41:14 -04:00
LysandreJik d340e2329e create_mask_from_sequences -> create_token_type_ids_from_sequences 2019-09-24 09:09:28 -04:00
LysandreJik c832f43a4d output_token_type -> token_type_ids 2019-09-24 07:21:38 -04:00
LysandreJik 3927d7756c Updated the GLUE pre-processing method 2019-09-24 07:15:11 -04:00
LysandreJik 0ea82b246f Updated tests 2019-09-24 07:10:09 -04:00
LysandreJik 9d44236f70 Updated DistilBERT 2019-09-24 07:03:24 -04:00
LysandreJik ab984a8b72 Python 2 compatibility 2019-09-19 15:01:33 +02:00
LysandreJik 3df208c93a Tokenizer accepts token list as well as string 2019-09-19 14:47:52 +02:00
LysandreJik 66ea76b8a9 prepare_for_model and prepare_pair_for_model methods. Added an option to select which sequence will be truncated. 2019-09-19 13:50:51 +02:00
LysandreJik 60414f31a9 GLUE updated with new methods 2019-09-19 10:55:06 +02:00
LysandreJik baa74326ab Stride + tests + small fixes 2019-09-19 10:55:06 +02:00
LysandreJik c10c7d59e7 Mask computing in standalone method. Tests. 2019-09-19 10:55:06 +02:00
LysandreJik bf503158c5 Sentence -> Sequence. Removed output_mask from the special token addition methods. 2019-09-19 10:55:06 +02:00
LysandreJik 8cba057260 Doc + remove artefacts 2019-09-19 10:55:06 +02:00
LysandreJik 6393261e41 encode + encode_plus tests modified 2019-09-19 10:55:06 +02:00
LysandreJik dcc9bb3252 Modified encode to return only lists. Added a more complete encode_plus method 2019-09-19 10:55:06 +02:00
LysandreJik af23b626c8 Max encoding length + corresponding tests 2019-09-19 10:55:06 +02:00
LysandreJik c4d4f3ec8c Updated DistilBERT test to reflect the sequence encoding 2019-09-19 10:55:06 +02:00
LysandreJik d572d7027b Number of added tokens calculator 2019-09-19 10:55:06 +02:00
LysandreJik de8e14b6c0 Added DistilBERT to run_squad script 2019-09-19 10:55:06 +02:00
LysandreJik 88368c2a16 Added DistilBERT to run_lm_finetuning 2019-09-19 10:55:06 +02:00
LysandreJik 2d8ec5a684 Changed warning to be more explicit 
Co-authored by: julien_c <chaumond@gmail.com>
 2019-09-19 10:55:06 +02:00
LysandreJik 75635072e1 Updated GLUE script to add DistilBERT. Cleaned up unused args in the utils file. 2019-09-19 10:55:06 +02:00
LysandreJik 92a9976e91 Distilbert sequence builder w/ mask 2019-09-19 10:55:06 +02:00
LysandreJik 59057abe52 typo 2019-09-19 10:55:06 +02:00
LysandreJik bac332fec0 Updated the GLUE data processor. Corrections to RoBERTa and XLNet. 2019-09-19 10:55:06 +02:00
LysandreJik c3df2136e1 Added binary masking tests 2019-09-19 10:55:06 +02:00
LysandreJik e391d4735e Tokenizers' encode function can output binary masks 2019-09-19 10:55:06 +02:00
LysandreJik 11ac4b9555 [CI] Symbolic link for documentation 2019-09-11 10:13:44 +02:00
LysandreJik 3f91338be9 Patched a few outdated parameters 2019-09-06 17:48:06 -04:00
LysandreJik f47f9a5874 Updated outdated examples 2019-09-06 17:10:33 -04:00
LysandreJik e52737d5ad Updated docs README to feature the examples symlink 2019-09-06 12:13:31 -04:00
LysandreJik 5e151f5e77 Table of contents 2019-09-06 12:08:36 -04:00
LysandreJik 593c070435 Better examples 2019-09-06 12:00:12 -04:00
LysandreJik 0b52642d37 1.2.0 in docs 2019-09-04 11:03:32 -04:00
LysandreJik 7f522437bc Updated documentation for LM finetuning script 2019-09-02 13:40:25 -04:00
LysandreJik 3fbf301bba [CI] Updated resource size for python 3 tests 2019-09-02 12:35:14 -04:00
LysandreJik 31d3373bc9 Appends space before special token 2019-09-01 21:07:00 -04:00
LysandreJik 6ae0bb5291 XLM 100 different URLs 2019-08-31 14:46:31 -04:00
LysandreJik 819b468f70 Fixed XLM model url 2019-08-31 14:40:51 -04:00
LysandreJik 58b59a0c31 Random seed is accessible anywhere within the common tests 2019-08-31 13:17:08 -04:00
LysandreJik ea86bef545 Check for None 2019-08-31 00:56:22 -04:00
LysandreJik e0f867a9ba XLNet bias fix on resize embeddings (cf #1124) 2019-08-31 00:50:59 -04:00
LysandreJik 11600edc6e Rebase on master + DistilBERT head pruning patch 2019-08-31 00:37:41 -04:00
LysandreJik b6992b7b47 Applied patch to OpenAI GPT, RoBERTa, TransfoL, XLM and XLNet 2019-08-31 00:33:50 -04:00
LysandreJik 0c8e823b03 Added patch to remaining models 2019-08-31 00:33:50 -04:00
LysandreJik 0cd283522a Attempt to fix head index 2019-08-31 00:33:50 -04:00
LysandreJik c85b5db61a Conditional append/init + fixed warning 2019-08-31 00:33:50 -04:00
LysandreJik 5c2b94c82a Changed string so that Circle CI accepts the warning 2019-08-31 00:33:50 -04:00
LysandreJik 87747518e9 Blocks deletion from already deleted heads. Necessary integration test. 
Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.
 2019-08-31 00:33:50 -04:00
LysandreJik 719cb3738d Pruning for GPT and GPT-2 2019-08-31 00:33:50 -04:00
LysandreJik fc1fbae45d XLM can be pruned 2019-08-31 00:33:50 -04:00
Lysandre 42e00cf9e1 Pruning saved to configuration first try 2019-08-31 00:33:50 -04:00
LysandreJik d7a4c3252e Fixed filename 2019-08-31 00:08:56 -04:00
LysandreJik 7f006cdd87 Set seed for head_masking test 2019-08-30 23:58:49 -04:00
LysandreJik 09363f2a8b Fix documentation index 2019-08-30 19:48:32 -04:00
LysandreJik 9b6e3b34d9 Docstrings 2019-08-30 14:09:02 -04:00
LysandreJik dec8f4d6fd Added DistilBERT models to all other AutoModels. 2019-08-30 13:52:18 -04:00
LysandreJik bc29aa67a9 HubConf configuration 2019-08-30 12:48:55 -04:00
LysandreJik 7ca9653852 Pytorch Hub & AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik 25e8389439 Tests for added AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik dc43215c01 Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-30 12:48:55 -04:00
LysandreJik e0caab0cf0 fix link 2019-08-30 10:09:17 -04:00
LysandreJik a600b30cc3 Fix index number in documentation 2019-08-30 10:08:14 -04:00
LysandreJik 20c06fa37d Added DistilBERT to documentation index 2019-08-30 10:06:51 -04:00
LysandreJik caf1d116a6 Closing bracket in DistilBERT's token count. 2019-08-29 15:30:10 -04:00
LysandreJik e7fba4bef5 Documentation auto-deploy 2019-08-29 12:14:29 -04:00
LysandreJik bf3dc778b8 Changed learning rate for run_squad test 2019-08-28 18:24:43 -04:00
LysandreJik 9ce42dc540 Pretrained models table fix 2019-08-28 13:56:28 -04:00
LysandreJik f753d4e32b Removed typings for Python 2 2019-08-28 10:15:02 -04:00
LysandreJik 75bc2a03cc Updated article link 2019-08-28 10:05:15 -04:00
LysandreJik 1dc43e56c9 Documentation additions 2019-08-28 09:37:27 -04:00
LysandreJik c513415b19 Dilbert tests from CommonTests 2019-08-27 23:59:00 -04:00
LysandreJik 778a263f09 GilBert added to AutoModels 2019-08-27 23:14:00 -04:00
LysandreJik e08c01aa1a fix #1102 2019-08-26 18:13:06 -04:00
LysandreJik 84a3a9689d Pytorch Hub & AutoModels 2019-08-26 16:08:43 -04:00
LysandreJik f68339639a Tests for added AutoModels 2019-08-26 16:02:23 -04:00
LysandreJik cb60ce59dd Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-26 15:44:30 -04:00
LysandreJik 529a16dec6 Generic encoding implementation. 2019-08-26 15:00:43 -04:00
LysandreJik 2ba1a14fb0 Decode now calls private property instead of public method 2019-08-22 17:25:55 -04:00
Lysandre 55f69a11b6 OpenAI GPT tests now extend CommonTests 2019-08-21 18:09:25 -04:00
Lysandre 47267ba556 OpenAI GPT-2 now depends on CommonTests. 2019-08-21 17:50:16 -04:00
Lysandre 034aa0c2d7 Fixed GPT2DoubleHeadsModel example and weight tying 2019-08-21 17:27:38 -04:00
Lysandre 814a3f4e01 Removed attention_mask from GPT-2 and GPT documentation. Corrected multiple_choice_labels to actual name mc_labels 2019-08-21 14:11:14 -04:00
Lysandre 2f9397139d Added GPT-2 LARGE to Pre-trained Models documentation 2019-08-21 11:29:37 -04:00
Lysandre d6bbcbc4cf Added finetuning example to documentation 2019-08-21 11:22:05 -04:00
Lysandre 2d042274ac Sequence special token handling for BERT and RoBERTa 2019-08-20 14:15:28 -04:00
Lysandre f94f1c6016 Distributed training + tokenizer agnostic mask token 2019-08-19 14:58:50 -04:00
Lysandre c589862b78 Doc: loading from config alone does not load the model weights 2019-08-19 10:17:47 -04:00
Lysandre 5652f54ac2 Simplified data generator + better perplexity calculator 
GPT-2 now obtains ~20 perplexity on WikiText-2
 2019-08-16 13:49:56 -04:00
LysandreJik 7e7fc53da5 Fixing run_glue example with RoBERTa 2019-08-16 11:53:10 -04:00
LysandreJik 715534800a BERT + RoBERTa masking tokens handling + GPU device update. 2019-08-16 10:10:21 -04:00