c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,586 Commits 171 Branches 49 Tags
60414f31a9a67ade65d90191c0b8349a189978a6
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LysandreJik 60414f31a9 GLUE updated with new methods 2019-09-19 10:55:06 +02:00
LysandreJik baa74326ab Stride + tests + small fixes 2019-09-19 10:55:06 +02:00
LysandreJik c10c7d59e7 Mask computing in standalone method. Tests. 2019-09-19 10:55:06 +02:00
LysandreJik bf503158c5 Sentence -> Sequence. Removed output_mask from the special token addition methods. 2019-09-19 10:55:06 +02:00
LysandreJik 8cba057260 Doc + remove artefacts 2019-09-19 10:55:06 +02:00
LysandreJik 6393261e41 encode + encode_plus tests modified 2019-09-19 10:55:06 +02:00
LysandreJik dcc9bb3252 Modified encode to return only lists. Added a more complete encode_plus method 2019-09-19 10:55:06 +02:00
LysandreJik af23b626c8 Max encoding length + corresponding tests 2019-09-19 10:55:06 +02:00
LysandreJik c4d4f3ec8c Updated DistilBERT test to reflect the sequence encoding 2019-09-19 10:55:06 +02:00
LysandreJik d572d7027b Number of added tokens calculator 2019-09-19 10:55:06 +02:00
LysandreJik de8e14b6c0 Added DistilBERT to run_squad script 2019-09-19 10:55:06 +02:00
LysandreJik 88368c2a16 Added DistilBERT to run_lm_finetuning 2019-09-19 10:55:06 +02:00
LysandreJik 2d8ec5a684 Changed warning to be more explicit 
Co-authored by: julien_c <chaumond@gmail.com>
 2019-09-19 10:55:06 +02:00
LysandreJik 75635072e1 Updated GLUE script to add DistilBERT. Cleaned up unused args in the utils file. 2019-09-19 10:55:06 +02:00
LysandreJik 92a9976e91 Distilbert sequence builder w/ mask 2019-09-19 10:55:06 +02:00
LysandreJik 59057abe52 typo 2019-09-19 10:55:06 +02:00
LysandreJik bac332fec0 Updated the GLUE data processor. Corrections to RoBERTa and XLNet. 2019-09-19 10:55:06 +02:00
LysandreJik c3df2136e1 Added binary masking tests 2019-09-19 10:55:06 +02:00
LysandreJik e391d4735e Tokenizers' encode function can output binary masks 2019-09-19 10:55:06 +02:00
LysandreJik 11ac4b9555 [CI] Symbolic link for documentation 2019-09-11 10:13:44 +02:00
LysandreJik 3f91338be9 Patched a few outdated parameters 2019-09-06 17:48:06 -04:00
LysandreJik f47f9a5874 Updated outdated examples 2019-09-06 17:10:33 -04:00
LysandreJik e52737d5ad Updated docs README to feature the examples symlink 2019-09-06 12:13:31 -04:00
LysandreJik 5e151f5e77 Table of contents 2019-09-06 12:08:36 -04:00
LysandreJik 593c070435 Better examples 2019-09-06 12:00:12 -04:00
LysandreJik 0b52642d37 1.2.0 in docs 2019-09-04 11:03:32 -04:00
LysandreJik 7f522437bc Updated documentation for LM finetuning script 2019-09-02 13:40:25 -04:00
LysandreJik 3fbf301bba [CI] Updated resource size for python 3 tests 2019-09-02 12:35:14 -04:00
LysandreJik 31d3373bc9 Appends space before special token 2019-09-01 21:07:00 -04:00
LysandreJik 6ae0bb5291 XLM 100 different URLs 2019-08-31 14:46:31 -04:00
LysandreJik 819b468f70 Fixed XLM model url 2019-08-31 14:40:51 -04:00
LysandreJik 58b59a0c31 Random seed is accessible anywhere within the common tests 2019-08-31 13:17:08 -04:00
LysandreJik ea86bef545 Check for None 2019-08-31 00:56:22 -04:00
LysandreJik e0f867a9ba XLNet bias fix on resize embeddings (cf #1124) 2019-08-31 00:50:59 -04:00
LysandreJik 11600edc6e Rebase on master + DistilBERT head pruning patch 2019-08-31 00:37:41 -04:00
LysandreJik b6992b7b47 Applied patch to OpenAI GPT, RoBERTa, TransfoL, XLM and XLNet 2019-08-31 00:33:50 -04:00
LysandreJik 0c8e823b03 Added patch to remaining models 2019-08-31 00:33:50 -04:00
LysandreJik 0cd283522a Attempt to fix head index 2019-08-31 00:33:50 -04:00
LysandreJik c85b5db61a Conditional append/init + fixed warning 2019-08-31 00:33:50 -04:00
LysandreJik 5c2b94c82a Changed string so that Circle CI accepts the warning 2019-08-31 00:33:50 -04:00
LysandreJik 87747518e9 Blocks deletion from already deleted heads. Necessary integration test. 
Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.
 2019-08-31 00:33:50 -04:00
LysandreJik 719cb3738d Pruning for GPT and GPT-2 2019-08-31 00:33:50 -04:00
LysandreJik fc1fbae45d XLM can be pruned 2019-08-31 00:33:50 -04:00
Lysandre 42e00cf9e1 Pruning saved to configuration first try 2019-08-31 00:33:50 -04:00
LysandreJik d7a4c3252e Fixed filename 2019-08-31 00:08:56 -04:00
LysandreJik 7f006cdd87 Set seed for head_masking test 2019-08-30 23:58:49 -04:00
LysandreJik 09363f2a8b Fix documentation index 2019-08-30 19:48:32 -04:00
LysandreJik 9b6e3b34d9 Docstrings 2019-08-30 14:09:02 -04:00
LysandreJik dec8f4d6fd Added DistilBERT models to all other AutoModels. 2019-08-30 13:52:18 -04:00
LysandreJik bc29aa67a9 HubConf configuration 2019-08-30 12:48:55 -04:00
LysandreJik 7ca9653852 Pytorch Hub & AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik 25e8389439 Tests for added AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik dc43215c01 Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-30 12:48:55 -04:00
LysandreJik e0caab0cf0 fix link 2019-08-30 10:09:17 -04:00
LysandreJik a600b30cc3 Fix index number in documentation 2019-08-30 10:08:14 -04:00
LysandreJik 20c06fa37d Added DistilBERT to documentation index 2019-08-30 10:06:51 -04:00
LysandreJik caf1d116a6 Closing bracket in DistilBERT's token count. 2019-08-29 15:30:10 -04:00
LysandreJik e7fba4bef5 Documentation auto-deploy 2019-08-29 12:14:29 -04:00
LysandreJik bf3dc778b8 Changed learning rate for run_squad test 2019-08-28 18:24:43 -04:00
LysandreJik 9ce42dc540 Pretrained models table fix 2019-08-28 13:56:28 -04:00
LysandreJik f753d4e32b Removed typings for Python 2 2019-08-28 10:15:02 -04:00
LysandreJik 75bc2a03cc Updated article link 2019-08-28 10:05:15 -04:00
LysandreJik 1dc43e56c9 Documentation additions 2019-08-28 09:37:27 -04:00
LysandreJik c513415b19 Dilbert tests from CommonTests 2019-08-27 23:59:00 -04:00
LysandreJik 778a263f09 GilBert added to AutoModels 2019-08-27 23:14:00 -04:00
LysandreJik e08c01aa1a fix #1102 2019-08-26 18:13:06 -04:00
LysandreJik 84a3a9689d Pytorch Hub & AutoModels 2019-08-26 16:08:43 -04:00
LysandreJik f68339639a Tests for added AutoModels 2019-08-26 16:02:23 -04:00
LysandreJik cb60ce59dd Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-26 15:44:30 -04:00
LysandreJik 529a16dec6 Generic encoding implementation. 2019-08-26 15:00:43 -04:00
LysandreJik 2ba1a14fb0 Decode now calls private property instead of public method 2019-08-22 17:25:55 -04:00
Lysandre 55f69a11b6 OpenAI GPT tests now extend CommonTests 2019-08-21 18:09:25 -04:00
Lysandre 47267ba556 OpenAI GPT-2 now depends on CommonTests. 2019-08-21 17:50:16 -04:00
Lysandre 034aa0c2d7 Fixed GPT2DoubleHeadsModel example and weight tying 2019-08-21 17:27:38 -04:00
Lysandre 814a3f4e01 Removed attention_mask from GPT-2 and GPT documentation. Corrected multiple_choice_labels to actual name mc_labels 2019-08-21 14:11:14 -04:00
Lysandre 2f9397139d Added GPT-2 LARGE to Pre-trained Models documentation 2019-08-21 11:29:37 -04:00
Lysandre d6bbcbc4cf Added finetuning example to documentation 2019-08-21 11:22:05 -04:00
Lysandre 2d042274ac Sequence special token handling for BERT and RoBERTa 2019-08-20 14:15:28 -04:00
Lysandre f94f1c6016 Distributed training + tokenizer agnostic mask token 2019-08-19 14:58:50 -04:00
Lysandre c589862b78 Doc: loading from config alone does not load the model weights 2019-08-19 10:17:47 -04:00
Lysandre 5652f54ac2 Simplified data generator + better perplexity calculator 
GPT-2 now obtains ~20 perplexity on WikiText-2
 2019-08-16 13:49:56 -04:00
LysandreJik 7e7fc53da5 Fixing run_glue example with RoBERTa 2019-08-16 11:53:10 -04:00
LysandreJik 715534800a BERT + RoBERTa masking tokens handling + GPU device update. 2019-08-16 10:10:21 -04:00
LysandreJik 339e556feb CLM for BERT, beginning of CLM fot RoBERTa; still needs a better masking token mechanism. 2019-08-16 10:10:20 -04:00
LysandreJik 5c18825a18 Removed dataset limit 2019-08-16 10:10:20 -04:00
LysandreJik 3e3e145497 Added GPT to the generative fine-tuning. 2019-08-16 10:10:20 -04:00
LysandreJik 47975ed53e Language Modeling fine-tuning using GPT-2. 2019-08-16 10:10:20 -04:00
LysandreJik ab05280666 Order of strings in AutoModel/AutoTokenizer updated. 2019-08-16 09:53:26 -04:00
LysandreJik 9d0029e215 Added RoBERTa example to README 2019-08-15 17:17:35 -04:00
LysandreJik 83dba0b67b Added RoBERTa tokenizer to AutoTokenizer 2019-08-15 17:07:07 -04:00
LysandreJik e24e19ce3b Added RoBERTa to AutoModel/AutoConfig 2019-08-15 14:02:11 -04:00
LysandreJik fe02e45e48 Release: 1.1.0 2019-08-15 11:15:08 -04:00
Lysandre Debut 88efc65bac Merge pull request #964 from huggingface/RoBERTa 
RoBERTa: model conversion, inference, tests 🔥
 2019-08-15 11:11:10 -04:00
LysandreJik 8308170156 Warning for RoBERTa sequences encoded without special tokens. 2019-08-15 10:29:04 -04:00
LysandreJik 572dcfd1db Doc 2019-08-14 14:56:14 -04:00
LysandreJik 39f426be65 Added special tokens <pad> and <mask> to RoBERTa. 2019-08-13 15:19:50 -04:00
LysandreJik 3d87991f60 Fixed error with encoding 2019-08-13 12:00:24 -04:00
LysandreJik 634a3172d8 Added integration tests for sequence builders. 2019-08-12 15:14:15 -04:00
LysandreJik 22ac004a7c Added documentation and changed parameters for special_tokens_sentences_pair. 2019-08-12 15:13:53 -04:00
LysandreJik 75d5f98fd2 Roberta tokenization + fixed tests (py3 + py2). 2019-08-09 15:02:13 -04:00