c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,527 Commits 171 Branches 49 Tags
364920e216c16d73c782a61a4cf6652e541fbe18
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
LysandreJik 3f91338be9 Patched a few outdated parameters 2019-09-06 17:48:06 -04:00
LysandreJik f47f9a5874 Updated outdated examples 2019-09-06 17:10:33 -04:00
LysandreJik e52737d5ad Updated docs README to feature the examples symlink 2019-09-06 12:13:31 -04:00
LysandreJik 5e151f5e77 Table of contents 2019-09-06 12:08:36 -04:00
LysandreJik 593c070435 Better examples 2019-09-06 12:00:12 -04:00
LysandreJik 0b52642d37 1.2.0 in docs 2019-09-04 11:03:32 -04:00
LysandreJik 7f522437bc Updated documentation for LM finetuning script 2019-09-02 13:40:25 -04:00
LysandreJik 3fbf301bba [CI] Updated resource size for python 3 tests 2019-09-02 12:35:14 -04:00
LysandreJik 31d3373bc9 Appends space before special token 2019-09-01 21:07:00 -04:00
LysandreJik 6ae0bb5291 XLM 100 different URLs 2019-08-31 14:46:31 -04:00
LysandreJik 819b468f70 Fixed XLM model url 2019-08-31 14:40:51 -04:00
LysandreJik 58b59a0c31 Random seed is accessible anywhere within the common tests 2019-08-31 13:17:08 -04:00
LysandreJik ea86bef545 Check for None 2019-08-31 00:56:22 -04:00
LysandreJik e0f867a9ba XLNet bias fix on resize embeddings (cf #1124) 2019-08-31 00:50:59 -04:00
LysandreJik 11600edc6e Rebase on master + DistilBERT head pruning patch 2019-08-31 00:37:41 -04:00
LysandreJik b6992b7b47 Applied patch to OpenAI GPT, RoBERTa, TransfoL, XLM and XLNet 2019-08-31 00:33:50 -04:00
LysandreJik 0c8e823b03 Added patch to remaining models 2019-08-31 00:33:50 -04:00
LysandreJik 0cd283522a Attempt to fix head index 2019-08-31 00:33:50 -04:00
LysandreJik c85b5db61a Conditional append/init + fixed warning 2019-08-31 00:33:50 -04:00
LysandreJik 5c2b94c82a Changed string so that Circle CI accepts the warning 2019-08-31 00:33:50 -04:00
LysandreJik 87747518e9 Blocks deletion from already deleted heads. Necessary integration test. 
Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.
 2019-08-31 00:33:50 -04:00
LysandreJik 719cb3738d Pruning for GPT and GPT-2 2019-08-31 00:33:50 -04:00
LysandreJik fc1fbae45d XLM can be pruned 2019-08-31 00:33:50 -04:00
Lysandre 42e00cf9e1 Pruning saved to configuration first try 2019-08-31 00:33:50 -04:00
LysandreJik d7a4c3252e Fixed filename 2019-08-31 00:08:56 -04:00
LysandreJik 7f006cdd87 Set seed for head_masking test 2019-08-30 23:58:49 -04:00
LysandreJik 09363f2a8b Fix documentation index 2019-08-30 19:48:32 -04:00
LysandreJik 9b6e3b34d9 Docstrings 2019-08-30 14:09:02 -04:00
LysandreJik dec8f4d6fd Added DistilBERT models to all other AutoModels. 2019-08-30 13:52:18 -04:00
LysandreJik bc29aa67a9 HubConf configuration 2019-08-30 12:48:55 -04:00
LysandreJik 7ca9653852 Pytorch Hub & AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik 25e8389439 Tests for added AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik dc43215c01 Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-30 12:48:55 -04:00
LysandreJik e0caab0cf0 fix link 2019-08-30 10:09:17 -04:00
LysandreJik a600b30cc3 Fix index number in documentation 2019-08-30 10:08:14 -04:00
LysandreJik 20c06fa37d Added DistilBERT to documentation index 2019-08-30 10:06:51 -04:00
LysandreJik caf1d116a6 Closing bracket in DistilBERT's token count. 2019-08-29 15:30:10 -04:00
LysandreJik e7fba4bef5 Documentation auto-deploy 2019-08-29 12:14:29 -04:00
LysandreJik bf3dc778b8 Changed learning rate for run_squad test 2019-08-28 18:24:43 -04:00
LysandreJik 9ce42dc540 Pretrained models table fix 2019-08-28 13:56:28 -04:00
LysandreJik f753d4e32b Removed typings for Python 2 2019-08-28 10:15:02 -04:00
LysandreJik 75bc2a03cc Updated article link 2019-08-28 10:05:15 -04:00
LysandreJik 1dc43e56c9 Documentation additions 2019-08-28 09:37:27 -04:00
LysandreJik c513415b19 Dilbert tests from CommonTests 2019-08-27 23:59:00 -04:00
LysandreJik 778a263f09 GilBert added to AutoModels 2019-08-27 23:14:00 -04:00
LysandreJik e08c01aa1a fix #1102 2019-08-26 18:13:06 -04:00
LysandreJik 84a3a9689d Pytorch Hub & AutoModels 2019-08-26 16:08:43 -04:00
LysandreJik f68339639a Tests for added AutoModels 2019-08-26 16:02:23 -04:00
LysandreJik cb60ce59dd Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-26 15:44:30 -04:00
LysandreJik 529a16dec6 Generic encoding implementation. 2019-08-26 15:00:43 -04:00
LysandreJik 2ba1a14fb0 Decode now calls private property instead of public method 2019-08-22 17:25:55 -04:00
Lysandre 55f69a11b6 OpenAI GPT tests now extend CommonTests 2019-08-21 18:09:25 -04:00
Lysandre 47267ba556 OpenAI GPT-2 now depends on CommonTests. 2019-08-21 17:50:16 -04:00
Lysandre 034aa0c2d7 Fixed GPT2DoubleHeadsModel example and weight tying 2019-08-21 17:27:38 -04:00
Lysandre 814a3f4e01 Removed attention_mask from GPT-2 and GPT documentation. Corrected multiple_choice_labels to actual name mc_labels 2019-08-21 14:11:14 -04:00
Lysandre 2f9397139d Added GPT-2 LARGE to Pre-trained Models documentation 2019-08-21 11:29:37 -04:00
Lysandre d6bbcbc4cf Added finetuning example to documentation 2019-08-21 11:22:05 -04:00
Lysandre 2d042274ac Sequence special token handling for BERT and RoBERTa 2019-08-20 14:15:28 -04:00
Lysandre f94f1c6016 Distributed training + tokenizer agnostic mask token 2019-08-19 14:58:50 -04:00
Lysandre c589862b78 Doc: loading from config alone does not load the model weights 2019-08-19 10:17:47 -04:00
Lysandre 5652f54ac2 Simplified data generator + better perplexity calculator 
GPT-2 now obtains ~20 perplexity on WikiText-2
 2019-08-16 13:49:56 -04:00
LysandreJik 7e7fc53da5 Fixing run_glue example with RoBERTa 2019-08-16 11:53:10 -04:00
LysandreJik 715534800a BERT + RoBERTa masking tokens handling + GPU device update. 2019-08-16 10:10:21 -04:00
LysandreJik 339e556feb CLM for BERT, beginning of CLM fot RoBERTa; still needs a better masking token mechanism. 2019-08-16 10:10:20 -04:00
LysandreJik 5c18825a18 Removed dataset limit 2019-08-16 10:10:20 -04:00
LysandreJik 3e3e145497 Added GPT to the generative fine-tuning. 2019-08-16 10:10:20 -04:00
LysandreJik 47975ed53e Language Modeling fine-tuning using GPT-2. 2019-08-16 10:10:20 -04:00
LysandreJik ab05280666 Order of strings in AutoModel/AutoTokenizer updated. 2019-08-16 09:53:26 -04:00
LysandreJik 9d0029e215 Added RoBERTa example to README 2019-08-15 17:17:35 -04:00
LysandreJik 83dba0b67b Added RoBERTa tokenizer to AutoTokenizer 2019-08-15 17:07:07 -04:00
LysandreJik e24e19ce3b Added RoBERTa to AutoModel/AutoConfig 2019-08-15 14:02:11 -04:00
LysandreJik fe02e45e48 Release: 1.1.0 2019-08-15 11:15:08 -04:00
Lysandre Debut 88efc65bac Merge pull request #964 from huggingface/RoBERTa 
RoBERTa: model conversion, inference, tests 🔥
 2019-08-15 11:11:10 -04:00
LysandreJik 8308170156 Warning for RoBERTa sequences encoded without special tokens. 2019-08-15 10:29:04 -04:00
LysandreJik 572dcfd1db Doc 2019-08-14 14:56:14 -04:00
LysandreJik 39f426be65 Added special tokens <pad> and <mask> to RoBERTa. 2019-08-13 15:19:50 -04:00
LysandreJik 3d87991f60 Fixed error with encoding 2019-08-13 12:00:24 -04:00
LysandreJik 634a3172d8 Added integration tests for sequence builders. 2019-08-12 15:14:15 -04:00
LysandreJik 22ac004a7c Added documentation and changed parameters for special_tokens_sentences_pair. 2019-08-12 15:13:53 -04:00
LysandreJik 75d5f98fd2 Roberta tokenization + fixed tests (py3 + py2). 2019-08-09 15:02:13 -04:00
LysandreJik 14e970c271 Tokenization encode/decode class-based sequence handling 2019-08-09 15:01:38 -04:00
LysandreJik 3566d27919 Clarified PreTrainedModel.from_pretrained warning messages in documentation. 2019-08-08 19:04:34 -04:00
LysandreJik fbd746bd06 Updated test architecture 2019-08-08 18:21:34 -04:00
LysandreJik 6c41a8f5dc Encode and Decode are back in the superclass. They now handle sentence pairs special tokens. 2019-08-08 18:20:32 -04:00
LysandreJik f2b300df6b fix #976 2019-08-08 10:38:57 -04:00
LysandreJik 7df303f5ad fix #971 2019-08-08 10:36:26 -04:00
LysandreJik d2cc6b101e Merge branch 'master' into RoBERTa 2019-08-08 09:42:05 -04:00
LysandreJik 39d72bcc7b Fixed the RoBERTa checkpoint conversion script according to the LM head refactoring. 2019-08-07 14:21:57 -04:00
LysandreJik 770043eea2 Sentence-pair tasks handling. Using common tests on RoBERTa. Forced push to fix indentation. 2019-08-07 12:53:19 -04:00
Lysandre Debut 6f05ad72b4 Merge pull request #791 from huggingface/doc 
RestructuredText table for pretrained models.
 2019-08-05 10:18:00 -04:00
LysandreJik 9d381e7be9 Fixed incorrect links in the PretrainedModel 2019-07-17 09:25:38 -04:00
LysandreJik 117ed92992 RestructuredText table for pretrained models. 2019-07-16 11:58:47 -04:00
LysandreJik 3fbceed8d2 Fix layer reference loss + previous attempted fix 2019-07-11 22:29:55 -04:00
LysandreJik 6c2ee16c04 Test suite testing the tie_weights function as well as the resize_token_embeddings function. 
Patched an issue relating to the tied weights I had introduced with the TorchScript addition.
Byte order mark management in TSV glue reading.
 2019-07-11 22:09:16 -04:00
LysandreJik 3821ecbf4a Byte order mark management in TSV glue reading. 2019-07-11 20:16:28 -04:00
LysandreJik e3fb4310d6 From pretrained correct initialization. Unknown token handling for gpt2. 2019-07-11 18:44:29 -04:00
LysandreJik 50e62a4cb4 fix gpt/gpt-2 from pretrained 2019-07-11 16:50:21 -04:00
LysandreJik 6491575fd5 Added TorchScript disclaimer. CSS modifications. 2019-07-11 12:38:21 -04:00
LysandreJik 7fdbc47822 Added the two CLM XLM pretrained checkpoints. 
Fixed file extensions for config/vocab/merges of XLM models.
 2019-07-10 19:37:24 -04:00
LysandreJik dee3e45b93 Fixed XLM weights conversion script. Added 5 new checkpoints for XLM. 2019-07-10 19:04:21 -04:00