c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,570 Commits 171 Branches 49 Tags
bac332fec06c843c8c3436091bb53343c109202d
Commit Graph
302 Commits
Author SHA1 Message Date
LysandreJik 7f006cdd87 Set seed for head_masking test 2019-08-30 23:58:49 -04:00
Julien Chaumond 1d438f15b3 [XLNet] Use pytorch's layernorm like in BERT 
See #1089

cc @thomwolf @lysandrejik

Also @dhpollack
 2019-08-30 20:20:15 -04:00
Julien Chaumond 574c5b3a72 [RoBERTa] LayerNorm's eps is not a nn.Parameter so there's no point setting it on the model 
Instead we correctly store it on the config

(regenerating the hosted config files)

cc @lysandrejik
 2019-08-30 20:09:24 -04:00
Thomas Wolf 206c35e9a4 Merge pull request #1154 from ziliwang/master 
fix: hard coding for max number
 2019-08-30 23:23:08 +02:00
Thomas Wolf f3d18c71ec Merge pull request #1152 from epwalsh/fix-special-tokens 
fix adding special tokens
 2019-08-30 23:21:59 +02:00
Thomas Wolf d483cd8e46 Merge pull request #1074 from huggingface/improved_testing 
Shortcut to special tokens' ids - fix GPT2 & RoBERTa tokenizers - improved testing for GPT/GPT-2
 2019-08-30 23:18:58 +02:00
Thomas Wolf d2f21f08f5 Merge pull request #1092 from shijie-wu/xlm-tokenization 
Added cleaned configuration properties for tokenizer with serialization - improve tokenization of XLM
 2019-08-30 23:15:40 +02:00
thomwolf bfe93a5a21 fix distilbert in auto tokenizer 2019-08-30 22:43:26 +02:00
thomwolf 256086bc69 clean up and simplify hubconf 2019-08-30 22:34:23 +02:00
thomwolf 80aa87d9a3 fix distilbert tokenizer 2019-08-30 22:24:23 +02:00
thomwolf 455a4c842c add distilbert tokenizer 2019-08-30 22:20:51 +02:00
LysandreJik dec8f4d6fd Added DistilBERT models to all other AutoModels. 2019-08-30 13:52:18 -04:00
thomwolf f35f612280 updating docstring for AutoModel 2019-08-30 12:48:55 -04:00
LysandreJik 25e8389439 Tests for added AutoModels 2019-08-30 12:48:55 -04:00
LysandreJik dc43215c01 Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification 2019-08-30 12:48:55 -04:00
thomwolf 7044ed6b05 fix tokenizers serialization 2019-08-30 17:36:11 +02:00
Thomas Wolf cd65c41a83 Merge branch 'master' into xlm-tokenization 2019-08-30 17:15:16 +02:00
thomwolf 69da972ace added test and debug tokenizer configuration serialization 2019-08-30 17:09:36 +02:00
thomwolf 88111de07c saving and reloading tokenizer configurations 2019-08-30 16:55:48 +02:00
thomwolf 3871b8a107 adding xlm 17 and 100 models and config on aws 2019-08-30 16:28:42 +02:00
thomwolf 8678ff8df5 adding 17 and 100 xlm models 2019-08-30 16:26:04 +02:00
thomwolf 82462c5cba Added option to setup pretrained tokenizer arguments 2019-08-30 15:30:41 +02:00
Thomas Wolf 41f35d0b3d Merge pull request #1089 from dhpollack/dhp/use_pytorch_layernorm 
change layernorm code to pytorch's native layer norm
 2019-08-30 14:49:08 +02:00
Thomas Wolf 50e615f43d Merge branch 'master' into improved_testing 2019-08-30 13:40:35 +02:00
thomwolf f8aace6bcd update tokenizers to use self.XX_token_id instead of converting self.XX_token 2019-08-30 13:39:52 +02:00
thomwolf 8faf2e086b more doc on special tokens 2019-08-30 13:36:22 +02:00
thomwolf ce5ef4b35d python2 doesn't spark joy 2019-08-30 13:22:43 +02:00
thomwolf 5dd7b677ad clean up all byte-level bpe tests 2019-08-30 12:43:08 +02:00
thomwolf ca1a00a302 fix for python2 2019-08-30 12:29:31 +02:00
thomwolf 4e6a3172ce update roberta docstring as well 2019-08-30 12:23:37 +02:00
thomwolf fd10d79b55 update GPT2 docstring 2019-08-30 12:23:12 +02:00
thomwolf abe734ca1f fix GPT-2 and RoBERTa tests to be clean now 2019-08-30 12:20:18 +02:00
thomwolf 0f5a799456 fix GPT2DoubleHeadModel docstring 2019-08-30 11:49:23 +02:00
thomwolf d51f72d5de adding shortcut to the ids of all the special tokens 2019-08-30 11:41:11 +02:00
thomwolf 50e6daf83a fix Roberta tokenizer __init__ 2019-08-30 11:27:43 +02:00
thomwolf 0517e7a1cb Fix GPT2 and RoBERTa tokenizer to beging with a space - update Roberta tokenizer 2019-08-30 11:23:49 +02:00
erenup 6e1ac34e2b Merge remote-tracking branch 'huggingface/master' 2019-08-30 15:50:11 +08:00
ziliwang 6060b2f89b fix: hard coding for max number 
fp16 max number is 65504, the original 1e30 will cause Nan in fp16
 2019-08-30 12:13:47 +08:00
epwalsh 07e21307b6 fix adding special tokens 2019-08-29 13:44:50 -07:00
thomwolf 0a74c88ac6 fix #1131 2019-08-28 22:41:42 +02:00
Thomas Wolf 5f297c7be3 Merge pull request #1087 from huggingface/fix-warnings 
Decode now calls private property instead of public method
 2019-08-28 22:22:11 +02:00
Stefan Schweter ed2ab1c220 distilbert: fix number of hidden_size 2019-08-28 18:08:16 +02:00
Thomas Wolf 0ecfd17f49 Merge pull request #987 from huggingface/generative-finetuning 
Generative finetuning
 2019-08-28 16:51:50 +02:00
Thomas Wolf 50792dbdcc Merge pull request #1127 from huggingface/dilbert 
DilBERT
 2019-08-28 16:43:09 +02:00
thomwolf e7706f514b update again 2019-08-28 16:37:22 +02:00
thomwolf b5eb283aaa update credits 2019-08-28 16:36:55 +02:00
LysandreJik f753d4e32b Removed typings for Python 2 2019-08-28 10:15:02 -04:00
LysandreJik 75bc2a03cc Updated article link 2019-08-28 10:05:15 -04:00
LysandreJik 1dc43e56c9 Documentation additions 2019-08-28 09:37:27 -04:00
thomwolf 912a377e90 dilbert -> distilbert 2019-08-28 13:59:42 +02:00