Commit Graph
1386 Commits
Author SHA1 Message Date
LysandreJik 6c41a8f5dc Encode and Decode are back in the superclass. They now handle sentence pairs special tokens. 2019-08-08 18:20:32 -04:00
Julien Chaumond e367ac469c [RoBERTa] Re-apply 39d72bcc7b
cc @lysandrejik
2019-08-08 11:26:11 -04:00
Julien Chaumond 9d0603148b [RoBERTa] RobertaForSequenceClassification + conversion 2019-08-08 11:24:54 -04:00
LysandreJik f2b300df6b fix #976 2019-08-08 10:38:57 -04:00
LysandreJik 7df303f5ad fix #971 2019-08-08 10:36:26 -04:00
LysandreJik d2cc6b101e Merge branch 'master' into RoBERTa 2019-08-08 09:42:05 -04:00
LysandreJik 39d72bcc7b Fixed the RoBERTa checkpoint conversion script according to the LM head refactoring. 2019-08-07 14:21:57 -04:00
LysandreJik 770043eea2 Sentence-pair tasks handling. Using common tests on RoBERTa. Forced push to fix indentation. 2019-08-07 12:53:19 -04:00
Thomas Wolf 7729ef7381 Merge pull request #955 from FeiWang96/master
Fix comment typo
2019-08-07 10:11:25 +02:00
Thomas Wolf 5c6ecf37e7 Merge pull request #958 from saket404/typo-fix
Fixed small typo
2019-08-07 10:10:20 +02:00
Thomas Wolf b4f9464f90 Merge pull request #960 from ethanjperez/patch-1
Fixing unused weight_decay argument
2019-08-07 10:09:55 +02:00
Thomas Wolf 822d6768eb Merge pull request #962 from guotong1988/patch-1
Update modeling_xlnet.py
2019-08-07 10:09:20 +02:00
Thomas Wolf 7e6102ce74 Merge pull request #963 from guotong1988/patch-2
Update modeling_bert.py
2019-08-07 10:09:04 +02:00
Thomas Wolf 3773ba44f0 Merge pull request #977 from chrisgzf/master
Fixed typo in migration guide
2019-08-07 10:08:45 +02:00
Thomas Wolf a80aa03bda Merge pull request #973 from FeiWang96/bert_config
Fix examples of loading pretrained models in docstring
2019-08-07 10:08:22 +02:00
Christopher Goh a6f412da01 Fixed typo in migration guide 2019-08-07 02:19:14 +08:00
wangfei 6ec1ee9ec2 Fix examples in docstring 2019-08-06 11:32:54 +08:00
wangfei 72622926e5 Fix examples in docstring 2019-08-06 11:32:41 +08:00
wangfei f889e77b9c Fix examples of loading pretrained models in docstring 2019-08-06 11:30:35 +08:00
wangfei beb03ec6c5 Fix examples of loading pretrained models in docstring 2019-08-06 11:24:46 +08:00
Thomas Wolf 4fc9f9ef54 Merge pull request #910 from huggingface/auto_models
Adding AutoTokenizer and AutoModel classes that automatically detect architecture - Clean up tokenizers
2019-08-05 19:17:47 +02:00
Thomas Wolf d43dc48b34 Merge branch 'master' into auto_models 2019-08-05 19:17:35 +02:00
thomwolf 0b524b0848 remove derived classes for now 2019-08-05 19:08:19 +02:00
thomwolf 13936a9621 update doc and tests 2019-08-05 18:48:16 +02:00
thomwolf ed4e542260 adding tests 2019-08-05 18:14:07 +02:00
thomwolf 3a126e73dd fix #950 2019-08-05 17:26:29 +02:00
thomwolf 7223886dc9 fix #944 2019-08-05 17:16:56 +02:00
thomwolf 70c10caa06 add option mentioned in #940 2019-08-05 17:09:37 +02:00
thomwolf 077ad693e9 tweak issue templates wordings 2019-08-05 16:46:29 +02:00
thomwolf 02d4087cb8 Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT 2019-08-05 16:26:01 +02:00
thomwolf 7c524d631e add issue templates 2019-08-05 16:25:54 +02:00
Lysandre Debut 6f05ad72b4 Merge pull request #791 from huggingface/doc
RestructuredText table for pretrained models.
2019-08-05 10:18:00 -04:00
thomwolf b90e29d52c working on automodels 2019-08-05 16:06:34 +02:00
thomwolf 58830807d1 inidicate we only support pytorch 1.0.0+ now 2019-08-05 14:38:59 +02:00
thomwolf 328afb7097 cleaning up tokenizer tests structure (at last) - last remaining ppb refs 2019-08-05 14:08:56 +02:00
Thomas Wolf 0e918707dc Merge pull request #907 from dhpollack/fix_convert_to_tf
Fix convert to tf
2019-08-05 12:55:04 +02:00
Julien Chaumond cb9db101c7 Python 2 must DIE 2019-08-04 22:04:15 -04:00
Julien Chaumond 05c083520a [RoBERTa] model conversion, inference, tests 🔥 2019-08-04 21:39:21 -04:00
雷打不动! d7fd10568c Update modeling_bert.py 2019-08-05 08:58:19 +08:00
雷打不动! 84eb699082 Update modeling_xlnet.py 2019-08-05 08:57:09 +08:00
thomwolf 00132b7a7a updating docs - adding few tests to tokenizers 2019-08-04 22:42:55 +02:00
Ethan Perez 28ba345ecc Fixing unused weight_decay argument
Currently the L2 regularization is hard-coded to "0.01", even though there is a --weight_decay flag implemented (that is unused). I'm making this flag control the weight decay used for fine-tuning in this script.
2019-08-04 12:31:46 -04:00
thomwolf 009273dbdd big doc update [WIP] 2019-08-04 12:14:57 +02:00
Saket Khandelwal 836e513698 Fixed small typo 2019-08-04 16:05:10 +10:00
wangfei a24f830604 Fix comment typo 2019-08-03 12:17:06 +08:00
Julien Chaumond 44dd941efb link to swift-coreml-transformers 2019-08-01 09:50:30 -04:00
Anthony MOI f2a3eb987e Fix small typos 2019-07-31 11:05:06 -04:00
Pierric Cistac 97091acb8c Small spelling fix 2019-07-31 10:37:56 -04:00
Grégory Châtel 769bb643ce Fixing a broken link. 2019-07-31 10:22:41 -04:00
David Pollack c90119e543 spelling mistake 2019-07-29 16:56:02 +02:00