 Morgan Funtowicz
|
f69dbecc38
|
Expose classification labels mapping (and reverse) in model config.
|
2019-12-12 10:25:36 +01:00 |
|
|
Thomas Wolf
|
90df44f0aa
|
Merge pull request #2063 from guillaume-be/special_tokens_mask_value_not_used
special_tokens_mask value was unused and calculated twice
|
2019-12-12 08:21:46 +01:00 |
|
|
Thomas Wolf
|
707f9e9241
|
Merge pull request #2081 from pglock/patch-1
handle string with only whitespaces as empty
|
2019-12-12 08:20:43 +01:00 |
|
|
Thomas Wolf
|
137e20a846
|
Merge pull request #2075 from huggingface/check-link-validity
Check link validity
|
2019-12-12 08:09:12 +01:00 |
|
|
Thomas Wolf
|
d5712f7cac
|
Merge branch 'master' into check-link-validity
|
2019-12-12 08:00:51 +01:00 |
|
|
Thomas Wolf
|
9c58b236ef
|
Merge pull request #2144 from huggingface/from-pretrained-from-url
Allowing from_pretrained to load from url directly
|
2019-12-12 07:43:40 +01:00 |
|
|
thomwolf
|
413f41921b
|
fix merge
|
2019-12-12 07:34:42 +01:00 |
|
|
Thomas Wolf
|
386a93f0f8
|
Merge branch 'master' into from-pretrained-from-url
|
2019-12-12 07:31:05 +01:00 |
|
|
Thomas Wolf
|
2d103546ef
|
Merge pull request #2148 from huggingface/fix_encode_plus
Fix encode plus
|
2019-12-12 07:24:47 +01:00 |
|
|
Julien Chaumond
|
1748fdf657
|
[doc] Fix rst table
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
36fc52a3b4
|
Update links to weights
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
371c5ddfad
|
Py2 tests for Lysandre
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
5505cf7014
|
Run tests on Py2 too, for Lysandre
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
9cb97c0c0f
|
Actually run the tests
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
95854c4a2f
|
Actually run the tests
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
d2100428d3
|
Update to new test infra and only run conditionally
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
597ba7feb3
|
Support testing Japanese BERT tokenizers
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
6a43dc9d7d
|
Support Python 2
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
a09da4eeb0
|
Add a test for Japanese BERT tokenizers
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
57b5cb3eaa
|
Fix loading BertJapaneseTokenizer
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
c03c0dfd23
|
Add support for Japanese BERT models by cl-tohoku
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
4f15e5a267
|
Add tests.
Maybe not the best possible place for the tests, lmk.
|
2019-12-11 17:41:51 -05:00 |
|
|
Julien Chaumond
|
18e1f751f1
|
TF support
|
2019-12-11 17:07:46 -05:00 |
|
|
Julien Chaumond
|
31e5b5ff22
|
Fix tests + first example of doc
|
2019-12-11 15:22:02 -05:00 |
|
|
LysandreJik
|
3d57c51111
|
Fix encode plus
|
2019-12-11 15:10:17 -05:00 |
|
|
Julien Chaumond
|
c999a3e505
|
Allow from_pretrained to take a remote identifier
|
2019-12-11 12:29:58 -05:00 |
|
|
Stefan Schweter
|
030faccb8d
|
doc: fix pretrained models table
|
2019-12-11 12:19:21 -05:00 |
|
|
thomwolf
|
6709739a05
|
allowing from_pretrained to load from url directly
|
2019-12-11 18:15:45 +01:00 |
|
|
thomwolf
|
29570db25b
|
allowing from_pretrained to load from url directly
|
2019-12-11 17:19:18 +01:00 |
|
|
Julien Chaumond
|
2e2f9fed55
|
rm duplicate imports
|
2019-12-11 11:11:56 -05:00 |
|
|
Morgan Funtowicz
|
c28273793e
|
Add missing DistilBert and Roberta to AutoModelForTokenClassification
|
2019-12-11 15:31:45 +01:00 |
|
|
LysandreJik
|
4c12860f7a
|
Remove misleading documentation
|
2019-12-11 09:22:37 -05:00 |
|
|
Morgan Funtowicz
|
b040bff6df
|
Added supported model to AutoModelTokenClassification
|
2019-12-11 14:13:58 +01:00 |
|
|
thomwolf
|
fafd4c86ec
|
fix TF 2.0 version of T5 - update conversion script
|
2019-12-11 13:47:27 +01:00 |
|
|
Bilal Khan
|
6aa919469d
|
Update run_xnli to save optimizer and scheduler states, then resume training from a checkpoint
|
2019-12-10 19:31:22 -06:00 |
|
|
Bilal Khan
|
89896fe04f
|
Update run_ner to save optimizer and scheduler states, then resume training from a checkpoint
|
2019-12-10 19:31:22 -06:00 |
|
|
Bilal Khan
|
fdc05cd68f
|
Update run_squad to save optimizer and scheduler states, then resume training from a checkpoint
|
2019-12-10 19:31:22 -06:00 |
|
|
Bilal Khan
|
854ec5784e
|
Update run_glue to save optimizer and scheduler states, then resume training from a checkpoint
|
2019-12-10 19:30:36 -06:00 |
|
|
Morgan Funtowicz
|
9a24e0cf76
|
Refactored qa pipeline argument handling + unittests
|
2019-12-11 00:33:25 +01:00 |
|
|
LysandreJik
|
b72f9d340e
|
Correct index in script
|
2019-12-10 18:33:17 -05:00 |
|
|
Thomas Wolf
|
51ae203290
|
Merge pull request #2129 from leopd/master
Progress indicator improvements when downloading pre-trained models.
|
2019-12-10 22:18:55 +01:00 |
|
|
LysandreJik
|
ec6fb25c21
|
Patch documentation
|
2019-12-10 15:49:20 -05:00 |
|
|
LysandreJik
|
418589244d
|
Uniforming the ignored indices
|
2019-12-10 15:26:19 -05:00 |
|
|
Leo Dirac
|
58d75aa310
|
Progress indicator improvements when downloading pre-trained models.
|
2019-12-10 11:36:56 -08:00 |
|
|
LysandreJik
|
6a73382706
|
Complete warning + cleanup
|
2019-12-10 14:33:24 -05:00 |
|
|
Lysandre
|
dc4e9e5cb3
|
DataParallel for SQuAD + fix XLM
|
2019-12-10 19:21:20 +00:00 |
|
|
thomwolf
|
67a8be8e90
|
fix backward in tests
|
2019-12-10 17:50:32 +01:00 |
|
|
Rémi Louf
|
07bc8efbc3
|
add greedy decoding and sampling
|
2019-12-10 17:27:50 +01:00 |
|
|
Morgan Funtowicz
|
63e36007ee
|
Make sure padding, cls and another non-context tokens cannot appear in the answer.
|
2019-12-10 16:47:35 +01:00 |
|
|
thomwolf
|
f2538c1274
|
all tests in torch no grad
|
2019-12-10 16:33:11 +01:00 |
|