 Julien Chaumond
|
9cb97c0c0f
|
Actually run the tests
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
95854c4a2f
|
Actually run the tests
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
d2100428d3
|
Update to new test infra and only run conditionally
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
597ba7feb3
|
Support testing Japanese BERT tokenizers
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
6a43dc9d7d
|
Support Python 2
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
a09da4eeb0
|
Add a test for Japanese BERT tokenizers
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
57b5cb3eaa
|
Fix loading BertJapaneseTokenizer
|
2019-12-11 18:32:27 -05:00 |
|
|
Masatoshi Suzuki
|
c03c0dfd23
|
Add support for Japanese BERT models by cl-tohoku
|
2019-12-11 18:32:27 -05:00 |
|
|
Julien Chaumond
|
4f15e5a267
|
Add tests.
Maybe not the best possible place for the tests, lmk.
|
2019-12-11 17:41:51 -05:00 |
|
|
Julien Chaumond
|
18e1f751f1
|
TF support
|
2019-12-11 17:07:46 -05:00 |
|
|
Julien Chaumond
|
31e5b5ff22
|
Fix tests + first example of doc
|
2019-12-11 15:22:02 -05:00 |
|
|
LysandreJik
|
3d57c51111
|
Fix encode plus
|
2019-12-11 15:10:17 -05:00 |
|
|
Julien Chaumond
|
c999a3e505
|
Allow from_pretrained to take a remote identifier
|
2019-12-11 12:29:58 -05:00 |
|
|
Stefan Schweter
|
030faccb8d
|
doc: fix pretrained models table
|
2019-12-11 12:19:21 -05:00 |
|
|
thomwolf
|
6709739a05
|
allowing from_pretrained to load from url directly
|
2019-12-11 18:15:45 +01:00 |
|
|
thomwolf
|
29570db25b
|
allowing from_pretrained to load from url directly
|
2019-12-11 17:19:18 +01:00 |
|
|
Julien Chaumond
|
2e2f9fed55
|
rm duplicate imports
|
2019-12-11 11:11:56 -05:00 |
|
|
Morgan Funtowicz
|
c28273793e
|
Add missing DistilBert and Roberta to AutoModelForTokenClassification
|
2019-12-11 15:31:45 +01:00 |
|
|
LysandreJik
|
4c12860f7a
|
Remove misleading documentation
|
2019-12-11 09:22:37 -05:00 |
|
|
Morgan Funtowicz
|
b040bff6df
|
Added supported model to AutoModelTokenClassification
|
2019-12-11 14:13:58 +01:00 |
|
|
thomwolf
|
fafd4c86ec
|
fix TF 2.0 version of T5 - update conversion script
|
2019-12-11 13:47:27 +01:00 |
|
|
Morgan Funtowicz
|
9a24e0cf76
|
Refactored qa pipeline argument handling + unittests
|
2019-12-11 00:33:25 +01:00 |
|
|
Thomas Wolf
|
51ae203290
|
Merge pull request #2129 from leopd/master
Progress indicator improvements when downloading pre-trained models.
|
2019-12-10 22:18:55 +01:00 |
|
|
Leo Dirac
|
58d75aa310
|
Progress indicator improvements when downloading pre-trained models.
|
2019-12-10 11:36:56 -08:00 |
|
|
LysandreJik
|
6a73382706
|
Complete warning + cleanup
|
2019-12-10 14:33:24 -05:00 |
|
|
Lysandre
|
dc4e9e5cb3
|
DataParallel for SQuAD + fix XLM
|
2019-12-10 19:21:20 +00:00 |
|
|
thomwolf
|
67a8be8e90
|
fix backward in tests
|
2019-12-10 17:50:32 +01:00 |
|
|
Morgan Funtowicz
|
63e36007ee
|
Make sure padding, cls and another non-context tokens cannot appear in the answer.
|
2019-12-10 16:47:35 +01:00 |
|
|
thomwolf
|
f2538c1274
|
all tests in torch no grad
|
2019-12-10 16:33:11 +01:00 |
|
|
thomwolf
|
a5df980c5b
|
updating distilbert test
|
2019-12-10 16:01:15 +01:00 |
|
|
Morgan Funtowicz
|
40a39ab650
|
Reuse recent SQuAD refactored data structure inside QA pipelines.
|
2019-12-10 15:59:38 +01:00 |
|
|
thomwolf
|
7c3a15ace9
|
Merge branch 'master' into t5
|
2019-12-10 15:36:54 +01:00 |
|
|
thomwolf
|
981a5c8c17
|
updating models urls
|
2019-12-10 15:36:19 +01:00 |
|
|
Thomas Wolf
|
e6cff60b4c
|
Merge pull request #2069 from huggingface/cleaner-pt-tf-conversion
clean up PT <=> TF conversion
|
2019-12-10 15:34:08 +01:00 |
|
|
Rémi Louf
|
4b82c485de
|
remove misplaced summarization documentation
|
2019-12-10 09:13:33 -05:00 |
|
|
thomwolf
|
8ae1044f80
|
updating tests and TF 2.0 model
|
2019-12-10 15:11:07 +01:00 |
|
|
Morgan Funtowicz
|
aae74065df
|
Added QuestionAnsweringPipeline unit tests.
|
2019-12-10 13:37:20 +01:00 |
|
|
Morgan Funtowicz
|
a7d3794a29
|
Remove token_type_ids for compatibility with DistilBert
|
2019-12-10 13:37:20 +01:00 |
|
|
Morgan Funtowicz
|
fe0f552e00
|
Use attention_mask everywhere.
|
2019-12-10 13:37:20 +01:00 |
|
|
Morgan Funtowicz
|
348e19aa21
|
Expose attention_masks and input_lengths arguments to batch_encode_plus
|
2019-12-10 13:37:18 +01:00 |
|
|
Morgan Funtowicz
|
c2407fdd88
|
Enable the Tensorflow backend.
|
2019-12-10 13:37:14 +01:00 |
|
|
Morgan Funtowicz
|
f116cf599c
|
Allow hidding frameworks through environment variables (NO_TF, NO_TORCH).
|
2019-12-10 13:37:07 +01:00 |
|
|
Morgan Funtowicz
|
6e61e06051
|
batch_encode_plus generates the encoder_attention_mask to avoid attending over padded values.
|
2019-12-10 13:37:07 +01:00 |
|
|
Morgan Funtowicz
|
02110485b0
|
Added batching, topk, chars index and scores.
|
2019-12-10 13:36:55 +01:00 |
|
|
Morgan Funtowicz
|
e1d89cb24d
|
Added QuestionAnsweringPipeline with batch support.
|
2019-12-10 13:36:55 +01:00 |
|
|
thomwolf
|
0558c9cb9b
|
Merge branch 'master' into t5
|
2019-12-10 12:58:48 +01:00 |
|
|
Morgan Funtowicz
|
81babb227e
|
Added download command through the cli.
It allows to predownload models and tokenizers.
|
2019-12-10 12:18:59 +01:00 |
|
|
thomwolf
|
31a3a73ee3
|
updating CLI
|
2019-12-10 12:18:59 +01:00 |
|
|
thomwolf
|
7c1697562a
|
compatibility with sklearn and keras
|
2019-12-10 12:12:22 +01:00 |
|
|
thomwolf
|
b81ab431f2
|
updating AutoModels and AutoConfiguration - adding pipelines
|
2019-12-10 12:11:33 +01:00 |
|