Commit Graph
6 Commits
Author SHA1 Message Date
Thomas Wolf 601d4d699c [tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
* remove references to old API in docstring - update data processors

* style

* fix tests - better type checking error messages

* better type checking

* include awesome fix by @LysandreJik for #5310

* updated doc and examples
2020-06-26 19:48:14 +02:00
Julien Chaumond d4c2cb402d Kill model archive maps (#4636)
* Kill model archive maps

* Fixup

* Also kill model_archive_map for MaskedBertPreTrainedModel

* Unhook config_archive_map

* Tokenizers: align with model id changes

* make style && make quality

* Fix CI
2020-06-02 09:39:33 -04:00
Victor SANH 9d7d9b3ae0 weird import 2020-06-01 09:23:31 -04:00
Victor SANH cc746a5020 flake8 compliance 2020-06-01 09:23:31 -04:00
Victor SANH 5c8e5b3709 commplying with isort 2020-06-01 09:23:31 -04:00
Victor SANH e4c07faf0a add sparsity modules 2020-06-01 09:23:31 -04:00