Ahmed Elnaggar and Ahmed Elnaggar
a9c8bff724
Add parallelization support for T5EncoderModel ( #9082 )
...
* add model parallelism to T5EncoderModel
add model parallelism to T5EncoderModel
* remove decoder from T5EncoderModel parallelize
* uodate T5EncoderModel docs
* Extend T5ModelTest for T5EncoderModel
* fix T5Stask using range for get_device_map
* fix style
Co-authored-by: Ahmed Elnaggar <elnaggar@rostlab.informatik.tu-muenchen.de >
2020-12-14 12:00:45 -05:00
40ecaf0c2b
Add T5 Encoder for Feature Extraction ( #8717 )
...
* Add T5 Encoder class for feature extraction
* fix T5 encoder add_start_docstrings indent
* update init with T5 encoder
* update init with TFT5ModelEncoder
* remove TFT5ModelEncoder
* change T5ModelEncoder order in init
* add T5ModelEncoder to transformers init
* clean T5ModelEncoder
* update init with TFT5ModelEncoder
* add TFModelEncoder for Tensorflow
* update init with TFT5ModelEncoder
* Update src/transformers/models/t5/modeling_t5.py
change output from Seq2SeqModelOutput to BaseModelOutput
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* remove encoder_outputs
1. remove encoder_outputs from the function call.
2. remove the encoder_outputs If statement.
3. remove isinstance from return_dict.
* Authorize missing decoder keys
* remove unnecessary input parameters
remove pask_key_values and use_cache
* remove use_cache
remove use_cache from the forward method
* add doctoring for T5 encoder
add doctoring for T5 encoder with T5_ENCODER_INPUTS_DOCSTRING
* change return_dict to dot access
* add T5_ENCODER_INPUTS_DOCSTRING for TF T5
* change TFT5Encoder output type to BaseModelOutput
* remove unnecessary parameters for TFT5Encoder
* remove unnecessary if statement
* add import BaseModelOutput
* fix BaseModelOutput typo to TFBaseModelOutput
* update T5 doc with T5ModelEncoder
* add T5ModelEncoder to tests
* finish pytorch
* finish docs and mt5
* add mtf to init
* fix init
* remove n_positions
* finish PR
* Update src/transformers/models/mt5/modeling_mt5.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
* Update src/transformers/models/t5/modeling_t5.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
* Update src/transformers/models/t5/modeling_tf_t5.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
* Update src/transformers/models/mt5/modeling_tf_mt5.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
* make style
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
2020-11-30 08:34:40 +01:00
Ahmed Elnaggar
aa6c3c14b4
typo fix ( #7611 )
...
It should be T5-3B not T5-3M.
2020-10-06 15:32:52 +02:00
Ahmed Elnaggar and Patrick von Platen
66c72082d0
Add ProtT5-XL-BFD model card ( #7606 )
...
* Add ProtT5-XL-BFD model card
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2020-10-06 12:19:21 +02:00
Ahmed Elnaggar
930153e7d2
Add ProtBert model card ( #6764 )
2020-08-28 12:12:28 +08:00
Ahmed Elnaggar
05e7150a53
create ProtBert-BFD model card. ( #6724 )
2020-08-27 02:19:19 +02:00
