c-my/transformers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,071 Commits 171 Branches 49 Tags
a75e31981915cbd072be7c4050a4b58c63ca6d33
Commit Graph
5071 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yih-Dar a75e319819 Fix mixed precision issue in TF DistilBert (#6915) 
* Remove hard-coded uses of float32 to fix mixed precision use in TF Distilbert

* fix style

* fix gelu dtype issue in TF Distilbert

* fix numeric overflow while using half precision
 2020-09-04 14:29:57 +02:00
Sam Shleifer e95d262f25 [s2s] support early stopping based on loss, rather than rouge (#6927) 2020-09-03 17:31:35 -04:00
Sam Shleifer 207ed8cb78 [s2s] use --eval_beams command line arg (#6926) 2020-09-03 12:42:09 -04:00
krfricke 0f360d3d1c move wandb/comet logger init to train() to allow parallel logging (#6850) 
* move wandb/comet logger init to train() to allow parallel logging

* Setup wandb/comet loggers on first call to log()
 2020-09-03 11:49:14 -04:00
Sam Shleifer 39ed68d597 [s2s] allow task_specific_params=summarization_xsum (#6923) 2020-09-03 11:11:40 -04:00
Sam ShleiferandSylvain Gugger 5a318f075a [s2s]: script to convert pl checkpoints to hf checkpoints (#6911) 
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2020-09-03 09:47:00 -04:00
brett koonce b8e4906c97 tweak tar command in readme (#6919) 2020-09-03 09:29:01 -04:00
Stefan Engl a66db7d828 Corrected link to paper (#6905) 2020-09-03 09:23:42 -04:00
David Mark Nemeskey 55d61ce8d6 Added a link to the thesis. (#6906) 2020-09-03 09:20:03 -04:00
abdullaholuk-loodosandAbdullah Oluk 653a79ccad Loodos model cards had errors on "Usage" section. It is fixed. Also "electra-base-turkish-uncased" model removed from s3 and re-uploaded as "electra-base-turkish-uncased-discriminator". Its README added. (#6921) 
Co-authored-by: Abdullah Oluk <abdullaholuk123@gmail.com>
 2020-09-03 09:13:43 -04:00
Julien Chaumond 5a3aec90a9 [model_card] link to correctly cased piaf dataset 
cc @psorianom @rachelker
 2020-09-03 08:57:32 -04:00
Sylvain Gugger 722b5807d8 Template updates (#6914) 2020-09-03 04:14:58 -04:00
Antonio V MendozaLysandre DebutSylvain GuggerLysandre
 		ea2c6f1afc Adding the LXMERT pretraining model (MultiModal languageXvision) to HuggingFace's suite of models (#5793) 
* added template files for LXMERT and competed the configuration_lxmert.py

* added modeling, tokization, testing, and finishing touched for lxmert [yet to be tested]

* added model card for lxmert

* cleaning up lxmert code

* Update src/transformers/modeling_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* tested torch lxmert, changed documtention, updated outputs, and other small fixes

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* renaming, other small issues, did not change TF code in this commit

* added lxmert question answering model in pytorch

* added capability to edit number of qa labels for lxmert

* made answer optional for lxmert question answering

* add option to return hidden_states for lxmert

* changed default qa labels for lxmert

* changed config archive path

* squshing 3 commits: merged UI + testing improvments + more UI and testing

* changed some variable names for lxmert

* TF LXMERT

* Various fixes to LXMERT

* Final touches to LXMERT

* AutoTokenizer order

* Add LXMERT to index.rst and README.md

* Merge commit test fixes + Style update

* TensorFlow 2.3.0 sequential model changes variable names

Remove inherited test

* Update src/transformers/modeling_tf_pytorch_utils.py

* Update docs/source/model_doc/lxmert.rst

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/model_doc/lxmert.rst

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* added suggestions

* Fixes

* Final fixes for TF model

* Fix docs

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2020-09-03 04:02:25 -04:00
Puneetha Pai 4ebb52afdb test_tf_common: remove un_used mixin class parameters (#6866) 2020-09-02 10:54:40 -04:00
Stas Bekman e71f32c0ef [testing] fix ambiguous test (#6898) 
Since `generate()` does:
```
        num_beams = num_beams if num_beams is not None else self.config.num_beams
```
This test fails if `model.config.num_beams > 1` (which is the case in the model I'm porting).

This fix makes the test setup unambiguous by passing an explicit `num_beams=1` to `generate()`.

Thanks.
 2020-09-02 16:18:17 +02:00
Sylvain Gugger 8f2723caf0 Output attention takes an s (#6903) 
* Fix output_attention -> output_attentions

* Formatting

* One unsaved file
 2020-09-02 08:11:45 -04:00
Yohei Tamura 485da7222f fix error class instantiation (#6634) 2020-09-02 07:36:32 -04:00
Suraj Patil 4230d30f77 [pipelines] Text2TextGenerationPipeline (#6744) 
* add Text2TextGenerationPipeline

* remove max length warning

* remove comments

* remove input_length

* fix typo

* add tests

* use TFAutoModelForSeq2SeqLM

* doc

* typo

* add the doc below TextGenerationPipeline

* doc nit

* style

* delete comment
 2020-09-02 07:34:35 -04:00
Prajjwal Bhargava 6b24281229 fix typo in comments (#6838) 2020-09-02 06:55:37 -04:00
Stas Bekman 7351ef83c1 [doc] typos (#6867) 
* [doc] typos

fixed typos

* Update README.md
 2020-09-02 06:51:51 -04:00
Harry Wang ee1bff06f8 minor docs grammar fixes (#6889) 2020-09-02 06:45:19 -04:00
Patrick von Platen 8abd7f69fc fix warning for position ids (#6884) 2020-09-02 06:44:51 -04:00
Parthe Pandit 7cb0572c64 Update modeling_bert.py (#6897) 
outptus -> outputs in example of BertForPreTraining
 2020-09-02 06:39:01 -04:00
David Mark NemeskeyandJulien Chaumond e3c55ceb8d Model card for huBERT (#6893) 
* Create README.md

Model card for huBERT.

* Update README.md

lowercase h

* Update model_cards/SZTAKI-HLT/hubert-base-cc/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-09-02 04:50:10 -04:00
Patrick von Platen 1889e96c8c fix QA example for PT (#6890) 2020-09-02 09:53:09 +02:00
Julien Chaumond d822ab636b [model_cards] Fix file path for flexudy/t5-base-multi-sentence-doctor 2020-09-02 00:02:40 +02:00
Rohan Rajpal ad5fb33c9a Create README.md (#6598) 2020-09-01 17:59:15 -04:00
Rohan Rajpal f9dadcd85b Create README.md (#6602) 2020-09-01 17:58:43 -04:00
Igli Manaj f5d69c75f7 Update multilingual passage rereanking model card (#6788) 
Fix range of possible score, add inference .
 2020-09-01 17:56:19 -04:00
Tom Grek 5d820f3ca6 Model card for primer/BART-Squad2 (#6801) 2020-09-01 17:52:32 -04:00
zolekodeandzolekode 8b884dadc6 added model card for flexudys t5 model (#6759) 
Co-authored-by: zolekode <pascal.zoleko@fau.de>
 2020-09-01 17:38:55 -04:00
hakan bff6d517cd loodos turkish model cards added (#6840) 2020-09-01 17:35:24 -04:00
Manuel Romero 502d194b95 Create README.md (#6887) 
Add language meta attribute
 2020-09-01 17:09:10 -04:00
Manuel Romero d082edf216 Create README.md (#6888) 
Add language meta attribute
 2020-09-01 17:09:02 -04:00
Abed khooliandJulien Chaumond dacbee9a50 Create README.md (#6886) 
* Create README.md

model card for  akhooli/xlm-r-large-arabic-sent

* Update model_cards/akhooli/xlm-r-large-arabic-sent/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-09-01 17:06:15 -04:00
Abed khooli e2971e61bd Create README.md (#6885) 2020-09-01 16:57:48 -04:00
Patrick von Platen 4d1a3ffde8 [EncoderDecoder] Add xlm-roberta to encoder decoder (#6878) 
* finish xlm-roberta

* finish docs

* expose XLMRobertaForCausalLM
 2020-09-01 21:56:39 +02:00
Patrick von Platen 311992630c Create README.md (#6883) 
* Create README.md

* Update README.md
 2020-09-01 19:24:45 +02:00
Jin Young (Daniel) Sohn 21d719238c Add cache_dir to save features TextDataset (#6879) 
* Add cache_dir to save features TextDataset

This is in case the dataset is in a RO filesystem, for which is the case
in tests (GKE TPU tests).

* style
 2020-09-01 11:42:17 -04:00
Lysandre Debut 1461aac8d7 Update docs stable version 2020-09-01 11:02:24 -04:00
Lysandre 3726754a6c v3.1.0 documentation 2020-09-01 14:39:07 +02:00
Lysandre 4b3ee9cbc5 Release: v3.1.0 v3.1.0 2020-09-01 14:27:52 +02:00
Patrick von Platen afc4ece462 [Generate] Facilitate PyTorch generate using ModelOutputs (#6735) 
* fix generate for GPT2 Double Head

* fix gpt2 double head model

* fix  bart / t5

* also add for no beam search

* fix no beam search

* fix encoder decoder

* simplify t5

* simplify t5

* fix t5 tests

* fix BART

* fix transfo-xl

* fix conflict

* integrating sylvains and sams comments

* fix tf past_decoder_key_values

* fix enc dec test
 2020-09-01 12:38:25 +02:00
Funtowicz Morgan 397f819615 Restore PaddingStrategy.MAX_LENGTH on QAPipeline while no v2. (#6875) 
Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>
 2020-09-01 05:35:35 -04:00
Sam Shleifer a32d85f0d4 delete reinit (#6862) 2020-09-01 03:43:27 -04:00
Sylvain GuggerandLysandre Debut d5f1ffa0d8 Logging doc (#6852) 
* Add logging doc

* Foamtting

* Update docs/source/main_classes/logging.rst

* Update src/transformers/utils/logging.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-01 03:16:34 -04:00
Stas Bekman 59a6a32a61 add a final report to all pytest jobs (#6861) 
we had it added for one job, please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!
 2020-08-31 22:47:23 -04:00
Sam Shleifer 431ab19d7a [fix] typo in available in helper function (#6859) 2020-08-31 17:59:34 -04:00
Sam Shleifer 367235ee52 Bart can make decoder_input_ids from labels (#6758) 2020-08-31 16:16:47 -04:00
Sam Shleifer b9772897ec [s2s] command line args for faster val steps (#6833) 2020-08-31 16:16:10 -04:00