c-my/transformers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,663 Commits 171 Branches 49 Tags
5e97c82940a51ee95324b23f66b66692fa419182
Commit Graph
4663 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Manuel Romero 5e97c82940 Create README.md (#6076) 2020-07-28 09:36:00 -04:00
Clement 54f49af4ae Add inference widget examples (#5825) 2020-07-28 09:14:00 -04:00
Sylvain Gugger 0206efb4cf Make all data collators accept dict (#6065) 
* Make all data collators accept dict

* Style
 2020-07-28 09:08:20 -04:00
Sam ShleiferJulien ChaumondSylvain GuggerLysandre DebutTeven
 		31a5486e42 github issue template suggests who to tag (#5790) 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Teven <teven.lescao@gmail.com>
 2020-07-28 08:41:27 -04:00
Stas Bekman f0c70085c2 link to README.md (#6068) 
* add a link to README.md

* Update README.md
 2020-07-28 20:34:58 +08:00
Pavel Soriano 4f814fd587 [Model Card] camembert-base-squadFR-fquad-piaf (#6087) 2020-07-28 20:33:52 +08:00
Sam Shleifer 3c7fbf35a6 MBART: support summarization tasks where max_src_len > max_tgt_len (#6003) 
* MBART: support summarization tasks

* fix test

* Style

* add tokenizer test
 2020-07-28 08:18:11 -04:00
Tanmay Thakur 842eb45606 New Community NB Add (#5824) 
Signed-off-by: lordtt13 <thakurtanmay72@yahoo.com>
 2020-07-28 04:25:12 -04:00
Andrés Felipe CruzandLysandre Debut 018d61fa24 Moving transformers package import statements to relative imports in some files (#5796) 
* Moving rom transformers statements to relative imports in some files under src/

* Import order

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-07-28 04:19:17 -04:00
Lysandre Debut 7214954db4 Should return a tuple for serialization (#6061) 2020-07-28 03:14:31 -04:00
Sam Shleifer 7a68d40138 [s2s] Don't mention packed data in README (#6079) 2020-07-27 20:07:21 -04:00
Sam Shleifer b7345d22d0 [fix] no warning for position_ids buffer (#6063) 2020-07-27 20:00:44 -04:00
Sam Shleifer 1e00ef681d [s2s] dont document packing because it hurts performance (#6077) 2020-07-27 18:26:00 -04:00
sgugger 9d0d3a6645 Pin TF while we wait for a fix 2020-07-27 18:03:09 -04:00
Ramsri Goutham Golla 769e6ba01f Create README.md (#6032) 
Adding model card - readme
 2020-07-27 16:25:37 -04:00
Sylvain Gugger fd347e0da7 Add fire to setup.cfg to make isort happy (#6066) 2020-07-27 15:17:33 -04:00
Sam Shleifer 11792d7826 CL util to convert models to fp16 before upload (#5953) 2020-07-27 12:21:25 -04:00
Sam Shleifer 4302ace5bd [pack_dataset] don't sort before packing, only pack train (#5954) 2020-07-27 12:14:23 -04:00
Suraj Patil c8bdf7f4ec Add new AutoModel classes in pipeline (#6062) 
* use new AutoModel classed

* make style and quality
 2020-07-27 11:50:08 -04:00
Cola 5779e5434d ✏️ Fix typo (#5734) 2020-07-27 10:55:15 -04:00
Suraj Patil d1d15d6f2d [examples (seq2seq)] fix preparing decoder_input_ids for T5 (#5994) 2020-07-27 10:10:43 -04:00
Joe Davison 3deffc1d67 Zero shot classification pipeline (#5760) 
* add initial zero-shot pipeline

* change default args

* update default template

* add label string splitting

* add str labels support, remove nli from name

* style

* add input validation and working tf defaults

* tests

* quality check

* add docstring to __call__

* add slow tests

* Change truncation to only_first

also lower precision on tests for readibility

* style
 2020-07-27 09:42:58 -04:00
Sylvain Gugger 1246b20f6d Fix the return documentation rendering for all model outputs (#6022) 
* Fix the return documentation rendering for all model outputs

* Formatting
 2020-07-27 09:18:59 -04:00
Sylvain Gugger 3b64ad5d5c Remove unused file (#6023) 2020-07-27 08:31:24 -04:00
Xin Wen b9b11795cf Update model_summary.rst (#5737) 
Add '-' to make the reference of Transformer-XL more accurate and formal.
 2020-07-27 05:34:02 -04:00
Gong Linyuan b21993b362 Allow to set Adam beta1, beta2 in TrainingArgs (#5592) 
* Add Adam beta1, beta2 to trainier

* Make style consistent
 2020-07-27 05:31:37 -04:00
Pavel Soriano 7969e96f4a draft etalab QA model (#6040) 2020-07-27 05:15:08 -04:00
Vamsi995andJulien Chaumond a9585fd107 Model card for Vamsi/T5_Paraphrase_Paws (#6037) 
* Model card for Vamsi/T5_Paraphrase_Paws

* Update model_cards/Vamsi/T5_Paraphrase_Paws/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-27 05:12:45 -04:00
Rodolfo De Nadai f7f03b22dc Update README.md of my model (#6042) 2020-07-26 23:31:49 +02:00
Stas Bekman fb0589a03d don't complain about missing W&B when WANDB_DISABLED=true (#6036) 
* don't complain about missing W&B when WANDB_DISABLED=true

* reformat to elif

* typo
 2020-07-26 14:29:54 -04:00
Stas Bekman daa5dd1202 add a summary report flag for run_examples on CI (#6035) 
Currently, it's hard to derive which example tests were run on CI, and which weren't. Adding `-rA` flag to `pytest`, will now include a summary like:

```
==================================================================== short test summary info =====================================================================
PASSED examples/test_examples.py::ExamplesTests::test_generation
PASSED examples/test_examples.py::ExamplesTests::test_run_glue
PASSED examples/test_examples.py::ExamplesTests::test_run_language_modeling
PASSED examples/test_examples.py::ExamplesTests::test_run_squad
FAILED examples/test_examples.py::ExamplesTests::test_run_pl_glue - AttributeError: 'Namespace' object has no attribute 'gpus'
============================================================ 1 failed, 4 passed, 8 warnings in 42.96s ============================================================
```
which makes it easier to validate whether some example is being covered by CI or not.
 2020-07-26 14:09:14 -04:00
Sam Shleifer c69ea5efc4 [CI] Don't test apex (#6021) 2020-07-24 15:34:16 -04:00
Sylvain Gugger a884b7fa38 Update the new model template (#6019) 2020-07-24 14:15:37 -04:00
Julien Chaumond 295466aae6 [model_card] Sample input for rdenadai/BR_BERTo 
cc @rdenadai
 2020-07-24 14:14:10 -04:00
Manuel RomeroandJulien Chaumond 518361d69a Create model card for RuPERTa-base (#6016) 
* Update README.md

* Update model_cards/mrm8488/RuPERTa-base/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-24 14:12:29 -04:00
Manuel Romero bd51f0a7ab Create README.md (#5952) 2020-07-24 14:12:14 -04:00
Manuel Romero 87a779dfa8 Create README.md (#5951) 2020-07-24 14:12:09 -04:00
Rodolfo De NadaiandJulien Chaumond d115872b38 Create README.md (#6020) 
* Create README.md

* Update README.md

* Update model_cards/rdenadai/BR_BERTo/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Update model_cards/rdenadai/BR_BERTo/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-24 14:11:14 -04:00
Sylvain Gugger 3996041d0a Fix question template (#6014) 2020-07-24 10:04:25 -04:00
Victor SANHandJulien Chaumond 778e635fc9 [model_cards] roberta-base-finetuned-yelp-polarity (#6009) 
* [model_cards] roberta-base-finetuned-yelp-polarity

* Update model_cards/VictorSanh/roberta-base-finetuned-yelp-polarity/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-24 09:45:21 -04:00
Funtowicz Morgan 614fef1691 Ensure OpenAI GPT position_ids is correctly initialized and registered at init. (#5773) 
* Ensure OpenAI GPT position_ids is correctly initialized and registered as buffer at init.

This will make it compatible with TorchScript export.

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix missing slice operator on the tensor data accessor.

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Style.

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fixed BertEmbedding position_ids buffer created at forward.

Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>

* Fixed MobileBertEmbedding position_ids buffer created at forward.

Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>

* Fixed XLM position_ids buffer created at forward.

Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>
 2020-07-24 15:37:52 +02:00
Sylvain Gugger 3b44aa935a Model utils doc (#6005) 
* Document TF modeling utils

* Document all model utils
 2020-07-24 09:16:28 -04:00
sgugger a540405213 Fix commit hash for stable doc 2020-07-24 09:07:40 -04:00
Qingqing Cao fc0fe2a532 fix: model card readme clutter (#6008) 
this removes the clutter line in the readme.md of model card `csarron/roberta-base-squad-v1`. It also fixes the result table.
 2020-07-24 04:17:52 -04:00
Sylvain Gugger f5b5c5bd7e Avoid unnecessary warnings when loading pretrained model (#5922) 
* Avoid unnecessary warnings when loading pretrained model

* Fix test

* Add other keys to ignore

* keys_to_ignore_at_load -> authorized_missing_keys
 2020-07-23 18:13:36 -04:00
Philip May 29afb5764f Bert german dbmdz uncased sentence stsb (#6000) 
* Describe usage of sentence model

* fix typo usage

* add use and description to readme

* fix typo in readme

* readme formatting

* add training procedure to readme

* description name and company

* readme formatting

* dataset training readme

* typo

* readme
 2020-07-23 17:56:45 -04:00
Qingqing Cao 2b5ef9706d Model cards: add roberta-base-squad-v1 and bert-base-uncased-squad-v1 (#6006) 
* add: bert-base-uncased-squad-v1

* add: roberta-base-squad-v1
 2020-07-23 17:53:47 -04:00
Sam Shleifer 9827d666eb MbartTokenizer: do not hardcode vocab size (#5998) 2020-07-23 15:41:14 -04:00
Sylvain Gugger 6e16195510 Fix #5974 (#5999) 2020-07-23 13:51:29 -04:00
Sylvain Gugger e168488a74 Cleanup Trainer and expose customization points (#5982) 
* Clean up Trainer and expose customization points

* Formatting

* eval_step -> prediction_step
 2020-07-23 12:05:41 -04:00