c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,560 Commits 171 Branches 49 Tags
df5bf64bb2585e01a89bc2a34ba422c62a1ee56b
Commit Graph
4560 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mariama Drame df5bf64bb2 update small model tokenizer 2020-07-16 16:54:21 +02:00
Sam Shleifer fb1f0b4209 Merge branch 'master' into blenderbot 2020-07-14 06:14:05 -04:00
Sam Shleifer b2505f7db7 Cleanup bart caching logic (#5640) 2020-07-14 06:13:05 -04:00
Sam Shleifer 838950ee44 [fix] mbart_en_ro_generate test now identical to fairseq (#5731) 2020-07-14 06:12:24 -04:00
Boris DaymaandJulien Chaumond 4d5a8d6557 docs(wandb): explain how to use W&B integration (#5607) 
* docs(wandb): explain how to use W&B integration

fix #5262

* Also mention TensorBoard

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-07-14 05:12:33 -04:00
Gunnlaugur Thor Briem cd30f98fd2 doc: fix apparent copy-paste error in docstring (#5626) 2020-07-14 09:47:41 +02:00
as-stevensandPatrick von Platen f867000f56 [Reformer classification head] Implement the reformer model classification head for text classification (#5198) 
* Reformer model head classification implementation for text classification

* Reformat the reformer model classification code

* PR review comments, and test case implementation for reformer for classification head changes

* CI/CD reformer for classification head test import error fix

* CI/CD test case implementation  added ReformerForSequenceClassification to all_model_classes

* Code formatting- fixed

* Normal test cases added for reformer classification head

* Fix test cases implementation for the reformer classification head

* removed token_type_id parameter from the reformer classification head

* fixed the test case for reformer classification head

* merge conflict with master fixed

* merge conflict, changed reformer classification to accept the choice_label parameter added in latest code

* refactored the the reformer classification head test code

* reformer classification head, common transform test cases fixed

* final set of the review comment, rearranging the reformer classes and docstring add to classification forward method

* fixed the compilation error and text case fix for reformer classification head

* Apply suggestions from code review

Remove unnecessary dup

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2020-07-14 09:16:22 +02:00
Gaurav Mishra f0bda06f43 Update tokenization_t5.py (#5717) 
Minor doc fix.
 2020-07-14 00:02:03 -04:00
Sam Shleifer c3c61ea017 [Fix] github actions CI by reverting #5138 (#5686) 2020-07-13 17:12:18 -04:00
Stas Bekman 45addfe96d FlaubertForTokenClassification (#5644) 
* implement FlaubertForTokenClassification as a subclass of XLMForTokenClassification

* fix mapping order

* add the doc

* add common tests
 2020-07-13 14:59:53 -04:00
Sam Shleifer e50807900f add failing slow tests 2020-07-13 12:46:34 -04:00
Sam Shleifer 07e1a3b0e6 Simplify config 2020-07-13 12:10:11 -04:00
Sam Shleifer 6a6527e702 Merge branch 'master' into blenderbot 2020-07-13 11:57:21 -04:00
Sam Shleifer 79e6c39d29 Fix tok 2020-07-13 11:40:30 -04:00
Patrick von Platen 7096e47513 [Longformer] fix longformer global attention output (#5659) 
* fix longformer global attention output

* fix multi gpu problem

* replace -10000 with 0

* better comment

* make attention output equal local and global

* Update src/transformers/modeling_longformer.py
 2020-07-13 17:23:22 +02:00
Sam Shleifer 08d3f716bd remove bad imports 2020-07-13 10:24:40 -04:00
Sam Shleifer 3e933766c9 Fix is_valid_mbart 2020-07-13 10:20:50 -04:00
Sylvain GuggerandSam Shleifer ce374ba877 Fix Trainer in DataParallel setting (#5685) 
* Fix Trainer in DataParallel setting

* Fix typo

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
 2020-07-13 08:37:38 -04:00
Mariama Drame 724dc87981 add tokenizer test 2020-07-13 13:24:36 +02:00
Stas Bekman 0a19a49dfe doc improvements (#5688) 2020-07-13 18:10:17 +08:00
Stas Bekman 443b0cad96 rename the function to match the rest of the test convention (#5692) 2020-07-13 18:09:49 +08:00
onepointconsulting 74843695eb Added first description of the model (#5672) 
Added general description, information about the tags and also some example usage code.
 2020-07-13 02:53:48 -04:00
Sam Shleifer 84dc65ea09 fix mbart 2020-07-12 23:21:15 -04:00
Sam Shleifer 9d7908939e Working 90m model 2020-07-12 23:06:20 -04:00
Sam Shleifer 08e630e1be passing 2020-07-12 23:05:31 -04:00
Sam Shleifer bb988e901d Merge branch 'master' into blenderbot 2020-07-12 22:58:19 -04:00
Kevin Canwen Xu 0befb51327 Pipeline model type check (#5679) 
* Add model type check for pipelines

* Add model type check for pipelines

* rename func

* Fix the init parameters

* Fix format

* rollback unnecessary refactor
 2020-07-12 12:34:21 +08:00
Kevin Canwen Xu dc31a72f50 Add Microsoft's CodeBERT (#5683) 
* Add Microsoft's CodeBERT

* link style

* single modal

* unused import
 2020-07-11 21:37:30 +08:00
Sam Shleifer b77daa402d merged sylvain change 2020-07-11 01:54:56 -04:00
Sam Shleifer f8cb16c541 Merge branch 'master' into blenderbot 2020-07-11 01:42:55 -04:00
Sylvain GuggerandLysandre Debut 7fad617dc1 Document model outputs (#5673) 
* Document model outputs

* Update docs/source/main_classes/output.rst

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-07-10 17:31:02 -04:00
Sylvain Gugger df983b7483 Deprecate old past arguments (#5671) 2020-07-10 17:25:52 -04:00
Tomo Lazovich cdf4cd7068 [squad] add version tag to squad cache (#5669) 2020-07-10 16:34:21 -04:00
Patrick von Platen 223084e42b Add Reformer to notebooks 2020-07-10 18:34:25 +02:00
Julien ChaumondSuraj PatilSylvain Gugger
 		201d23f285 Update The Big Table of Tasks 
Co-Authored-By: Suraj Patil <surajp815@gmail.com>
Co-Authored-By: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2020-07-10 18:07:29 +02:00
Bashar Talafha 82f7bbbd93 Update README.md (#5617) 
* Update README.md

* Update README.md
 2020-07-10 11:43:27 -04:00
Manuel Romero bf497376ee Create README.md (#5572) 2020-07-10 11:42:49 -04:00
kolk 3653d01f2a Create README.md for electra-base-squad2 (#5574) 2020-07-10 11:39:44 -04:00
Sam Shleifer 6367bf8d99 Update integration tests 2020-07-10 11:39:19 -04:00
Txus aa69c81f29 Add freshly trained base version (#5621) 2020-07-10 11:39:04 -04:00
Teven 227e0a406d Fixed use of memories in XLNet (caching for language generation + warning when loading improper memoryless model) (#5632) 
* Pytorch gpu => cpu proper device

* Memoryless XLNet warning + fixed memories during generation

* Revert "Pytorch gpu => cpu proper device"

This reverts commit 93489b36

* made black happy

* TF generation with memories

* dim => axis

* added padding_text to TF XL models

* Added comment, added TF
 2020-07-10 17:38:36 +02:00
Manuel Romero 3b7b646563 Create README.md (#5638) 2020-07-10 11:38:23 -04:00
Manuel Romero 0039b965db Create model card (#5655) 
Create model card for T5-small fine-tuned on SQUAD v2
 2020-07-10 11:38:11 -04:00
Nils Reimers 46982d612f Create README.md - Model card (#5657) 
Model card for sentence-transformers/bert-base-nli-cls-token
 2020-07-10 11:38:03 -04:00
Nils Reimers c483803d1b Create README.md - Model card (#5658) 
Model card for sentence-transformers/bert-base-nli-max-tokens
 2020-07-10 11:37:56 -04:00
Sylvain Gugger edfd82f5ff Change model outputs types to self-document outputs (#5438) 
* [WIP] Proposal for model outputs

* All Bert models

* Make CI green maybe?

* Fix ONNX test

* Isolate ModelOutput from pt and tf

* Formatting

* Add Electra models

* Auto-generate docstrings from outputs

* Add TF outputs

* Add some BERT models

* Revert TF side

* Remove last traces of TF changes

* Fail with a clear error message

* Add Albert and work through Bart

* Add CTRL and DistilBert

* Formatting

* Progress on Bart

* Renames and finish Bart

* Formatting

* Fix last test

* Add DPR

* Finish Electra and add FlauBERT

* Add GPT2

* Add Longformer

* Add MMBT

* Add MobileBert

* Add GPT

* Formatting

* Add Reformer

* Add Roberta

* Add T5

* Add Transformer XL

* Fix test

* Add XLM + fix XLMForTokenClassification

* Style + XLMRoberta

* Add XLNet

* Formatting

* Add doc of return_tuple arg
 2020-07-10 11:36:53 -04:00
Suraj Parmar fa265230a2 Create Model card for RoBERTa-hindi-guj-san (#5661) 2020-07-10 11:34:23 -04:00
Sylvain Gugger b2747af543 Improvements to PretrainedConfig documentation (#5642) 
* Update PretrainedConfig doc

* Formatting

* Small fixes

* Forgotten args and more cleanup
 2020-07-10 10:31:47 -04:00
Mariama Drame 1fbf338417 test blenderbot small tokenizer 2020-07-10 15:13:03 +02:00
Mariama Drame 7a5a9d9018 Merge remote-tracking branch 'origin/master' into blenderbot 2020-07-10 14:20:29 +02:00