c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,159 Commits 171 Branches 49 Tags
513ba3b6a019645d306d83ade7cbcfb368fa2dd5
Commit Graph
82 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sam Shleifer f90bc44d9a [examples] Cleanup summarization docs (#4876) 2020-06-09 17:38:28 -04:00
Sam Shleifer a139d1a160 [cleanup] consolidate some prune_heads logic (#4799) 2020-06-08 17:08:04 -04:00
Sam Shleifer c58e6c129a [marian tests ] pass device to pipeline (#4815) 2020-06-06 00:52:17 -04:00
Sam Shleifer 4ab7424597 [cleanup/marian] pipelines test and new kwarg (#4812) 2020-06-05 18:45:19 -04:00
Sam Shleifer 875288b344 [isort] add matplotlib to known 3rd party dependencies (#4800) 2020-06-05 17:27:31 -04:00
Sam Shleifer 3723f30a18 [cleanup] MarianTokenizer: delete unused constants (#4802) 2020-06-05 14:57:24 -04:00
Sam Shleifer 2b8b6c929e [cleanup] PretrainedModel.generate: remove unused kwargs (#4761) 2020-06-04 08:13:52 -04:00
Sam Shleifer 70f7423436 TFRobertaModelIntegrationTest requires tf (#4726) 2020-06-02 12:59:00 -04:00
Sam Shleifer 07797c4da4 [testing] LanguageModelGenerationTests require_tf or require_torch (#4616) 2020-05-27 09:10:26 -04:00
Sam Shleifer b86e42e0ac [ci] fix 3 remaining slow GPU failures (#4584) 2020-05-25 19:20:50 -04:00
Sam Shleifer ab44630db2 [Summarization Pipeline]: Fix default tokenizer (#4506) 
* Fix pipelines defaults bug

* one liner

* style
 2020-05-22 17:49:45 -04:00
Sam Shleifer efbc1c5a9d [MarianTokenizer] implement save_vocabulary and other common methods (#4389) 2020-05-19 19:45:49 -04:00
Sam Shleifer 956c4c4eb4 [gpu slow tests] fix mbart-large-enro gpu tests (#4472) 2020-05-19 19:45:31 -04:00
Sam Shleifer 07dd7c2fd8 [cleanup] test_tokenization_common.py (#4390) 2020-05-19 10:46:55 -04:00
Sam Shleifer a699525d25 [test_pipelines] Mark tests > 10s @slow, small speedups (#4421) 2020-05-18 12:23:21 -04:00
Sam Shleifer 9535bf1977 Tokenizer.batch_decode convenience method (#4159) 2020-05-14 13:50:47 -04:00
Sam Shleifer 7822cd38a0 [tests] make pipelines tests faster with smaller models (#4238) 
covers torch and tf. Also fixes a failing @slow test
 2020-05-14 13:36:02 -04:00
Sam Shleifer 9a687ebb77 [Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290) 2020-05-13 17:29:41 -04:00
Sam Shleifer 4658896ee1 [Marian] Fix typo in docstring (#4284) 2020-05-11 11:47:51 -04:00
Sam Shleifer 3487be75ef [Marian] documentation and AutoModel support (#4152) 
- MarianSentencepieceTokenizer - > MarianTokenizer
- Start using unk token.
- add docs page
- add better generation params to MarianConfig
- more conversion utilities
 2020-05-10 13:54:57 -04:00
Sam Shleifer 18db92dd9a [testing] add timeout_decorator (#3543) 2020-05-01 09:05:47 -04:00
Sam Shleifer 2c77842887 [Fix common tests on GPU] send model, ids to torch_device (#4014) 2020-04-29 09:47:20 -04:00
Sam ShleiferandStefan Schweter 847e7f3379 MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908) 
Co-Authored-By: Stefan Schweter <stefan@schweter.it>
 2020-04-28 18:22:37 -04:00
Sam ShleiferandJulien Chaumond d714dfeaa8 [isort] add known 3rd party to setup.cfg (#4053) 
* add known 3rd party to setup.cfg

* comment

* Update CONTRIBUTING.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-04-28 17:12:00 -04:00
sshleifer 41750a6cff Fix typos 2020-04-27 13:25:53 -04:00
Sam Shleifer a504cb49ec [examples] fix summarization do_predict (#3866) 2020-04-20 10:49:56 -04:00
Sam Shleifer f0c96fafd1 [examples] summarization/bart/finetune.py supports t5 (#3824) 
renames `run_bart_sum.py` to `finetune.py`
 2020-04-16 15:15:19 -04:00
Sam Shleifer 16469fedbd [PretrainedTokenizer] Factor out tensor conversion method (#3777) 2020-04-16 15:02:43 -04:00
Sam Shleifer dbd041243d [cleanup] factor out get_head_mask, invert_attn_mask, get_exten… (#3806) 
* Delete some copy pasted code
 2020-04-16 09:55:25 -04:00
Sam Shleifer c59b1e682d [examples] unit test for run_bart_sum (#3544) 
- adds pytorch-lightning dependency
 2020-04-15 18:35:01 -04:00
Sam Shleifer 7a7fdf71f8 Multilingual BART - (#3602) 
- support mbart-en-ro weights
- add MBartTokenizer
 2020-04-10 11:25:39 -04:00
Sam Shleifer 715aa5b135 [Bart] Replace config.output_past with use_cache kwarg (#3632) 2020-04-07 19:08:26 -04:00
Sam Shleifer e344e3d402 [examples] SummarizationDataset cleanup (#3451) 2020-04-07 19:05:58 -04:00
Sam Shleifer 0a4b1068e1 Speedup torch summarization tests (#3663) 2020-04-07 14:01:30 -04:00
Sam Shleifer 8deff3acf2 [bart-tiny-random] Put a 5MB model on S3 to allow faster exampl… (#3488) 2020-03-30 12:28:27 -04:00
Sam Shleifer 33ef7002e1 [Docs] examples/summarization/bart: Simplify CNN/DM preprocessi… (#3516) 2020-03-29 13:25:42 -04:00
Sam Shleifer f6a23d1911 [BART] add bart-large-xsum weights (#3422) 2020-03-29 10:51:13 -04:00
Sam Shleifer 3ee431dd4c [Bart/Memory] Two separate, smaller decoder attention masks (#3371) 2020-03-26 21:34:15 -04:00
Sam Shleifer c10decf7a0 [Bart: example] drop columns that are exclusively pad_token_id… (#3400) 
* trim seq_len below 1024 if there are columns full of pad_token_id
* Centralize trim_batch so SummarizationDataset can use it too
 2020-03-26 19:33:54 -04:00
Sam Shleifer 63f4d8cad0 [Bart/Memory] SelfAttention only returns weights if config.outp… (#3369) 2020-03-26 18:42:39 -04:00
Sam Shleifer 2b2a2f8df2 [Bart] Fix: put dummy_inputs on correct device (#3398) 
* Dummy inputs to model.device

* Move self.device to ModuleUtilsMixin
 2020-03-26 18:42:09 -04:00
Sam Shleifer 1a5aefc95c [Seq2Seq Generation] Call encoder before expanding input_ids (#3370) 2020-03-26 18:41:19 -04:00
Sam Shleifer 39371ee454 [Bart/Memory] don't create lm_head (#3323) 
* delete lm_head, skips weight tying
* Fixed s3
 2020-03-26 18:40:39 -04:00
Sam Shleifer 4e4403c9b4 [BART] torch 1.0 compatibility (#3322) 
* config.activation_function
 2020-03-19 11:56:54 -04:00
Sam Shleifer ad7233fc01 [BART] cleanup: remove redundant kwargs, improve docstrings (#3319) 2020-03-19 11:16:51 -04:00
Sam Shleifer 38a555a83c Add Summarization to Pipelines (#3128) 
* passing

* Undo stupid chg

* docs

* undo rename

* delete-cruft

* only import if you have torch

* Dont rely on dict ordering

* Fix dict ordering upstream

* docstring link

* docstring link

* remove trailing comma for 3.5 compat

* new name

* delegate kwarging

* Update kwargs
 2020-03-17 18:04:21 -04:00
Sam Shleifer b2c1a447fe [BART] Delete redundant unit test (#3302) 2020-03-16 23:09:10 -04:00
Sam Shleifer 11573231c6 [BART] generation_mode as a kwarg not a class attribute (#3278) 2020-03-16 12:47:53 -04:00
Sam Shleifer 5ea8ba67b4 [BART] Remove unused kwargs (#3279) 
* Remove unused kwargs
* dont call forward in tests
 2020-03-15 23:00:44 -04:00
Sam Shleifer 2bd79e23de [BART] FP16 testing fixes (#3266) 2020-03-13 19:48:26 -04:00
Sam Shleifer 087465b943 add BART to README (#3255) 2020-03-12 19:38:05 -04:00
Sam Shleifer 2e81b9d8d7 Bart: update example for #3140 compatibility (#3233) 
* Update bart example docs
 2020-03-12 10:36:37 -04:00
Sam Shleifer 3aca02efb3 Bart example: model.to(device) (#3194) 2020-03-09 15:09:35 -04:00
Sam Shleifer ed37f9fa4f [Bart] _prepare_decoder_inputs should use large negative (#3158) 2020-03-06 16:06:36 -05:00
Sam Shleifer e58b3ec5df add imports to examples (#3160) 2020-03-06 11:15:33 -05:00
Sam Shleifer 857e0a0d3b Rename BartForMaskedLM -> BartForConditionalGeneration (#3114) 
* improved documentation
 2020-03-05 17:41:18 -05:00
sshleifer 14d40584b2 remove newline 2020-03-05 13:06:35 -05:00
sshleifer 1360dacaa3 cleanup deltas 2020-03-05 12:57:42 -05:00
sshleifer 810079de1f no ipdb 2020-03-05 12:48:14 -05:00
sshleifer c203509d5b undo chg 2020-03-05 12:34:08 -05:00
sshleifer c36fdc88d4 tests pass 2020-03-05 12:33:08 -05:00
Sam Shleifer e9e6efdc45 BartForSequenceClassification: fix num_labels, add test (#3110) 2020-03-03 15:54:29 -05:00
Sam Shleifer 5b396457e5 Summarization Examples: add Bart CNN Evaluation (#3082) 
* Rename and improve example

* Add test

* slightly faster test

* style

* This breaks remy prolly

* shorter test string

* no slow

* newdir structure

* New tree

* Style

* shorter

* docs

* clean

* Attempt future import

* more import hax
 2020-03-03 15:29:59 -05:00
Sam Shleifer 5c5af879b6 [Bart] dont call .forward (#3094) 2020-03-03 15:14:12 -05:00
Sam Shleifer b54ef78d0c Bart-CNN (#3059) 
`generate` code that produces 99% identical summarizations to fairseq on CNN test data, with caching.
 2020-03-02 10:35:53 -05:00
Sam Shleifer 6a37588041 spelling: strictly (#3042) 2020-02-27 10:22:35 -05:00
Sam Shleifer 9df74b8bc4 Delete all mentions of Model2Model (#3019) 2020-02-26 11:36:27 -05:00
Sam Shleifer 129f0604ac Delete untested, broken Model2LSTM (#2968) 2020-02-23 11:28:48 -05:00
Sam Shleifer 92487a1dc0 Bart: fix layerdrop and cached decoder_input_ids for generation (#2969) 2020-02-22 16:25:04 -05:00
Sam Shleifer b5b3445c4f Only use F.gelu for torch >=1.4.0 (#2955) 
* Only use F.gelu for torch >=1.4.0

* Use F.gelu for newer torch
 2020-02-21 16:10:21 -05:00
Sam Shleifer 53ce3854a1 New BartModel (#2745) 
* Results same as fairseq
* Wrote a ton of tests
* Struggled with api signatures
* added some docs
 2020-02-20 18:11:13 -05:00
Sam Shleifer 20fc18fbda Skip flaky test_tf_question_answering (#2845) 
* Skip flaky test

* Style
 2020-02-18 16:14:50 -05:00
Sam Shleifer 0ed630f139 Attempt to increase timeout for circleci slow tests (#2844) 2020-02-13 09:11:03 -05:00
Sam Shleifer ef74b0f07a get_activation('relu') provides a simple mapping from strings i… (#2807) 
* activations.py contains a mapping from string to activation function
* resolves some `gelu` vs `gelu_new` ambiguity
 2020-02-13 08:28:33 -05:00
sshleifer 5f2dd71d1b Smaller diff 2020-02-11 17:20:09 -05:00
sshleifer 31158af57c formatting 2020-02-11 17:20:09 -05:00
sshleifer 5dd61fb9a9 Add more specific testing advice to Contributing.md 2020-02-11 17:20:09 -05:00
sshleifer 9e5b549b4d fix default getattr 2020-02-04 16:38:52 -05:00
sshleifer 25848a6094 double quotes 2020-02-04 16:38:52 -05:00
sshleifer cbcb83f21d minor cleanup of test_attention_outputs 2020-02-04 16:38:52 -05:00
sshleifer 119610b5c5 Merge branch 'master' into delete-n-special-doc 2019-09-19 01:35:01 -07:00
sshleifer 08e4ad5eea Remove documentation for unused kwarg 2019-09-18 16:35:01 -07:00