c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,939 Commits 171 Branches 49 Tags
035678efdb9d7782c8a1d20883324f172c48a4fa
Commit Graph
67 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sam Shleifer 9535bf1977 Tokenizer.batch_decode convenience method (#4159) 2020-05-14 13:50:47 -04:00
Sam Shleifer 7822cd38a0 [tests] make pipelines tests faster with smaller models (#4238) 
covers torch and tf. Also fixes a failing @slow test
 2020-05-14 13:36:02 -04:00
Sam Shleifer 9a687ebb77 [Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290) 2020-05-13 17:29:41 -04:00
Sam Shleifer 4658896ee1 [Marian] Fix typo in docstring (#4284) 2020-05-11 11:47:51 -04:00
Sam Shleifer 3487be75ef [Marian] documentation and AutoModel support (#4152) 
- MarianSentencepieceTokenizer - > MarianTokenizer
- Start using unk token.
- add docs page
- add better generation params to MarianConfig
- more conversion utilities
 2020-05-10 13:54:57 -04:00
Sam Shleifer 18db92dd9a [testing] add timeout_decorator (#3543) 2020-05-01 09:05:47 -04:00
Sam Shleifer 2c77842887 [Fix common tests on GPU] send model, ids to torch_device (#4014) 2020-04-29 09:47:20 -04:00
Sam ShleiferandStefan Schweter 847e7f3379 MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908) 
Co-Authored-By: Stefan Schweter <stefan@schweter.it>
 2020-04-28 18:22:37 -04:00
Sam ShleiferandJulien Chaumond d714dfeaa8 [isort] add known 3rd party to setup.cfg (#4053) 
* add known 3rd party to setup.cfg

* comment

* Update CONTRIBUTING.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-04-28 17:12:00 -04:00
sshleifer 41750a6cff Fix typos 2020-04-27 13:25:53 -04:00
Sam Shleifer a504cb49ec [examples] fix summarization do_predict (#3866) 2020-04-20 10:49:56 -04:00
Sam Shleifer f0c96fafd1 [examples] summarization/bart/finetune.py supports t5 (#3824) 
renames `run_bart_sum.py` to `finetune.py`
 2020-04-16 15:15:19 -04:00
Sam Shleifer 16469fedbd [PretrainedTokenizer] Factor out tensor conversion method (#3777) 2020-04-16 15:02:43 -04:00
Sam Shleifer dbd041243d [cleanup] factor out get_head_mask, invert_attn_mask, get_exten… (#3806) 
* Delete some copy pasted code
 2020-04-16 09:55:25 -04:00
Sam Shleifer c59b1e682d [examples] unit test for run_bart_sum (#3544) 
- adds pytorch-lightning dependency
 2020-04-15 18:35:01 -04:00
Sam Shleifer 7a7fdf71f8 Multilingual BART - (#3602) 
- support mbart-en-ro weights
- add MBartTokenizer
 2020-04-10 11:25:39 -04:00
Sam Shleifer 715aa5b135 [Bart] Replace config.output_past with use_cache kwarg (#3632) 2020-04-07 19:08:26 -04:00
Sam Shleifer e344e3d402 [examples] SummarizationDataset cleanup (#3451) 2020-04-07 19:05:58 -04:00
Sam Shleifer 0a4b1068e1 Speedup torch summarization tests (#3663) 2020-04-07 14:01:30 -04:00
Sam Shleifer 8deff3acf2 [bart-tiny-random] Put a 5MB model on S3 to allow faster exampl… (#3488) 2020-03-30 12:28:27 -04:00
Sam Shleifer 33ef7002e1 [Docs] examples/summarization/bart: Simplify CNN/DM preprocessi… (#3516) 2020-03-29 13:25:42 -04:00
Sam Shleifer f6a23d1911 [BART] add bart-large-xsum weights (#3422) 2020-03-29 10:51:13 -04:00
Sam Shleifer 3ee431dd4c [Bart/Memory] Two separate, smaller decoder attention masks (#3371) 2020-03-26 21:34:15 -04:00
Sam Shleifer c10decf7a0 [Bart: example] drop columns that are exclusively pad_token_id… (#3400) 
* trim seq_len below 1024 if there are columns full of pad_token_id
* Centralize trim_batch so SummarizationDataset can use it too
 2020-03-26 19:33:54 -04:00
Sam Shleifer 63f4d8cad0 [Bart/Memory] SelfAttention only returns weights if config.outp… (#3369) 2020-03-26 18:42:39 -04:00
Sam Shleifer 2b2a2f8df2 [Bart] Fix: put dummy_inputs on correct device (#3398) 
* Dummy inputs to model.device

* Move self.device to ModuleUtilsMixin
 2020-03-26 18:42:09 -04:00
Sam Shleifer 1a5aefc95c [Seq2Seq Generation] Call encoder before expanding input_ids (#3370) 2020-03-26 18:41:19 -04:00
Sam Shleifer 39371ee454 [Bart/Memory] don't create lm_head (#3323) 
* delete lm_head, skips weight tying
* Fixed s3
 2020-03-26 18:40:39 -04:00
Sam Shleifer 4e4403c9b4 [BART] torch 1.0 compatibility (#3322) 
* config.activation_function
 2020-03-19 11:56:54 -04:00
Sam Shleifer ad7233fc01 [BART] cleanup: remove redundant kwargs, improve docstrings (#3319) 2020-03-19 11:16:51 -04:00
Sam Shleifer 38a555a83c Add Summarization to Pipelines (#3128) 
* passing

* Undo stupid chg

* docs

* undo rename

* delete-cruft

* only import if you have torch

* Dont rely on dict ordering

* Fix dict ordering upstream

* docstring link

* docstring link

* remove trailing comma for 3.5 compat

* new name

* delegate kwarging

* Update kwargs
 2020-03-17 18:04:21 -04:00
Sam Shleifer b2c1a447fe [BART] Delete redundant unit test (#3302) 2020-03-16 23:09:10 -04:00
Sam Shleifer 11573231c6 [BART] generation_mode as a kwarg not a class attribute (#3278) 2020-03-16 12:47:53 -04:00
Sam Shleifer 5ea8ba67b4 [BART] Remove unused kwargs (#3279) 
* Remove unused kwargs
* dont call forward in tests
 2020-03-15 23:00:44 -04:00
Sam Shleifer 2bd79e23de [BART] FP16 testing fixes (#3266) 2020-03-13 19:48:26 -04:00
Sam Shleifer 087465b943 add BART to README (#3255) 2020-03-12 19:38:05 -04:00
Sam Shleifer 2e81b9d8d7 Bart: update example for #3140 compatibility (#3233) 
* Update bart example docs
 2020-03-12 10:36:37 -04:00
Sam Shleifer 3aca02efb3 Bart example: model.to(device) (#3194) 2020-03-09 15:09:35 -04:00
Sam Shleifer ed37f9fa4f [Bart] _prepare_decoder_inputs should use large negative (#3158) 2020-03-06 16:06:36 -05:00
Sam Shleifer e58b3ec5df add imports to examples (#3160) 2020-03-06 11:15:33 -05:00
Sam Shleifer 857e0a0d3b Rename BartForMaskedLM -> BartForConditionalGeneration (#3114) 
* improved documentation
 2020-03-05 17:41:18 -05:00
sshleifer 14d40584b2 remove newline 2020-03-05 13:06:35 -05:00
sshleifer 1360dacaa3 cleanup deltas 2020-03-05 12:57:42 -05:00
sshleifer 810079de1f no ipdb 2020-03-05 12:48:14 -05:00
sshleifer c203509d5b undo chg 2020-03-05 12:34:08 -05:00
sshleifer c36fdc88d4 tests pass 2020-03-05 12:33:08 -05:00
Sam Shleifer e9e6efdc45 BartForSequenceClassification: fix num_labels, add test (#3110) 2020-03-03 15:54:29 -05:00
Sam Shleifer 5b396457e5 Summarization Examples: add Bart CNN Evaluation (#3082) 
* Rename and improve example

* Add test

* slightly faster test

* style

* This breaks remy prolly

* shorter test string

* no slow

* newdir structure

* New tree

* Style

* shorter

* docs

* clean

* Attempt future import

* more import hax
 2020-03-03 15:29:59 -05:00
Sam Shleifer 5c5af879b6 [Bart] dont call .forward (#3094) 2020-03-03 15:14:12 -05:00
Sam Shleifer b54ef78d0c Bart-CNN (#3059) 
`generate` code that produces 99% identical summarizations to fairseq on CNN test data, with caching.
 2020-03-02 10:35:53 -05:00
Sam Shleifer 6a37588041 spelling: strictly (#3042) 2020-02-27 10:22:35 -05:00
Sam Shleifer 9df74b8bc4 Delete all mentions of Model2Model (#3019) 2020-02-26 11:36:27 -05:00
Sam Shleifer 129f0604ac Delete untested, broken Model2LSTM (#2968) 2020-02-23 11:28:48 -05:00
Sam Shleifer 92487a1dc0 Bart: fix layerdrop and cached decoder_input_ids for generation (#2969) 2020-02-22 16:25:04 -05:00
Sam Shleifer b5b3445c4f Only use F.gelu for torch >=1.4.0 (#2955) 
* Only use F.gelu for torch >=1.4.0

* Use F.gelu for newer torch
 2020-02-21 16:10:21 -05:00
Sam Shleifer 53ce3854a1 New BartModel (#2745) 
* Results same as fairseq
* Wrote a ton of tests
* Struggled with api signatures
* added some docs
 2020-02-20 18:11:13 -05:00
Sam Shleifer 20fc18fbda Skip flaky test_tf_question_answering (#2845) 
* Skip flaky test

* Style
 2020-02-18 16:14:50 -05:00
Sam Shleifer 0ed630f139 Attempt to increase timeout for circleci slow tests (#2844) 2020-02-13 09:11:03 -05:00
Sam Shleifer ef74b0f07a get_activation('relu') provides a simple mapping from strings i… (#2807) 
* activations.py contains a mapping from string to activation function
* resolves some `gelu` vs `gelu_new` ambiguity
 2020-02-13 08:28:33 -05:00
sshleifer 5f2dd71d1b Smaller diff 2020-02-11 17:20:09 -05:00
sshleifer 31158af57c formatting 2020-02-11 17:20:09 -05:00
sshleifer 5dd61fb9a9 Add more specific testing advice to Contributing.md 2020-02-11 17:20:09 -05:00
sshleifer 9e5b549b4d fix default getattr 2020-02-04 16:38:52 -05:00
sshleifer 25848a6094 double quotes 2020-02-04 16:38:52 -05:00
sshleifer cbcb83f21d minor cleanup of test_attention_outputs 2020-02-04 16:38:52 -05:00
sshleifer 119610b5c5 Merge branch 'master' into delete-n-special-doc 2019-09-19 01:35:01 -07:00
sshleifer 08e4ad5eea Remove documentation for unused kwarg 2019-09-18 16:35:01 -07:00