c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,447 Commits 171 Branches 49 Tags
c03c0dfd230a5174c536a58d6ba5e590ed1afcc4
Commit Graph
77 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Julien Chaumond 2e2f9fed55 rm duplicate imports 2019-12-11 11:11:56 -05:00
Julien Chaumond 1d18930462 Harmonize no_cuda flag with other scripts 2019-12-09 20:37:55 -05:00
Julien Chaumond e4679cddce [cli] Uploads: add progress bar (#2078) 
* [cli] Uploads: add progress bar

see https://github.com/huggingface/transformers/pull/2044#discussion_r354057827 for context

* rename + documentation

* Add auto-referential comment
 2019-12-06 11:56:23 -05:00
Julien Chaumond 3ba417e1a8 [cli] ls: Tabular formatting 2019-12-04 18:40:52 -05:00
Julien Chaumond 96fa9a8a70 Python 2 + Post mime-type to S3 2019-12-04 17:22:50 -05:00
Julien Chaumond e4fbf3e2cc CLI for authenticated file sharing 2019-12-04 00:52:23 -05:00
Julien Chaumond 7edb51f3a5 [pplm] split classif head into its own file 2019-12-03 22:07:25 +00:00
Julien ChaumondandPiero Molino f434bfc623 [pplm] Update S3 links 
Co-Authored-By: Piero Molino <w4nderlust@gmail.com>
 2019-12-03 10:53:02 -05:00
Julien Chaumond 3b48806f75 [pplm] README: add setup + tweaks 2019-12-03 10:14:02 -05:00
Julien ChaumondandRosanne Liu 0cb2c90890 readme 
Co-Authored-By: Rosanne Liu <mimosavvy@gmail.com>
 2019-12-03 10:14:02 -05:00
Julien Chaumond 1efb2ae7fc [pplm] move scripts under examples/pplm/ 2019-12-03 10:14:02 -05:00
Julien Chaumond d5faa74cd6 tokenizer white space: revert to previous behavior 2019-12-03 10:14:02 -05:00
Julien Chaumond 0b77d66a6d rm extraneous import 2019-12-03 10:14:02 -05:00
Julien ChaumondpieroRosanne Liu
 		572c24cfa2 PPLM (squashed) 
Co-authored-by: piero <piero@uber.com>
Co-authored-by: Rosanne Liu <mimosavvy@gmail.com>
 2019-12-03 10:14:02 -05:00
Julien Chaumond b5d884d25c Uniformize #1952 2019-11-27 11:05:55 -05:00
Julien Chaumond 8742baa531 Improve test protocol for inputs_embeds in TF 2019-11-26 14:39:47 -05:00
Julien Chaumond cf62bdc962 Improve test protocol for inputs_embeds in TF 
cc @lysandrejik
 2019-11-26 14:37:32 -05:00
Julien Chaumond bdfe21ab24 Change param order for consistency 2019-11-26 13:08:12 -05:00
Julien Chaumond afaa335851 [doc] Fix assets urls 2019-11-23 11:34:45 -05:00
Julien Chaumond 176cd1ce1b [doc] homogenize instructions slightly 2019-11-23 11:18:54 -05:00
Julien Chaumond 3916b334a8 [camembert] Acknowledge the full author list 2019-11-18 09:29:11 -05:00
Julien Chaumond 0477b307c7 [camembert] tokenizer: use additional_special_tokens 2019-11-16 00:11:07 -05:00
Julien Chaumond f9abf73e31 [camembert] realign w/ recent changes 2019-11-16 00:11:07 -05:00
Julien Chaumond 26858f27cb [camembert] Upload to s3 + rename script 2019-11-16 00:11:07 -05:00
Julien Chaumond 155c782a2c [inputs_embeds] All TF models + tests 2019-11-12 11:29:21 -05:00
Julien Chaumond 2aef2f0bbc [common attributes] Fix previous commit for transfo-xl 2019-11-12 11:29:21 -05:00
Julien Chaumond 2f17464266 [common attributes] Slightly sharper test coverage 2019-11-12 11:29:21 -05:00
Julien Chaumond 9d2398fd99 Ooopsie 2019-11-12 11:29:21 -05:00
Julien Chaumond 70d97ddd60 [TF models] Common attributes as per #1721 2019-11-12 11:29:21 -05:00
Julien Chaumond 872403be1c This is not a @property after all 2019-11-12 11:29:21 -05:00
Julien Chaumond dd6b2e05e1 whitespace 2019-11-12 11:29:21 -05:00
Julien ChaumondLysandre DebutJong Wook KimJeff Wu
 		1c542df7e5 Add RoBERTa-based GPT-2 Output Detector from OpenAI 
converted from https://github.com/openai/gpt-2-output-dataset/tree/master/detector

Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
Co-Authored-By: Jong Wook Kim <jongwook@nyu.edu>
Co-Authored-By: Jeff Wu <wuthefwasthat@gmail.com>
 2019-11-06 16:26:31 -05:00
Julien Chaumond 2f3a421018 Fix other PyTorch models 2019-11-06 14:03:47 -05:00
Julien Chaumond d5319793c4 Fix BERT 2019-11-06 14:03:47 -05:00
Julien Chaumond 27e015bd54 [tests] Flag to test on cuda 2019-11-06 14:03:47 -05:00
Julien Chaumond 13d9135fa5 [tests] get rid of warning 
cf. https://docs.pytest.org/en/latest/example/simple.html
 2019-11-06 14:03:47 -05:00
Julien Chaumond f88c104d8f [run_tf_glue] Add comment for context 2019-11-05 19:56:43 -05:00
Julien Chaumond 30968d70af misc doc 2019-11-05 19:06:12 -05:00
Julien Chaumond 7daacf00df Merge pull request #1695 from huggingface/models_inputs_embeds 
model forwards can take an inputs_embeds param
 2019-11-05 09:55:28 -05:00
Julien Chaumond 00337e9687 [inputs_embeds] All PyTorch models 2019-11-05 00:39:18 +00:00
Julien Chaumond 9eddf44b7a docstring + check 2019-11-04 17:19:15 +00:00
Julien Chaumond 8e11de0e86 model forwards can take an inputs_embeds param 2019-11-04 16:56:26 +00:00
Julien Chaumond 93d2fff071 Close #1654 2019-11-01 09:47:38 -04:00
Julien Chaumond 2a5663c280 Merge branch 'mataney-fix_top_k_top_p_filtering' 2019-10-31 18:28:34 +00:00
Julien Chaumond f96ce1c241 [run_generation] Fix generation with batch_size>1 2019-10-31 18:27:11 +00:00
Julien Chaumond 3c1b6f594e Merge branch 'master' into fix_top_k_top_p_filtering 2019-10-31 13:53:51 -04:00
Julien Chaumond ef1b8b2ae5 [CTRL] warn if generation prompt does not start with a control code 
see also https://github.com/salesforce/ctrl/pull/50
 2019-10-22 21:30:32 +00:00
Julien Chaumond 788e632622 [ner] Honor args.overwrite_cache 2019-10-15 09:17:31 +02:00
Julien Chaumond d688af19e5 Update link to swift-coreml-transformers 
cc @lysandrejik
 2019-10-08 16:37:52 -04:00
Julien Chaumond 9e136ff57c Honor args.overwrite_cache (h/t @erenup) 2019-10-04 15:00:56 -04:00
Julien ChaumondandLysandre Debut b350662955 overflowing_tokens do not really make sense here, let's just return a number 
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2019-09-30 16:37:09 -04:00
Julien Chaumond f5bcde0b2f [multiple-choice] Simplify and use tokenizer.encode_plus 2019-09-30 16:04:55 -04:00
Julien Chaumond d8b641c839 6 -> 8 models 2019-09-27 17:22:01 -04:00
Julien Chaumond c6acbdd50a Close #1304 2019-09-27 17:02:53 -04:00
Julien ChaumondandLysandre Debut 22d2fded2c [docs] Fix doc auto-deploy 
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2019-09-26 18:22:45 -04:00
Julien ChaumondandLysandre Debut fc9faa8a47 [docs] Doc tweaks 
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2019-09-26 18:19:51 -04:00
Julien Chaumond 798da627eb Fix TFBert tests in Python 3.5 2019-09-23 12:06:10 -04:00
Julien Chaumond 62760baf46 tiny fixes 2019-09-17 18:29:15 -04:00
Julien Chaumond f9453d15e5 Fix broken link 2019-09-05 12:35:22 -04:00
Julien Chaumond f7ee2e5d20 [README] link to Write With Transformer 2019-09-05 12:33:46 -04:00
Julien Chaumond 2dcc5a1629 [doc] Add blurb about large-scale model downloads 
cc @n1t0 @lysandrejik @thomwolf
 2019-09-02 12:27:11 -04:00
Julien Chaumond 0fd0b674e6 [ci] legible output [skip ci] 2019-08-30 20:36:26 -04:00
Julien Chaumond b65a994f59 [ci] decrease parallelism to increase success prob 2019-08-30 20:33:16 -04:00
Julien Chaumond 1d438f15b3 [XLNet] Use pytorch's layernorm like in BERT 
See #1089

cc @thomwolf @lysandrejik

Also @dhpollack
 2019-08-30 20:20:15 -04:00
Julien Chaumond 574c5b3a72 [RoBERTa] LayerNorm's eps is not a nn.Parameter so there's no point setting it on the model 
Instead we correctly store it on the config

(regenerating the hosted config files)

cc @lysandrejik
 2019-08-30 20:09:24 -04:00
Julien Chaumond b0b9b8091b minor typo 2019-08-20 11:33:46 +02:00
Julien ChaumondandMyle Ott c4ef103447 [RoBERTa] First 4 authors 
cf. https://github.com/huggingface/pytorch-transformers/pull/964#discussion_r313574354

Co-Authored-By: Myle Ott <myleott@fb.com>
 2019-08-14 12:31:09 -04:00
Julien Chaumond baf08ca1d4 [RoBERTa] run_glue: correct pad_token + reorder labels 2019-08-13 12:51:15 -04:00
Julien Chaumond 912fdff899 [RoBERTa] Update run_glue for RoBERTa 2019-08-12 13:49:50 -04:00
Julien Chaumond b3d83d68db Fixup 9d0603148b 2019-08-12 12:28:55 -04:00
Julien Chaumond e367ac469c [RoBERTa] Re-apply 39d72bcc7b 
cc @lysandrejik
 2019-08-08 11:26:11 -04:00
Julien Chaumond 9d0603148b [RoBERTa] RobertaForSequenceClassification + conversion 2019-08-08 11:24:54 -04:00
Julien Chaumond cb9db101c7 Python 2 must DIE 2019-08-04 22:04:15 -04:00
Julien Chaumond 05c083520a [RoBERTa] model conversion, inference, tests 🔥 2019-08-04 21:39:21 -04:00
Julien Chaumond 44dd941efb link to swift-coreml-transformers 2019-08-01 09:50:30 -04:00
Julien Chaumond 8da280ebbe Setup CI 2018-12-20 16:33:39 -05:00
Julien Chaumond d57763f582 Fix typos 2018-12-18 19:23:22 -05:00