c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
640 Commits 171 Branches 49 Tags
4d3cf0d6028d7576b8c51ba1eda8403e86b42b05
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf ec5c1d6134 Merge pull request #425 from Separius/patch-1 
fix lm_finetuning's link
 2019-03-29 09:14:11 +01:00
Thomas Wolf 694e2117f3 Merge pull request #388 from ananyahjha93/master 
Added remaining GLUE tasks to 'run_classifier.py'
 2019-03-28 09:06:53 +01:00
Thomas Wolf f7c9dc8c99 Merge pull request #409 from ikuyamada/master 
Remove padding_idx from position_embeddings and token_type_embeddings
 2019-03-27 12:30:03 +01:00
Thomas Wolf cc8c2d2332 Merge pull request #396 from IndexFziQ/IndexFziQ 
add tqdm to the process of eval in examples/run_swag.py
 2019-03-27 12:03:26 +01:00
Thomas Wolf bbff03fbfc Merge pull request #394 from desireevl/master 
Minor change in README
 2019-03-27 12:03:00 +01:00
Thomas Wolf 2fb8ddeeff Merge pull request #392 from Rocketknight1/master 
Add full language model fine-tuning
 2019-03-27 12:02:36 +01:00
Thomas Wolf f3e5404880 Merge pull request #381 from tseretelitornike/master 
Added missing imports.
 2019-03-15 12:54:40 +01:00
Thomas Wolf d5c037c3ed Merge pull request #380 from yongbowin/patch-3 
typo in annotation
 2019-03-14 15:56:40 +01:00
Thomas Wolf 59e2bdd086 Merge pull request #379 from yongbowin/patch-2 
typo
 2019-03-14 10:17:18 +01:00
Thomas Wolf 76906372b0 Merge pull request #378 from huggingface/absolute_imports 
Add absolute imports to GPT, GPT-2, Transfo-XL and and fix empty nbest_predictions.json
 2019-03-14 10:00:47 +01:00
Thomas Wolf eecaaa734a Merge pull request #371 from yongbowin/patch-1 
Simplify code, delete redundancy line
 2019-03-14 09:03:32 +01:00
Thomas Wolf 9b03d67b83 Merge pull request #362 from Bharat123rox/patch-1 
Make the hyperlink of NVIDIA Apex clickable
 2019-03-11 09:08:51 +01:00
Thomas Wolf 8435d78f0c Merge pull request #361 from junjieqian/jqian/updateReadme 
Correct line number in README for classes
 2019-03-11 09:08:27 +01:00
Thomas Wolf 80790705e0 Merge pull request #359 from elonmuskceo/fix-typo 
Update run_gpt2.py
 2019-03-11 09:07:56 +01:00
Thomas Wolf 13aa13dbc0 Merge pull request #358 from cdjhz/patch-1 
add 'padding_idx=0' for BertEmbeddings
 2019-03-11 09:06:55 +01:00
Thomas Wolf c0660df5dd Merge pull request #357 from pglock/feature/354-use-dropout-layer-gpt 
Use Dropout Layer in OpenAIGPTMultipleChoiceHead
 2019-03-11 09:06:27 +01:00
Thomas Wolf 8e36da7acb Merge pull request #347 from jplehmann/feature/sst2-processor 
Processor for SST-2 task
 2019-03-06 09:48:27 +01:00
Thomas Wolf 21c88a07b7 Merge pull request #341 from potatochip/patch-1 
catch exception if pathlib not install
 2019-03-06 09:48:01 +01:00
Thomas Wolf 3c01dfb775 Merge pull request #338 from CatalinVoss/patch-3 
Fix top k generation for k != 0
 2019-03-06 09:47:33 +01:00
Thomas Wolf 477ec4b6cc Merge pull request #337 from CatalinVoss/patch-2 
Allow tokenization of sequences > 512 for caching
 2019-03-06 09:45:49 +01:00
Thomas Wolf 7b9e5a54b5 Merge pull request #327 from lukovnikov/master 
Issue#324: warmup linear fixes
 2019-03-06 09:44:56 +01:00
Thomas Wolf 4784b04f47 Merge pull request #325 from john-hewitt/master 
add BertTokenizer flag to skip basic tokenization
 2019-03-06 09:37:11 +01:00
Thomas Wolf 2152bfeae8 Merge pull request #316 from joelgrus/gpt2docs 
update documentation for gpt-2
 2019-02-24 09:38:29 +01:00
Thomas Wolf a5b3a89545 Merge pull request #310 from spolu/spolu-nits_gpt2 
Few small nits in GPT-2's README code examples
 2019-02-21 10:23:27 +01:00
Thomas Wolf cbb7fad319 Merge pull request #307 from guotong1988/patch-1 
Update README.md
 2019-02-21 09:25:19 +01:00
Thomas Wolf 97c815dae2 Merge pull request #305 from bkj/patch-1 
Update run_openai_gpt.py
 2019-02-20 21:24:06 +01:00
Thomas Wolf f50b82af04 Merge pull request #302 from yongbowin/master 
typo
 2019-02-20 14:14:02 +01:00
Thomas Wolf 8337740754 Merge pull request #295 from tnlin/master 
fix broken link in readme
 2019-02-19 14:00:28 +01:00
Thomas Wolf 3ca35b99ba Merge pull request #293 from davidefiocco/patch-2 
Minor README typos corrected
 2019-02-19 09:00:01 +01:00
Thomas Wolf 07ebe0fd06 Merge pull request #292 from sam-qordoba/patch-3 
Fix typo in `GPT2Model` code sample
 2019-02-18 21:07:39 +01:00
Thomas Wolf a25d056b7a update readme 2019-02-18 15:30:11 +01:00
Thomas Wolf 517d7c8624 update readme 2019-02-18 14:39:55 +01:00
Thomas Wolf ada22a1c9e more details in GPT-2 usage example 2019-02-18 14:37:41 +01:00
Thomas Wolf 522733f6cb readme typo fixes 2019-02-18 14:32:10 +01:00
Thomas Wolf 8f46cd1057 Merge pull request #288 from huggingface/gpt2 
forgot to add regex to requirements.txt :(
 2019-02-18 12:00:11 +01:00
Thomas Wolf 0856a231c0 Merge pull request #287 from huggingface/gpt2 
Gpt2
 2019-02-18 11:38:05 +01:00
Thomas Wolf 3a2f97db6f Merge pull request #286 from hendrycks/patch-1 
Update activation function docstring
 2019-02-17 15:30:46 +01:00
Thomas Wolf 5faf386652 Merge pull request #282 from wlhgtc/master 
Fix some bug about SQuAD code
 2019-02-15 10:06:51 +01:00
Thomas Wolf 0e774e57a6 Update readme 
Adding details on how to extract a full list of hidden states for the Transformer-XL
 2019-02-14 08:39:58 +01:00
Thomas Wolf c35d9d48d9 Merge pull request #275 from davidefiocco/patch-1 
--do_lower_case is duplicated in parser args
 2019-02-13 16:32:21 +01:00
Thomas Wolf 4e56da38d9 Merge pull request #268 from wangxiaodiu/master 
fixed a minor bug in README.md
 2019-02-13 10:19:25 +01:00
Thomas Wolf cdcb206e10 Merge pull request #273 from huggingface/update_to_fifth_release 
Update to fifth release
 2019-02-13 10:19:08 +01:00
Thomas Wolf 3c33499f87 fix typo in readme 2019-02-12 10:22:54 +01:00
Thomas Wolf 03cdb2a390 Merge pull request #254 from huggingface/python_2 
Adding OpenAI GPT and Transformer-XL models, compatibility with Python 2
 2019-02-11 14:19:26 +01:00
Thomas Wolf 2dfaf2f227 Merge pull request #261 from deepset-ai/rm_arg_lm_finetuning 
removing unused argument eval_batch_size from LM finetuning #256
 2019-02-08 10:36:03 +01:00
Thomas Wolf 58f0a2745c Merge pull request #258 from BoeingX/master 
Fix the undefined variable in squad example
 2019-02-06 20:33:18 +01:00
Thomas Wolf 848aae49e1 Merge branch 'master' into python_2 2019-02-06 00:13:20 +01:00
Thomas Wolf bd74632687 Merge pull request #251 from Iwontbecreative/active_loss_tok_classif 
Only keep the active part mof the loss for token classification
 2019-02-05 16:33:45 +01:00
Thomas Wolf fd223374f0 Merge pull request #208 from Liangtaiwan/mergesquad 
Merge run_squad.py and run_squad2.py
 2019-02-05 16:15:03 +01:00
Thomas Wolf 64ce900974 Merge pull request #248 from JoeDumoulin/squad1.1-fix 
fix prediction on run-squad.py example
 2019-02-05 16:00:51 +01:00
Thomas Wolf e9e77cd3c4 Merge pull request #218 from matej-svejda/master 
Fix learning rate problems in run_classifier.py
 2019-02-05 15:40:44 +01:00
Thomas Wolf 8f8bbd4a4c Merge pull request #244 from deepset-ai/prettify_lm_masking 
Avoid confusion of inplace LM masking
 2019-02-01 12:17:50 +01:00
Thomas Wolf e2d53d95b0 Merge pull request #242 from ksurya/argparse 
Fix argparse type error
 2019-02-01 12:14:55 +01:00
Thomas Wolf 7e0b415ab4 Merge pull request #240 from girishponkiya/patch-1 
Minor update in README
 2019-02-01 12:14:05 +01:00
Thomas Wolf 0a9d7c7edb Merge pull request #201 from Liangtaiwan/squad2_save_bug 
run_squad2 Don't save model if do not train
 2019-01-18 09:28:11 +01:00
Thomas Wolf f040a43cb3 Merge pull request #199 from davidefiocco/patch-1 
(very) minor update to README
 2019-01-16 23:51:52 +01:00
Thomas Wolf 647c983530 Merge pull request #193 from nhatchan/20190113_global_step 
Fix importing unofficial TF models
 2019-01-14 09:44:01 +01:00
Thomas Wolf 4e0cba1053 Merge pull request #191 from nhatchan/20190113_py35_finetune 
lm_finetuning compatibility with Python 3.5
 2019-01-14 09:40:07 +01:00
Thomas Wolf c94455651e Merge pull request #190 from nhatchan/20190113_finetune_doc 
Fix documentation (missing backslashes)
 2019-01-14 09:39:03 +01:00
Thomas Wolf 25eae7b0ae Merge pull request #189 from donglixp/patch-1 
[bug fix] args.do_lower_case is always True
 2019-01-14 09:38:37 +01:00
Thomas Wolf 35becc6d84 Merge pull request #182 from deepset-ai/fix_lowercase_and_saving 
add do_lower_case arg and adjust model saving for lm finetuning.
 2019-01-11 08:50:13 +01:00
Thomas Wolf e485829a41 Merge pull request #174 from abeljim/master 
Added Squad 2.0
 2019-01-10 23:40:45 +01:00
Thomas Wolf 7e60205bd3 Merge pull request #179 from likejazz/patch-2 
Fix it to run properly even if without `--do_train` param.
 2019-01-10 23:39:10 +01:00
Thomas Wolf 0dd5f55ac8 Merge pull request #172 from WrRan/never_split 
Never split some texts.
 2019-01-09 13:44:09 +01:00
Thomas Wolf e048c7f1c8 Merge pull request #171 from donglixp/patch-1 
LayerNorm initialization
 2019-01-07 12:44:46 +01:00
Thomas Wolf d3d56f9a0b Merge pull request #166 from likejazz/patch-1 
Fix error when `bert_model` param is path or url.
 2019-01-07 12:40:55 +01:00
Thomas Wolf 766c6b2ce3 Merge pull request #159 from jaderabbit/master 
Allow do_eval to be used without do_train and to use the pretrained model in the output folder
 2019-01-07 12:31:06 +01:00
Thomas Wolf 77966a43a4 Merge pull request #156 from rodgzilla/cl_args_doc 
Adding new pretrained model to the help of the `bert_model` argument.
 2019-01-07 12:27:16 +01:00
Thomas Wolf bcd607542c Merge pull request #145 from wlhgtc/master 
Correct the  wrong note
 2019-01-07 12:23:05 +01:00
Thomas Wolf 2e8c5c00ec Merge pull request #141 from SinghJasdeep/patch-1 
loading saved model when n_classes != 2
 2019-01-07 12:21:13 +01:00
Thomas Wolf 2860377021 Merge pull request #134 from rodgzilla/update_doc_pretrained_models 
Fixing various class documentations.
 2019-01-07 12:06:06 +01:00
Thomas Wolf c18bdb4433 Merge pull request #124 from deepset-ai/master 
Add example for fine tuning BERT language model
 2019-01-07 12:03:51 +01:00
Thomas Wolf 7fb94ab934 Merge pull request #127 from patrick-s-h-lewis/tokenizer-error-on-long-seqs 
raises value error for bert tokenizer for long sequences
 2018-12-19 10:29:17 +01:00
Thomas Wolf 2feb29c0ff Merge pull request #130 from sodre/use-entry-points 
Use entry-points instead of scripts
 2018-12-19 10:18:24 +01:00
Thomas Wolf 2c9991496b Merge pull request #128 from sodre/add-license 
Add license to source distribution
 2018-12-19 10:15:53 +01:00
Thomas Wolf 786cc41299 Typos in readme 2018-12-17 09:22:18 +01:00
Thomas Wolf ecc0b54bec Merge pull request #119 from danyaljj/patch-1 
Minor README fix
 2018-12-14 23:29:47 +01:00
Thomas Wolf 8809eb6c93 update readme with information on NVIDIA's apex 2018-12-14 16:59:39 +01:00
Thomas Wolf e1bfad4846 Merge pull request #112 from huggingface/fourth-release 
Fourth release
 2018-12-14 15:15:47 +01:00
Thomas Wolf 91aab2a6d3 Merge pull request #116 from FDecaYed/deyuf/fp16_with_apex 
Change to use apex for better fp16 and multi-gpu support
 2018-12-13 12:32:37 +01:00
Thomas Wolf 32a227f507 Merge pull request #113 from hzhwcmhf/master 
fix compatibility with python 3.5.2
 2018-12-13 12:15:15 +01:00
Thomas Wolf ffe9075f48 Merge pull request #96 from rodgzilla/multiple-choice-code 
BertForMultipleChoice and Swag dataset example.
 2018-12-13 12:05:11 +01:00
Thomas Wolf 632f2d2df9 Merge branch 'master' into fourth-release 2018-12-11 06:00:53 -05:00
Thomas Wolf a3a3180c86 Bump up requirements to Python 3.6 2018-12-11 11:29:45 +01:00
Thomas Wolf e7c0a8ddce Merge pull request #107 from lliimsft/master 
Fix optimizer to work with horovod
 2018-12-11 05:18:00 -05:00
Thomas Wolf e622790a93 Merge pull request #91 from rodgzilla/convert-examples-code-improvement 
run_classifier.py improvements
 2018-12-11 05:12:04 -05:00
Thomas Wolf a2b6918a11 Merge pull request #101 from davidefiocco/patch-1 
Adding --do_lower_case for all uncased BERTs examples
 2018-12-09 15:29:31 -05:00
Thomas Wolf 5c858448d3 Merge pull request #94 from rodgzilla/fixing-squad-commentary 
Fixing the commentary of the `SquadExample` class.
 2018-12-09 15:27:30 -05:00
Thomas Wolf 3ba5470eb8 Merge pull request #87 from rodgzilla/readme-file-links 
Readme file links
 2018-12-05 10:41:05 -05:00
Thomas Wolf 04826b0f2c Merge pull request #77 from davidefiocco/patch-1 
Correct assignement for logits in classifier example
 2018-12-02 13:01:04 +01:00
Thomas Wolf 063be09b71 Merge pull request #75 from davidefiocco/patch-2 
Point typo fix
 2018-12-01 01:15:43 +01:00
Thomas Wolf 4450f5ef6b Merge pull request #74 from davidefiocco/patch-1 
Update finetuning example in README adding --do_lower_case
 2018-12-01 01:15:31 +01:00
Thomas Wolf 836b40be82 Merge pull request #72 from NirantK/patch-1 
Fix internal hyperlink typo
 2018-11-30 23:33:53 +01:00
Thomas Wolf 66d50ca6ae Merge pull request #73 from huggingface/third-release 
Third release
 2018-11-30 23:10:30 +01:00
Thomas Wolf 8c7267f1cf Merge pull request #70 from deepset-ai/fix_lm_loss 
fix typo in input for masked lm loss function
 2018-11-30 18:23:46 +01:00
Thomas Wolf 3951c2c189 Merge pull request #60 from davidefiocco/patch-1 
Updated quick-start example with `BertForMaskedLM`
 2018-11-28 14:59:08 +01:00
Thomas Wolf 21f0196412 Merge pull request #58 from lliimsft/master 
Bug fix in examples;correct t_total for distributed training;run pred…
 2018-11-28 12:39:45 +01:00
Thomas Wolf 60e01ac427 fix link in readme 2018-11-21 12:08:30 +01:00
Thomas Wolf 061eeca84a Merge pull request #32 from xiaoda99/master 
Fix ineffective no_decay bug when using BERTAdam
 2018-11-20 10:11:46 +01:00
Thomas Wolf fd32ebed81 Merge pull request #42 from weiyumou/master 
Fixed UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2
 2018-11-20 10:09:50 +01:00