c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
790 Commits 171 Branches 49 Tags
3bf3f9596fe58b244ceed9e4a8d454e9717b8ea2
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf 3fc63f126d Merge pull request #598 from burcturkoglu/master 
Updating learning rate with special warm up in examples
 2019-05-10 13:48:12 +02:00
Thomas Wolf 701bd59b8b Merge pull request #585 from huntzhan/master 
Make the epsilon of LayerNorm configurable.
 2019-05-08 16:56:38 +02:00
Thomas Wolf 303b5e2b92 Merge pull request #545 from ailzhang/cache_dir 
move pytroch_pretrained_bert cache folder under same path as torch
 2019-05-08 16:55:27 +02:00
Thomas Wolf 0198399d84 Merge pull request #570 from MottoX/fix-1 
Create optimizer only when args.do_train is True
 2019-05-08 16:07:50 +02:00
Thomas Wolf 50fa92c026 Merge pull request #571 from MottoX/patch-1 
Fix documentation typo
 2019-05-08 16:06:13 +02:00
Thomas Wolf 3ae8c8be1e Merge pull request #562 from apappu97/roc_stories_lmlabels_fix 
Small fix to remove shifting of lm labels during pre process of RocStories.
 2019-05-01 11:20:17 +02:00
Thomas Wolf e89520175d Merge pull request #564 from 8enmann/patch-2 
Fix #537
 2019-05-01 11:18:46 +02:00
Thomas Wolf 2dee86319d Merge pull request #527 from Mathieu-Prouveur/fix_value_training_loss 
Update example files so that tr_loss is not affected by args.gradient…
 2019-04-30 11:12:55 +02:00
Thomas Wolf e6cf62d499 Merge pull request #488 from dhpollack/fix_multichoice 
fixed BertForMultipleChoice model init and forward pass
 2019-04-25 21:04:16 +02:00
Thomas Wolf 1cc1c3c344 Merge pull request #533 from lukovnikov/master 
Docs for new learning rate code
 2019-04-25 21:02:35 +02:00
Thomas Wolf dee8af4e46 Merge pull request #518 from huggingface/schedules_in_examples 
Fix training schedules in examples to match new API
 2019-04-25 21:01:04 +02:00
Thomas Wolf d76a57b0ba Merge pull request #506 from ailzhang/hubconf 
Hubconf
 2019-04-24 20:59:21 +02:00
Thomas Wolf c36cca075a Merge pull request #515 from Rocketknight1/master 
Fix --reduce_memory in finetune_on_pregenerated
 2019-04-23 10:30:23 +02:00
Thomas Wolf 99e02c3415 Merge pull request #512 from cynthia/master 
Fix indentation weirdness in GPT-2 example.
 2019-04-23 10:29:01 +02:00
Thomas Wolf 98cb7b2c51 Merge pull request #445 from lukovnikov/master 
Learning rate schedules improvement + extension
 2019-04-23 10:27:38 +02:00
Thomas Wolf 68a889ee43 Merge pull request #500 from huggingface/network 
Updating network handling
 2019-04-17 15:22:14 +02:00
Thomas Wolf 8407429d74 Merge pull request #494 from SudoSharma/patch-1 
Fix indentation for unconditional generation
 2019-04-17 11:11:36 +02:00
Thomas Wolf 2e153930cf Merge pull request #495 from SudoSharma/patch-2 
Fix gradient overflow issue during attention mask
 2019-04-17 11:10:36 +02:00
Thomas Wolf 46078e1b46 Merge pull request #496 from 8enmann/patch-1 
[run_gpt2.py] temperature should be a float, not int
 2019-04-17 11:08:54 +02:00
Thomas Wolf b8686130ca Merge pull request #498 from huggingface/GPT2_tokenization 
Gpt2 tokenization
 2019-04-17 11:06:41 +02:00
Thomas Wolf 3d78e226e6 Merge pull request #489 from huggingface/tokenization_serialization 
Better serialization for Tokenizers and Configuration classes - Also fix #466
 2019-04-16 08:49:54 +02:00
Thomas Wolf 64b6ef4db0 Merge pull request #490 from huggingface/better_finetuning_GPT_GPT-2 
Clean up GPT and GPT-2 losses computation
 2019-04-15 16:14:50 +02:00
Thomas Wolf 6b35cfd28f Merge pull request #423 from dhanajitb/master 
making unconditional generation work
 2019-04-15 11:01:53 +02:00
Thomas Wolf aff44f0c08 Merge branch 'master' into master 2019-04-15 10:58:34 +02:00
Thomas Wolf 7e7e4753c8 Merge pull request #480 from mboyanov/docs/cls_token_info 
Extend the BertForSequenceClassification docs to mention the special CLS token.
 2019-04-15 10:57:25 +02:00
Thomas Wolf bb61b747df Merge pull request #474 from jiesutd/master 
Fix tsv read error in Windows
 2019-04-15 10:56:48 +02:00
Thomas Wolf 7873d76464 Merge pull request #478 from Rocketknight1/master 
Added a helpful error for users with single-document corpuses - fixes # 452
 2019-04-15 10:55:57 +02:00
Thomas Wolf 616743330e Merge pull request #462 from 8enmann/master 
fix run_gpt2.py
 2019-04-11 21:54:46 +02:00
Thomas Wolf 2cdfb8b254 Merge pull request #467 from yaroslavvb/patch-2 
Update README.md
 2019-04-11 21:53:23 +02:00
Thomas Wolf 94980b529f Merge pull request #404 from CatalinVoss/fix_lm_loss 
Fix Language Modeling Loss
 2019-04-03 11:35:30 +02:00
Thomas Wolf 9ca25ce828 Merge pull request #427 from jeonsworld/patch-1 
fix sample_doc
 2019-04-03 11:26:58 +02:00
Thomas Wolf db4dccd1b5 Merge pull request #389 from lukovnikov/master 
Fix cosine schedule
 2019-04-03 11:21:43 +02:00
Thomas Wolf 404adcdabf Merge pull request #437 from MottoX/fix-link 
Fix links in README
 2019-04-02 11:40:46 +02:00
Thomas Wolf 2f80dbbc0d Merge pull request #430 from MottoX/master 
Fix typo in example code
 2019-04-02 10:41:56 +02:00
Thomas Wolf 94adad6be3 Merge pull request #435 from marpaia/training-fixes 
Fixes to the TensorFlow conversion tool
 2019-04-02 10:41:40 +02:00
Thomas Wolf ec5c1d6134 Merge pull request #425 from Separius/patch-1 
fix lm_finetuning's link
 2019-03-29 09:14:11 +01:00
Thomas Wolf 694e2117f3 Merge pull request #388 from ananyahjha93/master 
Added remaining GLUE tasks to 'run_classifier.py'
 2019-03-28 09:06:53 +01:00
Thomas Wolf f7c9dc8c99 Merge pull request #409 from ikuyamada/master 
Remove padding_idx from position_embeddings and token_type_embeddings
 2019-03-27 12:30:03 +01:00
Thomas Wolf cc8c2d2332 Merge pull request #396 from IndexFziQ/IndexFziQ 
add tqdm to the process of eval in examples/run_swag.py
 2019-03-27 12:03:26 +01:00
Thomas Wolf bbff03fbfc Merge pull request #394 from desireevl/master 
Minor change in README
 2019-03-27 12:03:00 +01:00
Thomas Wolf 2fb8ddeeff Merge pull request #392 from Rocketknight1/master 
Add full language model fine-tuning
 2019-03-27 12:02:36 +01:00
Thomas Wolf f3e5404880 Merge pull request #381 from tseretelitornike/master 
Added missing imports.
 2019-03-15 12:54:40 +01:00
Thomas Wolf d5c037c3ed Merge pull request #380 from yongbowin/patch-3 
typo in annotation
 2019-03-14 15:56:40 +01:00
Thomas Wolf 59e2bdd086 Merge pull request #379 from yongbowin/patch-2 
typo
 2019-03-14 10:17:18 +01:00
Thomas Wolf 76906372b0 Merge pull request #378 from huggingface/absolute_imports 
Add absolute imports to GPT, GPT-2, Transfo-XL and and fix empty nbest_predictions.json
 2019-03-14 10:00:47 +01:00
Thomas Wolf eecaaa734a Merge pull request #371 from yongbowin/patch-1 
Simplify code, delete redundancy line
 2019-03-14 09:03:32 +01:00
Thomas Wolf 9b03d67b83 Merge pull request #362 from Bharat123rox/patch-1 
Make the hyperlink of NVIDIA Apex clickable
 2019-03-11 09:08:51 +01:00
Thomas Wolf 8435d78f0c Merge pull request #361 from junjieqian/jqian/updateReadme 
Correct line number in README for classes
 2019-03-11 09:08:27 +01:00
Thomas Wolf 80790705e0 Merge pull request #359 from elonmuskceo/fix-typo 
Update run_gpt2.py
 2019-03-11 09:07:56 +01:00
Thomas Wolf 13aa13dbc0 Merge pull request #358 from cdjhz/patch-1 
add 'padding_idx=0' for BertEmbeddings
 2019-03-11 09:06:55 +01:00
Thomas Wolf c0660df5dd Merge pull request #357 from pglock/feature/354-use-dropout-layer-gpt 
Use Dropout Layer in OpenAIGPTMultipleChoiceHead
 2019-03-11 09:06:27 +01:00
Thomas Wolf 8e36da7acb Merge pull request #347 from jplehmann/feature/sst2-processor 
Processor for SST-2 task
 2019-03-06 09:48:27 +01:00
Thomas Wolf 21c88a07b7 Merge pull request #341 from potatochip/patch-1 
catch exception if pathlib not install
 2019-03-06 09:48:01 +01:00
Thomas Wolf 3c01dfb775 Merge pull request #338 from CatalinVoss/patch-3 
Fix top k generation for k != 0
 2019-03-06 09:47:33 +01:00
Thomas Wolf 477ec4b6cc Merge pull request #337 from CatalinVoss/patch-2 
Allow tokenization of sequences > 512 for caching
 2019-03-06 09:45:49 +01:00
Thomas Wolf 7b9e5a54b5 Merge pull request #327 from lukovnikov/master 
Issue#324: warmup linear fixes
 2019-03-06 09:44:56 +01:00
Thomas Wolf 4784b04f47 Merge pull request #325 from john-hewitt/master 
add BertTokenizer flag to skip basic tokenization
 2019-03-06 09:37:11 +01:00
Thomas Wolf 2152bfeae8 Merge pull request #316 from joelgrus/gpt2docs 
update documentation for gpt-2
 2019-02-24 09:38:29 +01:00
Thomas Wolf a5b3a89545 Merge pull request #310 from spolu/spolu-nits_gpt2 
Few small nits in GPT-2's README code examples
 2019-02-21 10:23:27 +01:00
Thomas Wolf cbb7fad319 Merge pull request #307 from guotong1988/patch-1 
Update README.md
 2019-02-21 09:25:19 +01:00
Thomas Wolf 97c815dae2 Merge pull request #305 from bkj/patch-1 
Update run_openai_gpt.py
 2019-02-20 21:24:06 +01:00
Thomas Wolf f50b82af04 Merge pull request #302 from yongbowin/master 
typo
 2019-02-20 14:14:02 +01:00
Thomas Wolf 8337740754 Merge pull request #295 from tnlin/master 
fix broken link in readme
 2019-02-19 14:00:28 +01:00
Thomas Wolf 3ca35b99ba Merge pull request #293 from davidefiocco/patch-2 
Minor README typos corrected
 2019-02-19 09:00:01 +01:00
Thomas Wolf 07ebe0fd06 Merge pull request #292 from sam-qordoba/patch-3 
Fix typo in `GPT2Model` code sample
 2019-02-18 21:07:39 +01:00
Thomas Wolf a25d056b7a update readme 2019-02-18 15:30:11 +01:00
Thomas Wolf 517d7c8624 update readme 2019-02-18 14:39:55 +01:00
Thomas Wolf ada22a1c9e more details in GPT-2 usage example 2019-02-18 14:37:41 +01:00
Thomas Wolf 522733f6cb readme typo fixes 2019-02-18 14:32:10 +01:00
Thomas Wolf 8f46cd1057 Merge pull request #288 from huggingface/gpt2 
forgot to add regex to requirements.txt :(
 2019-02-18 12:00:11 +01:00
Thomas Wolf 0856a231c0 Merge pull request #287 from huggingface/gpt2 
Gpt2
 2019-02-18 11:38:05 +01:00
Thomas Wolf 3a2f97db6f Merge pull request #286 from hendrycks/patch-1 
Update activation function docstring
 2019-02-17 15:30:46 +01:00
Thomas Wolf 5faf386652 Merge pull request #282 from wlhgtc/master 
Fix some bug about SQuAD code
 2019-02-15 10:06:51 +01:00
Thomas Wolf 0e774e57a6 Update readme 
Adding details on how to extract a full list of hidden states for the Transformer-XL
 2019-02-14 08:39:58 +01:00
Thomas Wolf c35d9d48d9 Merge pull request #275 from davidefiocco/patch-1 
--do_lower_case is duplicated in parser args
 2019-02-13 16:32:21 +01:00
Thomas Wolf 4e56da38d9 Merge pull request #268 from wangxiaodiu/master 
fixed a minor bug in README.md
 2019-02-13 10:19:25 +01:00
Thomas Wolf cdcb206e10 Merge pull request #273 from huggingface/update_to_fifth_release 
Update to fifth release
 2019-02-13 10:19:08 +01:00
Thomas Wolf 3c33499f87 fix typo in readme 2019-02-12 10:22:54 +01:00
Thomas Wolf 03cdb2a390 Merge pull request #254 from huggingface/python_2 
Adding OpenAI GPT and Transformer-XL models, compatibility with Python 2
 2019-02-11 14:19:26 +01:00
Thomas Wolf 2dfaf2f227 Merge pull request #261 from deepset-ai/rm_arg_lm_finetuning 
removing unused argument eval_batch_size from LM finetuning #256
 2019-02-08 10:36:03 +01:00
Thomas Wolf 58f0a2745c Merge pull request #258 from BoeingX/master 
Fix the undefined variable in squad example
 2019-02-06 20:33:18 +01:00
Thomas Wolf 848aae49e1 Merge branch 'master' into python_2 2019-02-06 00:13:20 +01:00
Thomas Wolf bd74632687 Merge pull request #251 from Iwontbecreative/active_loss_tok_classif 
Only keep the active part mof the loss for token classification
 2019-02-05 16:33:45 +01:00
Thomas Wolf fd223374f0 Merge pull request #208 from Liangtaiwan/mergesquad 
Merge run_squad.py and run_squad2.py
 2019-02-05 16:15:03 +01:00
Thomas Wolf 64ce900974 Merge pull request #248 from JoeDumoulin/squad1.1-fix 
fix prediction on run-squad.py example
 2019-02-05 16:00:51 +01:00
Thomas Wolf e9e77cd3c4 Merge pull request #218 from matej-svejda/master 
Fix learning rate problems in run_classifier.py
 2019-02-05 15:40:44 +01:00
Thomas Wolf 8f8bbd4a4c Merge pull request #244 from deepset-ai/prettify_lm_masking 
Avoid confusion of inplace LM masking
 2019-02-01 12:17:50 +01:00
Thomas Wolf e2d53d95b0 Merge pull request #242 from ksurya/argparse 
Fix argparse type error
 2019-02-01 12:14:55 +01:00
Thomas Wolf 7e0b415ab4 Merge pull request #240 from girishponkiya/patch-1 
Minor update in README
 2019-02-01 12:14:05 +01:00
Thomas Wolf 0a9d7c7edb Merge pull request #201 from Liangtaiwan/squad2_save_bug 
run_squad2 Don't save model if do not train
 2019-01-18 09:28:11 +01:00
Thomas Wolf f040a43cb3 Merge pull request #199 from davidefiocco/patch-1 
(very) minor update to README
 2019-01-16 23:51:52 +01:00
Thomas Wolf 647c983530 Merge pull request #193 from nhatchan/20190113_global_step 
Fix importing unofficial TF models
 2019-01-14 09:44:01 +01:00
Thomas Wolf 4e0cba1053 Merge pull request #191 from nhatchan/20190113_py35_finetune 
lm_finetuning compatibility with Python 3.5
 2019-01-14 09:40:07 +01:00
Thomas Wolf c94455651e Merge pull request #190 from nhatchan/20190113_finetune_doc 
Fix documentation (missing backslashes)
 2019-01-14 09:39:03 +01:00
Thomas Wolf 25eae7b0ae Merge pull request #189 from donglixp/patch-1 
[bug fix] args.do_lower_case is always True
 2019-01-14 09:38:37 +01:00
Thomas Wolf 35becc6d84 Merge pull request #182 from deepset-ai/fix_lowercase_and_saving 
add do_lower_case arg and adjust model saving for lm finetuning.
 2019-01-11 08:50:13 +01:00
Thomas Wolf e485829a41 Merge pull request #174 from abeljim/master 
Added Squad 2.0
 2019-01-10 23:40:45 +01:00
Thomas Wolf 7e60205bd3 Merge pull request #179 from likejazz/patch-2 
Fix it to run properly even if without `--do_train` param.
 2019-01-10 23:39:10 +01:00
Thomas Wolf 0dd5f55ac8 Merge pull request #172 from WrRan/never_split 
Never split some texts.
 2019-01-09 13:44:09 +01:00
Thomas Wolf e048c7f1c8 Merge pull request #171 from donglixp/patch-1 
LayerNorm initialization
 2019-01-07 12:44:46 +01:00