c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
981 Commits 171 Branches 49 Tags
269e73b6011f87f4d5e6fea47f8fee11dfcdf2cc
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf 64ce4dbd86 Merge pull request #748 from huggingface/torchscript 
Release 0.7 - Add Torchscript capabilities
 2019-07-03 22:52:03 +02:00
Thomas Wolf 12e892e174 Merge pull request #697 from huggingface/updating_examples 
Updating examples
 2019-06-20 09:58:24 +02:00
Thomas Wolf 3763f8944d Merge pull request #696 from huggingface/split_config_weights 
Split config weights
 2019-06-18 11:42:57 +02:00
Thomas Wolf a6f2511811 Merge pull request #694 from huggingface/release_0.6.3 
Release 0.6.3
 2019-06-17 16:27:25 +02:00
Thomas Wolf 80684f6f86 Merge pull request #690 from shashwath94/projadpsftmax_fix 
Transformer XL ProjectedAdaptiveLogSoftmax output fix
 2019-06-15 23:14:10 +02:00
Thomas Wolf 9e363703d6 Merge pull request #688 from deepset-ai/german_bert 
Add German Bert model to code, update readme
 2019-06-15 23:13:41 +02:00
Thomas Wolf cc6cd430f7 Merge pull request #691 from vanche/master 
import class "GPT2MultipleChoiceHead"
 2019-06-15 23:12:55 +02:00
Thomas Wolf b3f9e9451b Merge pull request #687 from huggingface/tests_and_doc 
Updating tests and doc
 2019-06-14 17:23:45 +02:00
Thomas Wolf cad88e19de Merge pull request #672 from oliverguhr/master 
Add vocabulary and model config to the finetune output
 2019-06-14 17:02:47 +02:00
Thomas Wolf c6de625229 Merge pull request #655 from huggingface/finish_torchhub_interfaces 
Finish torchhub interfaces
 2019-06-14 17:02:08 +02:00
Thomas Wolf ff276fc00c Merge branch 'master' into finish_torchhub_interfaces 2019-06-14 16:59:07 +02:00
Thomas Wolf a64736dc23 Merge pull request #646 from Colanim/patch-1 
Fix link in README
 2019-06-14 16:57:45 +02:00
Thomas Wolf 460d9afd45 Merge pull request #640 from Barqawiz/master 
Support latest multi language bert fine tune
 2019-06-14 16:57:02 +02:00
Thomas Wolf 277c77f1c5 Merge pull request #630 from tguens/master 
Update run_squad.py
 2019-06-14 16:56:26 +02:00
Thomas Wolf 659af2cbd0 Merge pull request #604 from samuelbroscheit/master 
Fixing issue "Training beyond specified 't_total' steps with schedule 'warmup_linear'" reported in #556
 2019-06-14 16:49:24 +02:00
Thomas Wolf 2d6a53490d Merge pull request #597 from huggingface/attention 
GPT-2 (medium size model, special_tokens, fine-tuning, attention) + repo code coverage metric
 2019-06-14 16:47:32 +02:00
Thomas Wolf 35e6baab37 Merge branch 'master' into attention 2019-06-14 16:41:56 +02:00
Thomas Wolf f9cde97b31 Merge pull request #675 from meetshah1995/patch-1 
[hotfix] Fix frozen pooler parameters in SWAG example.
 2019-06-12 10:01:21 +02:00
Thomas Wolf 784c0ed89a Merge pull request #668 from jeonsworld/patch-2 
apply Whole Word Masking technique
 2019-06-11 11:29:10 +02:00
Thomas Wolf 2a329c6186 Merge pull request #651 from huggingface/gpt_torchhub 
Add GPT* compatibility to torchhub
 2019-05-31 14:44:52 +02:00
Thomas Wolf 3fc63f126d Merge pull request #598 from burcturkoglu/master 
Updating learning rate with special warm up in examples
 2019-05-10 13:48:12 +02:00
Thomas Wolf 701bd59b8b Merge pull request #585 from huntzhan/master 
Make the epsilon of LayerNorm configurable.
 2019-05-08 16:56:38 +02:00
Thomas Wolf 303b5e2b92 Merge pull request #545 from ailzhang/cache_dir 
move pytroch_pretrained_bert cache folder under same path as torch
 2019-05-08 16:55:27 +02:00
Thomas Wolf 0198399d84 Merge pull request #570 from MottoX/fix-1 
Create optimizer only when args.do_train is True
 2019-05-08 16:07:50 +02:00
Thomas Wolf 50fa92c026 Merge pull request #571 from MottoX/patch-1 
Fix documentation typo
 2019-05-08 16:06:13 +02:00
Thomas Wolf 3ae8c8be1e Merge pull request #562 from apappu97/roc_stories_lmlabels_fix 
Small fix to remove shifting of lm labels during pre process of RocStories.
 2019-05-01 11:20:17 +02:00
Thomas Wolf e89520175d Merge pull request #564 from 8enmann/patch-2 
Fix #537
 2019-05-01 11:18:46 +02:00
Thomas Wolf 2dee86319d Merge pull request #527 from Mathieu-Prouveur/fix_value_training_loss 
Update example files so that tr_loss is not affected by args.gradient…
 2019-04-30 11:12:55 +02:00
Thomas Wolf e6cf62d499 Merge pull request #488 from dhpollack/fix_multichoice 
fixed BertForMultipleChoice model init and forward pass
 2019-04-25 21:04:16 +02:00
Thomas Wolf 1cc1c3c344 Merge pull request #533 from lukovnikov/master 
Docs for new learning rate code
 2019-04-25 21:02:35 +02:00
Thomas Wolf dee8af4e46 Merge pull request #518 from huggingface/schedules_in_examples 
Fix training schedules in examples to match new API
 2019-04-25 21:01:04 +02:00
Thomas Wolf d76a57b0ba Merge pull request #506 from ailzhang/hubconf 
Hubconf
 2019-04-24 20:59:21 +02:00
Thomas Wolf c36cca075a Merge pull request #515 from Rocketknight1/master 
Fix --reduce_memory in finetune_on_pregenerated
 2019-04-23 10:30:23 +02:00
Thomas Wolf 99e02c3415 Merge pull request #512 from cynthia/master 
Fix indentation weirdness in GPT-2 example.
 2019-04-23 10:29:01 +02:00
Thomas Wolf 98cb7b2c51 Merge pull request #445 from lukovnikov/master 
Learning rate schedules improvement + extension
 2019-04-23 10:27:38 +02:00
Thomas Wolf 68a889ee43 Merge pull request #500 from huggingface/network 
Updating network handling
 2019-04-17 15:22:14 +02:00
Thomas Wolf 8407429d74 Merge pull request #494 from SudoSharma/patch-1 
Fix indentation for unconditional generation
 2019-04-17 11:11:36 +02:00
Thomas Wolf 2e153930cf Merge pull request #495 from SudoSharma/patch-2 
Fix gradient overflow issue during attention mask
 2019-04-17 11:10:36 +02:00
Thomas Wolf 46078e1b46 Merge pull request #496 from 8enmann/patch-1 
[run_gpt2.py] temperature should be a float, not int
 2019-04-17 11:08:54 +02:00
Thomas Wolf b8686130ca Merge pull request #498 from huggingface/GPT2_tokenization 
Gpt2 tokenization
 2019-04-17 11:06:41 +02:00
Thomas Wolf 3d78e226e6 Merge pull request #489 from huggingface/tokenization_serialization 
Better serialization for Tokenizers and Configuration classes - Also fix #466
 2019-04-16 08:49:54 +02:00
Thomas Wolf 64b6ef4db0 Merge pull request #490 from huggingface/better_finetuning_GPT_GPT-2 
Clean up GPT and GPT-2 losses computation
 2019-04-15 16:14:50 +02:00
Thomas Wolf 6b35cfd28f Merge pull request #423 from dhanajitb/master 
making unconditional generation work
 2019-04-15 11:01:53 +02:00
Thomas Wolf aff44f0c08 Merge branch 'master' into master 2019-04-15 10:58:34 +02:00
Thomas Wolf 7e7e4753c8 Merge pull request #480 from mboyanov/docs/cls_token_info 
Extend the BertForSequenceClassification docs to mention the special CLS token.
 2019-04-15 10:57:25 +02:00
Thomas Wolf bb61b747df Merge pull request #474 from jiesutd/master 
Fix tsv read error in Windows
 2019-04-15 10:56:48 +02:00
Thomas Wolf 7873d76464 Merge pull request #478 from Rocketknight1/master 
Added a helpful error for users with single-document corpuses - fixes # 452
 2019-04-15 10:55:57 +02:00
Thomas Wolf 616743330e Merge pull request #462 from 8enmann/master 
fix run_gpt2.py
 2019-04-11 21:54:46 +02:00
Thomas Wolf 2cdfb8b254 Merge pull request #467 from yaroslavvb/patch-2 
Update README.md
 2019-04-11 21:53:23 +02:00
Thomas Wolf 94980b529f Merge pull request #404 from CatalinVoss/fix_lm_loss 
Fix Language Modeling Loss
 2019-04-03 11:35:30 +02:00
Thomas Wolf 9ca25ce828 Merge pull request #427 from jeonsworld/patch-1 
fix sample_doc
 2019-04-03 11:26:58 +02:00
Thomas Wolf db4dccd1b5 Merge pull request #389 from lukovnikov/master 
Fix cosine schedule
 2019-04-03 11:21:43 +02:00
Thomas Wolf 404adcdabf Merge pull request #437 from MottoX/fix-link 
Fix links in README
 2019-04-02 11:40:46 +02:00
Thomas Wolf 2f80dbbc0d Merge pull request #430 from MottoX/master 
Fix typo in example code
 2019-04-02 10:41:56 +02:00
Thomas Wolf 94adad6be3 Merge pull request #435 from marpaia/training-fixes 
Fixes to the TensorFlow conversion tool
 2019-04-02 10:41:40 +02:00
Thomas Wolf ec5c1d6134 Merge pull request #425 from Separius/patch-1 
fix lm_finetuning's link
 2019-03-29 09:14:11 +01:00
Thomas Wolf 694e2117f3 Merge pull request #388 from ananyahjha93/master 
Added remaining GLUE tasks to 'run_classifier.py'
 2019-03-28 09:06:53 +01:00
Thomas Wolf f7c9dc8c99 Merge pull request #409 from ikuyamada/master 
Remove padding_idx from position_embeddings and token_type_embeddings
 2019-03-27 12:30:03 +01:00
Thomas Wolf cc8c2d2332 Merge pull request #396 from IndexFziQ/IndexFziQ 
add tqdm to the process of eval in examples/run_swag.py
 2019-03-27 12:03:26 +01:00
Thomas Wolf bbff03fbfc Merge pull request #394 from desireevl/master 
Minor change in README
 2019-03-27 12:03:00 +01:00
Thomas Wolf 2fb8ddeeff Merge pull request #392 from Rocketknight1/master 
Add full language model fine-tuning
 2019-03-27 12:02:36 +01:00
Thomas Wolf f3e5404880 Merge pull request #381 from tseretelitornike/master 
Added missing imports.
 2019-03-15 12:54:40 +01:00
Thomas Wolf d5c037c3ed Merge pull request #380 from yongbowin/patch-3 
typo in annotation
 2019-03-14 15:56:40 +01:00
Thomas Wolf 59e2bdd086 Merge pull request #379 from yongbowin/patch-2 
typo
 2019-03-14 10:17:18 +01:00
Thomas Wolf 76906372b0 Merge pull request #378 from huggingface/absolute_imports 
Add absolute imports to GPT, GPT-2, Transfo-XL and and fix empty nbest_predictions.json
 2019-03-14 10:00:47 +01:00
Thomas Wolf eecaaa734a Merge pull request #371 from yongbowin/patch-1 
Simplify code, delete redundancy line
 2019-03-14 09:03:32 +01:00
Thomas Wolf 9b03d67b83 Merge pull request #362 from Bharat123rox/patch-1 
Make the hyperlink of NVIDIA Apex clickable
 2019-03-11 09:08:51 +01:00
Thomas Wolf 8435d78f0c Merge pull request #361 from junjieqian/jqian/updateReadme 
Correct line number in README for classes
 2019-03-11 09:08:27 +01:00
Thomas Wolf 80790705e0 Merge pull request #359 from elonmuskceo/fix-typo 
Update run_gpt2.py
 2019-03-11 09:07:56 +01:00
Thomas Wolf 13aa13dbc0 Merge pull request #358 from cdjhz/patch-1 
add 'padding_idx=0' for BertEmbeddings
 2019-03-11 09:06:55 +01:00
Thomas Wolf c0660df5dd Merge pull request #357 from pglock/feature/354-use-dropout-layer-gpt 
Use Dropout Layer in OpenAIGPTMultipleChoiceHead
 2019-03-11 09:06:27 +01:00
Thomas Wolf 8e36da7acb Merge pull request #347 from jplehmann/feature/sst2-processor 
Processor for SST-2 task
 2019-03-06 09:48:27 +01:00
Thomas Wolf 21c88a07b7 Merge pull request #341 from potatochip/patch-1 
catch exception if pathlib not install
 2019-03-06 09:48:01 +01:00
Thomas Wolf 3c01dfb775 Merge pull request #338 from CatalinVoss/patch-3 
Fix top k generation for k != 0
 2019-03-06 09:47:33 +01:00
Thomas Wolf 477ec4b6cc Merge pull request #337 from CatalinVoss/patch-2 
Allow tokenization of sequences > 512 for caching
 2019-03-06 09:45:49 +01:00
Thomas Wolf 7b9e5a54b5 Merge pull request #327 from lukovnikov/master 
Issue#324: warmup linear fixes
 2019-03-06 09:44:56 +01:00
Thomas Wolf 4784b04f47 Merge pull request #325 from john-hewitt/master 
add BertTokenizer flag to skip basic tokenization
 2019-03-06 09:37:11 +01:00
Thomas Wolf 2152bfeae8 Merge pull request #316 from joelgrus/gpt2docs 
update documentation for gpt-2
 2019-02-24 09:38:29 +01:00
Thomas Wolf a5b3a89545 Merge pull request #310 from spolu/spolu-nits_gpt2 
Few small nits in GPT-2's README code examples
 2019-02-21 10:23:27 +01:00
Thomas Wolf cbb7fad319 Merge pull request #307 from guotong1988/patch-1 
Update README.md
 2019-02-21 09:25:19 +01:00
Thomas Wolf 97c815dae2 Merge pull request #305 from bkj/patch-1 
Update run_openai_gpt.py
 2019-02-20 21:24:06 +01:00
Thomas Wolf f50b82af04 Merge pull request #302 from yongbowin/master 
typo
 2019-02-20 14:14:02 +01:00
Thomas Wolf 8337740754 Merge pull request #295 from tnlin/master 
fix broken link in readme
 2019-02-19 14:00:28 +01:00
Thomas Wolf 3ca35b99ba Merge pull request #293 from davidefiocco/patch-2 
Minor README typos corrected
 2019-02-19 09:00:01 +01:00
Thomas Wolf 07ebe0fd06 Merge pull request #292 from sam-qordoba/patch-3 
Fix typo in `GPT2Model` code sample
 2019-02-18 21:07:39 +01:00
Thomas Wolf a25d056b7a update readme 2019-02-18 15:30:11 +01:00
Thomas Wolf 517d7c8624 update readme 2019-02-18 14:39:55 +01:00
Thomas Wolf ada22a1c9e more details in GPT-2 usage example 2019-02-18 14:37:41 +01:00
Thomas Wolf 522733f6cb readme typo fixes 2019-02-18 14:32:10 +01:00
Thomas Wolf 8f46cd1057 Merge pull request #288 from huggingface/gpt2 
forgot to add regex to requirements.txt :(
 2019-02-18 12:00:11 +01:00
Thomas Wolf 0856a231c0 Merge pull request #287 from huggingface/gpt2 
Gpt2
 2019-02-18 11:38:05 +01:00
Thomas Wolf 3a2f97db6f Merge pull request #286 from hendrycks/patch-1 
Update activation function docstring
 2019-02-17 15:30:46 +01:00
Thomas Wolf 5faf386652 Merge pull request #282 from wlhgtc/master 
Fix some bug about SQuAD code
 2019-02-15 10:06:51 +01:00
Thomas Wolf 0e774e57a6 Update readme 
Adding details on how to extract a full list of hidden states for the Transformer-XL
 2019-02-14 08:39:58 +01:00
Thomas Wolf c35d9d48d9 Merge pull request #275 from davidefiocco/patch-1 
--do_lower_case is duplicated in parser args
 2019-02-13 16:32:21 +01:00
Thomas Wolf 4e56da38d9 Merge pull request #268 from wangxiaodiu/master 
fixed a minor bug in README.md
 2019-02-13 10:19:25 +01:00
Thomas Wolf cdcb206e10 Merge pull request #273 from huggingface/update_to_fifth_release 
Update to fifth release
 2019-02-13 10:19:08 +01:00
Thomas Wolf 3c33499f87 fix typo in readme 2019-02-12 10:22:54 +01:00
Thomas Wolf 03cdb2a390 Merge pull request #254 from huggingface/python_2 
Adding OpenAI GPT and Transformer-XL models, compatibility with Python 2
 2019-02-11 14:19:26 +01:00
Thomas Wolf 2dfaf2f227 Merge pull request #261 from deepset-ai/rm_arg_lm_finetuning 
removing unused argument eval_batch_size from LM finetuning #256
 2019-02-08 10:36:03 +01:00