c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,342 Commits 171 Branches 49 Tags
1dc43e56c9116dc1a200ea13512bd7788c448837
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf df9d6effae Merge pull request #1081 from huggingface/fix_distributed_barrier_hang 
Fix distributed barrier hang
 2019-08-23 16:53:53 +02:00
Thomas Wolf 3f20dd7186 Merge pull request #1075 from abhishekraok/modeling_utils_config_None 
reraise EnvironmentError in modeling_utils.py
 2019-08-23 12:42:39 +02:00
Thomas Wolf 07681b6b58 Merge pull request #1064 from huggingface/gpt-2-large 
Adding gpt-2 large (774M parameters) model
 2019-08-21 03:05:56 +02:00
Thomas Wolf e4515faf54 Merge pull request #1057 from huggingface/fixes 
Add a few of typos corrections, bugs fixes and small improvements
 2019-08-21 01:54:05 +02:00
Thomas Wolf 41789c6c3d Merge pull request #1059 from GuillemGSubies/master 
Better use of spacy tokenizer in open ai and xlm tokenizers
 2019-08-21 01:53:48 +02:00
Thomas Wolf 260c86082d Merge pull request #1027 from samvelyan/iterative_split_on_token 
Re-implemented tokenize() iteratively in PreTrainedTokenizer.
 2019-08-21 01:46:03 +02:00
Thomas Wolf d30cbaf5dc Merge branch 'master' into iterative_split_on_token 2019-08-21 01:33:02 +02:00
Thomas Wolf 9beaa85b07 Merge pull request #1055 from qipeng/run_squad_fix 
Fix #1015 (tokenizer defaults to use_lower_case=True when loading from trained models)
 2019-08-21 01:20:46 +02:00
Thomas Wolf e753f249e1 Merge pull request #806 from wschin/fix-a-path 
Fix a path so that a test can run on Windows
 2019-08-21 01:14:40 +02:00
Thomas Wolf c3619f5536 Merge pull request #1060 from CrafterKolyan/patch-1 
Fix typo. configuratoin -> configuration
 2019-08-20 17:39:06 +02:00
Thomas Wolf 3b56427a1e Merge pull request #1040 from FeiWang96/multi_gpu 
Fix bug of multi-gpu training in lm finetuning
 2019-08-20 17:13:44 +02:00
Thomas Wolf 933841d903 Merge pull request #1056 from Morizeyao/master 
Swap of optimizer.step and scheduler.step for lm finetuning examples
 2019-08-20 12:42:24 +02:00
Thomas Wolf 5a49b793d9 Merge pull request #1023 from tuvuumass/patch-1 
fix issue #824
 2019-08-19 15:31:46 +02:00
Thomas Wolf 7729ef7381 Merge pull request #955 from FeiWang96/master 
Fix comment typo
 2019-08-07 10:11:25 +02:00
Thomas Wolf 5c6ecf37e7 Merge pull request #958 from saket404/typo-fix 
Fixed small typo
 2019-08-07 10:10:20 +02:00
Thomas Wolf b4f9464f90 Merge pull request #960 from ethanjperez/patch-1 
Fixing unused weight_decay argument
 2019-08-07 10:09:55 +02:00
Thomas Wolf 822d6768eb Merge pull request #962 from guotong1988/patch-1 
Update modeling_xlnet.py
 2019-08-07 10:09:20 +02:00
Thomas Wolf 7e6102ce74 Merge pull request #963 from guotong1988/patch-2 
Update modeling_bert.py
 2019-08-07 10:09:04 +02:00
Thomas Wolf 3773ba44f0 Merge pull request #977 from chrisgzf/master 
Fixed typo in migration guide
 2019-08-07 10:08:45 +02:00
Thomas Wolf a80aa03bda Merge pull request #973 from FeiWang96/bert_config 
Fix examples of loading pretrained models in docstring
 2019-08-07 10:08:22 +02:00
Thomas Wolf 4fc9f9ef54 Merge pull request #910 from huggingface/auto_models 
Adding AutoTokenizer and AutoModel classes that automatically detect architecture - Clean up tokenizers
 2019-08-05 19:17:47 +02:00
Thomas Wolf d43dc48b34 Merge branch 'master' into auto_models 2019-08-05 19:17:35 +02:00
Thomas Wolf 0e918707dc Merge pull request #907 from dhpollack/fix_convert_to_tf 
Fix convert to tf
 2019-08-05 12:55:04 +02:00
Thomas Wolf 6b763d04a9 Merge pull request #911 from huggingface/small_fixes 
Small fixes
 2019-07-26 21:36:21 +02:00
Thomas Wolf c054b5ee64 Merge pull request #896 from zijunsun/master 
fix multi-gpu training bug when using fp16
 2019-07-26 19:31:02 +02:00
Thomas Wolf 46cc9dd2b5 Merge pull request #899 from sukuya/master 
Fixed import to use torchscript flag.
 2019-07-25 15:03:21 +02:00
Thomas Wolf 6219ad7216 Merge pull request #888 from rococode/patch-1 
Update docs for parameter rename
 2019-07-25 15:01:22 +02:00
Thomas Wolf 0b6122e96a Merge pull request #882 from Liangtaiwan/squad_v1_bug 
fix squad v1 error (na_prob_file should be None)
 2019-07-25 14:59:59 +02:00
Thomas Wolf c244562cae Merge pull request #893 from joelgrus/patch-2 
make save_pretrained do the right thing with added tokens
 2019-07-25 14:58:48 +02:00
Thomas Wolf 067923d326 Merge pull request #873 from huggingface/identity_replacement 
Add nn.Identity replacement for old PyTorch
 2019-07-23 18:16:35 +02:00
Thomas Wolf 368670ac31 Merge pull request #866 from xanlsh/master 
Rework how PreTrainedModel.from_pretrained handles its arguments
 2019-07-23 18:05:30 +02:00
Thomas Wolf fec76a481d Update readme 2019-07-23 16:05:29 +02:00
Thomas Wolf 859c441776 Merge pull request #872 from huggingface/saving_schedules 
Updating schedules for state_dict saving/loading
 2019-07-23 16:03:06 +02:00
Thomas Wolf 268c6cc160 Merge pull request #845 from rabeehk/master 
fixed version issues in run_openai_gpt
 2019-07-23 15:29:31 +02:00
Thomas Wolf 1d7d01c080 Merge pull request #847 from lpq29743/master 
typos
 2019-07-23 15:28:31 +02:00
Thomas Wolf c4bc66886d Merge pull request #860 from Yiqing-Zhou/patch-1 
read().splitlines() -> readlines()
 2019-07-23 15:24:25 +02:00
Thomas Wolf a615499076 Merge pull request #797 from yzy5630/fix-examples 
fix some errors for distributed lm_finetuning
 2019-07-18 23:32:33 +02:00
Thomas Wolf dbecfcf321 Merge pull request #815 from praateekmahajan/update-readme-link 
Update Readme link for Fine Tune/Usage section
 2019-07-18 18:30:32 +02:00
Thomas Wolf 4bcddf6fc8 Merge pull request #801 from bzantium/master 
import sys twice
 2019-07-17 12:31:26 +02:00
Thomas Wolf 506ab34d0e Merge pull request #796 from stefan-it/minor-doc-updates 
Minor documentation updates
 2019-07-17 12:26:34 +02:00
Thomas Wolf b33a385091 update readme 2019-07-16 16:18:37 +02:00
Thomas Wolf 69dc010936 Merge pull request #786 from huggingface/doc-sphinx 
New documentation for pytorch-transformers
 2019-07-13 12:08:57 +02:00
Thomas Wolf 292140b921 Merge pull request #781 from huggingface/embeddings 
Clean up input embeddings resizing and weights tying
 2019-07-12 11:10:25 +02:00
Thomas Wolf c57e9d946f Merge branch 'xlnet' into embeddings 2019-07-12 11:10:14 +02:00
Thomas Wolf e4f9dca018 Merge pull request #773 from huggingface/doc-sphinx 
Sphinx doc, XLM Checkpoints
 2019-07-11 15:46:39 +02:00
Thomas Wolf b87eb82b4f Merge branch 'xlnet' into doc-sphinx 2019-07-11 15:46:27 +02:00
Thomas Wolf d216e798af Merge pull request #777 from huggingface/examples 
Working GLUE Example for XLNet (STS-B)
 2019-07-11 15:43:47 +02:00
Thomas Wolf 9dd2c86033 Merge pull request #767 from huggingface/doc 
Documentation
 2019-07-09 16:56:34 +02:00
Thomas Wolf 78462aad61 Merge pull request #733 from ceremonious/parallel-generation 
Added option to use multiple workers to create training data
 2019-07-05 12:04:30 +02:00
Thomas Wolf 781124b0d1 Merge pull request #620 from chrislarson1/convert-back-to-tf 
Convert pytorch models back to tensorflow
 2019-07-05 12:01:17 +02:00
Thomas Wolf e5fe2bb5e8 Merge pull request #745 from leimao/leimao 
fix evaluation bug
 2019-07-05 12:00:04 +02:00
Thomas Wolf 175fce0a55 Merge pull request #758 from huggingface/doc 
Release 0.7 - Add tokenizer API + tests
 2019-07-05 11:22:03 +02:00
Thomas Wolf 64ce4dbd86 Merge pull request #748 from huggingface/torchscript 
Release 0.7 - Add Torchscript capabilities
 2019-07-03 22:52:03 +02:00
Thomas Wolf dad3c7a485 Merge pull request #723 from tonianelope/master 
Update Adam optimizer to follow pytorch convention for betas parameter (#510)
 2019-06-28 17:28:25 +02:00
Thomas Wolf e296d5bef1 Merge pull request #704 from deepset-ai/master 
Adjust s3 german Bert file storage
 2019-06-28 17:10:58 +02:00
Thomas Wolf c68b4eceed Merge pull request #718 from Rocketknight1/master 
Incorrect docstring for BertForMaskedLM
 2019-06-28 17:08:51 +02:00
Thomas Wolf 98dc30b21e Merge pull request #714 from papower1/master 
Correct a broken link on README
 2019-06-22 21:29:41 +02:00
Thomas Wolf eae5d3819d Merge pull request #715 from Rocketknight1/master 
Include a reference for LM finetuning
 2019-06-22 21:29:19 +02:00
Thomas Wolf 12e892e174 Merge pull request #697 from huggingface/updating_examples 
Updating examples
 2019-06-20 09:58:24 +02:00
Thomas Wolf 3763f8944d Merge pull request #696 from huggingface/split_config_weights 
Split config weights
 2019-06-18 11:42:57 +02:00
Thomas Wolf a6f2511811 Merge pull request #694 from huggingface/release_0.6.3 
Release 0.6.3
 2019-06-17 16:27:25 +02:00
Thomas Wolf 80684f6f86 Merge pull request #690 from shashwath94/projadpsftmax_fix 
Transformer XL ProjectedAdaptiveLogSoftmax output fix
 2019-06-15 23:14:10 +02:00
Thomas Wolf 9e363703d6 Merge pull request #688 from deepset-ai/german_bert 
Add German Bert model to code, update readme
 2019-06-15 23:13:41 +02:00
Thomas Wolf cc6cd430f7 Merge pull request #691 from vanche/master 
import class "GPT2MultipleChoiceHead"
 2019-06-15 23:12:55 +02:00
Thomas Wolf b3f9e9451b Merge pull request #687 from huggingface/tests_and_doc 
Updating tests and doc
 2019-06-14 17:23:45 +02:00
Thomas Wolf cad88e19de Merge pull request #672 from oliverguhr/master 
Add vocabulary and model config to the finetune output
 2019-06-14 17:02:47 +02:00
Thomas Wolf c6de625229 Merge pull request #655 from huggingface/finish_torchhub_interfaces 
Finish torchhub interfaces
 2019-06-14 17:02:08 +02:00
Thomas Wolf ff276fc00c Merge branch 'master' into finish_torchhub_interfaces 2019-06-14 16:59:07 +02:00
Thomas Wolf a64736dc23 Merge pull request #646 from Colanim/patch-1 
Fix link in README
 2019-06-14 16:57:45 +02:00
Thomas Wolf 460d9afd45 Merge pull request #640 from Barqawiz/master 
Support latest multi language bert fine tune
 2019-06-14 16:57:02 +02:00
Thomas Wolf 277c77f1c5 Merge pull request #630 from tguens/master 
Update run_squad.py
 2019-06-14 16:56:26 +02:00
Thomas Wolf 659af2cbd0 Merge pull request #604 from samuelbroscheit/master 
Fixing issue "Training beyond specified 't_total' steps with schedule 'warmup_linear'" reported in #556
 2019-06-14 16:49:24 +02:00
Thomas Wolf 2d6a53490d Merge pull request #597 from huggingface/attention 
GPT-2 (medium size model, special_tokens, fine-tuning, attention) + repo code coverage metric
 2019-06-14 16:47:32 +02:00
Thomas Wolf 35e6baab37 Merge branch 'master' into attention 2019-06-14 16:41:56 +02:00
Thomas Wolf f9cde97b31 Merge pull request #675 from meetshah1995/patch-1 
[hotfix] Fix frozen pooler parameters in SWAG example.
 2019-06-12 10:01:21 +02:00
Thomas Wolf 784c0ed89a Merge pull request #668 from jeonsworld/patch-2 
apply Whole Word Masking technique
 2019-06-11 11:29:10 +02:00
Thomas Wolf 2a329c6186 Merge pull request #651 from huggingface/gpt_torchhub 
Add GPT* compatibility to torchhub
 2019-05-31 14:44:52 +02:00
Thomas Wolf 3fc63f126d Merge pull request #598 from burcturkoglu/master 
Updating learning rate with special warm up in examples
 2019-05-10 13:48:12 +02:00
Thomas Wolf 701bd59b8b Merge pull request #585 from huntzhan/master 
Make the epsilon of LayerNorm configurable.
 2019-05-08 16:56:38 +02:00
Thomas Wolf 303b5e2b92 Merge pull request #545 from ailzhang/cache_dir 
move pytroch_pretrained_bert cache folder under same path as torch
 2019-05-08 16:55:27 +02:00
Thomas Wolf 0198399d84 Merge pull request #570 from MottoX/fix-1 
Create optimizer only when args.do_train is True
 2019-05-08 16:07:50 +02:00
Thomas Wolf 50fa92c026 Merge pull request #571 from MottoX/patch-1 
Fix documentation typo
 2019-05-08 16:06:13 +02:00
Thomas Wolf 3ae8c8be1e Merge pull request #562 from apappu97/roc_stories_lmlabels_fix 
Small fix to remove shifting of lm labels during pre process of RocStories.
 2019-05-01 11:20:17 +02:00
Thomas Wolf e89520175d Merge pull request #564 from 8enmann/patch-2 
Fix #537
 2019-05-01 11:18:46 +02:00
Thomas Wolf 2dee86319d Merge pull request #527 from Mathieu-Prouveur/fix_value_training_loss 
Update example files so that tr_loss is not affected by args.gradient…
 2019-04-30 11:12:55 +02:00
Thomas Wolf e6cf62d499 Merge pull request #488 from dhpollack/fix_multichoice 
fixed BertForMultipleChoice model init and forward pass
 2019-04-25 21:04:16 +02:00
Thomas Wolf 1cc1c3c344 Merge pull request #533 from lukovnikov/master 
Docs for new learning rate code
 2019-04-25 21:02:35 +02:00
Thomas Wolf dee8af4e46 Merge pull request #518 from huggingface/schedules_in_examples 
Fix training schedules in examples to match new API
 2019-04-25 21:01:04 +02:00
Thomas Wolf d76a57b0ba Merge pull request #506 from ailzhang/hubconf 
Hubconf
 2019-04-24 20:59:21 +02:00
Thomas Wolf c36cca075a Merge pull request #515 from Rocketknight1/master 
Fix --reduce_memory in finetune_on_pregenerated
 2019-04-23 10:30:23 +02:00
Thomas Wolf 99e02c3415 Merge pull request #512 from cynthia/master 
Fix indentation weirdness in GPT-2 example.
 2019-04-23 10:29:01 +02:00
Thomas Wolf 98cb7b2c51 Merge pull request #445 from lukovnikov/master 
Learning rate schedules improvement + extension
 2019-04-23 10:27:38 +02:00
Thomas Wolf 68a889ee43 Merge pull request #500 from huggingface/network 
Updating network handling
 2019-04-17 15:22:14 +02:00
Thomas Wolf 8407429d74 Merge pull request #494 from SudoSharma/patch-1 
Fix indentation for unconditional generation
 2019-04-17 11:11:36 +02:00
Thomas Wolf 2e153930cf Merge pull request #495 from SudoSharma/patch-2 
Fix gradient overflow issue during attention mask
 2019-04-17 11:10:36 +02:00
Thomas Wolf 46078e1b46 Merge pull request #496 from 8enmann/patch-1 
[run_gpt2.py] temperature should be a float, not int
 2019-04-17 11:08:54 +02:00
Thomas Wolf b8686130ca Merge pull request #498 from huggingface/GPT2_tokenization 
Gpt2 tokenization
 2019-04-17 11:06:41 +02:00
Thomas Wolf 3d78e226e6 Merge pull request #489 from huggingface/tokenization_serialization 
Better serialization for Tokenizers and Configuration classes - Also fix #466
 2019-04-16 08:49:54 +02:00
Thomas Wolf 64b6ef4db0 Merge pull request #490 from huggingface/better_finetuning_GPT_GPT-2 
Clean up GPT and GPT-2 losses computation
 2019-04-15 16:14:50 +02:00
Thomas Wolf 6b35cfd28f Merge pull request #423 from dhanajitb/master 
making unconditional generation work
 2019-04-15 11:01:53 +02:00