c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,768 Commits 171 Branches 49 Tags
4f2b6579bf59b033e5eda27a51d4192e9c2d2623
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf ca559826c4 Merge pull request #1349 from ogabrielluiz/master 
Just some typos
 2019-09-27 13:08:00 +02:00
Thomas Wolf d83d295763 Merge pull request #1337 from mgrankin/fastdataset 
faster dataset building
 2019-09-27 10:35:12 +02:00
Thomas Wolf f6de000305 Merge pull request #1346 from BramVanroy/documentation 
Add small  note about the output of hidden states (closes #1332)
 2019-09-27 10:30:07 +02:00
Thomas Wolf 17ea43cf98 Merge pull request #1203 from huggingface/tf2 
[2.0] TF 2.0 support
 2019-09-26 12:11:03 +02:00
Thomas Wolf 4a233e5b2c Merge pull request #1315 from bryant1410/patch-1 
Remove unnecessary use of FusedLayerNorm
 2019-09-26 08:50:02 +02:00
Thomas Wolf e8e956dbb2 Merge pull request #1327 from huggingface/tf2-determinism 
Pytorch/TF2 determinism
 2019-09-24 22:49:57 +02:00
Thomas Wolf e4022d96f7 Merge pull request #1325 from huggingface/glue-included 
[Proposal] GLUE processors included in library
 2019-09-24 21:40:10 +02:00
Thomas Wolf 7c0f2d0a6a Merge pull request #1294 from sshleifer/delete-n-special-doc 
Delete n_special reference in docstring
 2019-09-23 14:54:55 +01:00
Thomas Wolf 0d1dad6d53 Merge pull request #1004 from erenup/master 
Refactoring old run_swag.py
 2019-09-18 21:42:51 +02:00
Thomas Wolf b62abe87c9 Merge pull request #1249 from ziliwang/master 
fixed: hard coding for max and min number will out of range in fp16, which will cause nan.
 2019-09-11 15:53:28 +02:00
Thomas Wolf 23c23f5399 Merge pull request #1229 from SKRohit/master 
changes in evaluate function in run_lm_finetuning.py
 2019-09-10 22:16:45 +02:00
Thomas Wolf 99a54ac51c Merge pull request #1233 from searchivarius/master 
Fix to prevent crashing on assert len(tokens_b)>=1
 2019-09-10 22:15:47 +02:00
Thomas Wolf 439b37b474 Merge pull request #1241 from mattolson93/patch-1 
Fixing typo in gpt2 for doc site's class link
 2019-09-10 22:14:18 +02:00
Thomas Wolf 2c177a87eb Merge pull request #1228 from huggingface/head-masking-test 
Trying to fix the head masking test
 2019-09-10 11:55:27 +02:00
Thomas Wolf 84d346b687 Merge pull request #1195 from huggingface/reorder_arguments 
[2.0] Reodering arguments for torch jit #1010 and future TF2.0 compatibility
 2019-09-09 15:42:51 +03:00
Thomas Wolf 3f05de6dde Merge branch 'master' into reorder_arguments 2019-09-09 15:42:25 +03:00
Thomas Wolf 995e38b7af Merge pull request #1214 from huggingface/new-examples 
Better examples
 2019-09-09 10:26:36 +03:00
Thomas Wolf 5ac8b62265 Merge pull request #1205 from maru0kun/patch-2 
Fix typo
 2019-09-05 21:44:16 +02:00
Thomas Wolf ed717635ff Merge pull request #1201 from huggingface/configuration_refactoring 
[2.0] - Split configuration and modeling files
 2019-09-05 21:16:58 +02:00
Thomas Wolf 9fd6e7ab9f Merge pull request #1190 from shijie-wu/xlm-tokenization 
Fix reference of import in XLM tokenization
 2019-09-04 12:50:49 +02:00
Thomas Wolf 0287d264e9 Merge pull request #1162 from huggingface/xlnet-bias 
XLNet bias fix on resize embeddings (cf #1124)
 2019-09-02 23:14:04 +02:00
Thomas Wolf 7b0c99add9 Merge pull request #1174 from huggingface/fix_byte_level_added_tokens 
Fix byte-level BPE decoding error when using added tokens
 2019-09-02 09:01:16 +02:00
Thomas Wolf b6cd856b08 Merge pull request #1164 from stefan-it/master 
distillation: fix ModuleNotFoundError error in token counts script
 2019-09-02 02:00:07 +02:00
Thomas Wolf ff7368eb6b Merge pull request #1077 from huggingface/pruning-save-and-load 
Pruning changes so that deleted heads are kept on save/load
 2019-09-01 09:42:15 +02:00
Thomas Wolf 51e980ce36 Merge pull request #1155 from anhnt170489/apex_fp16 
Update apex fp16 implementation
 2019-08-30 23:29:11 +02:00
Thomas Wolf 206c35e9a4 Merge pull request #1154 from ziliwang/master 
fix: hard coding for max number
 2019-08-30 23:23:08 +02:00
Thomas Wolf f3d18c71ec Merge pull request #1152 from epwalsh/fix-special-tokens 
fix adding special tokens
 2019-08-30 23:21:59 +02:00
Thomas Wolf d483cd8e46 Merge pull request #1074 from huggingface/improved_testing 
Shortcut to special tokens' ids - fix GPT2 & RoBERTa tokenizers - improved testing for GPT/GPT-2
 2019-08-30 23:18:58 +02:00
Thomas Wolf d2f21f08f5 Merge pull request #1092 from shijie-wu/xlm-tokenization 
Added cleaned configuration properties for tokenizer with serialization - improve tokenization of XLM
 2019-08-30 23:15:40 +02:00
Thomas Wolf 12b9cc9e26 Merge pull request #1110 from huggingface/automodels 
Torch.hub now based on AutoModels - Updating AutoModels with AutoModelWithLMHead, Sequence Classification and Question Answering
 2019-08-30 23:08:57 +02:00
Thomas Wolf cd65c41a83 Merge branch 'master' into xlm-tokenization 2019-08-30 17:15:16 +02:00
Thomas Wolf b66e9b4433 Merge pull request #1158 from rabeehk/master 
regarding #1026 pull request
 2019-08-30 16:30:33 +02:00
Thomas Wolf 0a2fecdf90 Merge branch 'master' into master 2019-08-30 16:30:08 +02:00
Thomas Wolf 41f35d0b3d Merge pull request #1089 from dhpollack/dhp/use_pytorch_layernorm 
change layernorm code to pytorch's native layer norm
 2019-08-30 14:49:08 +02:00
Thomas Wolf 01ad55f8cf Merge pull request #1026 from rabeehk/master 
loads the tokenizer for each checkpoint, to solve the reproducability…
 2019-08-30 14:15:36 +02:00
Thomas Wolf 50e615f43d Merge branch 'master' into improved_testing 2019-08-30 13:40:35 +02:00
Thomas Wolf f7978490b2 Merge pull request #1148 from huggingface/circleci 
Documentation auto-deploy
 2019-08-30 13:28:16 +02:00
Thomas Wolf 5f297c7be3 Merge pull request #1087 from huggingface/fix-warnings 
Decode now calls private property instead of public method
 2019-08-28 22:22:11 +02:00
Thomas Wolf d9847678b3 Merge pull request #1136 from adai183/update_SQuAD_script 
swap order of optimizer.step() and scheduler.step()
 2019-08-28 22:00:52 +02:00
Thomas Wolf 0f8ad89206 Merge pull request #1135 from stefan-it/master 
distilbert: fix number of hidden_size
 2019-08-28 22:00:12 +02:00
Thomas Wolf 0ecfd17f49 Merge pull request #987 from huggingface/generative-finetuning 
Generative finetuning
 2019-08-28 16:51:50 +02:00
Thomas Wolf 50792dbdcc Merge pull request #1127 from huggingface/dilbert 
DilBERT
 2019-08-28 16:43:09 +02:00
Thomas Wolf d06c5a2a0a Merge pull request #1120 from CrafterKolyan/patch-3 
Change attention mask dtype to be bool. Fix #1119
 2019-08-27 15:01:01 +02:00
Thomas Wolf edc5222fc3 Merge pull request #1118 from CrafterKolyan/patch-2 
Documentation fix #1117
 2019-08-27 14:58:50 +02:00
Thomas Wolf 9cf298dfc1 Merge pull request #1116 from CrafterKolyan/patch-1 
Delete nonexistent parameter from documentation fix #1115
 2019-08-27 14:56:43 +02:00
Thomas Wolf df9d6effae Merge pull request #1081 from huggingface/fix_distributed_barrier_hang 
Fix distributed barrier hang
 2019-08-23 16:53:53 +02:00
Thomas Wolf 3f20dd7186 Merge pull request #1075 from abhishekraok/modeling_utils_config_None 
reraise EnvironmentError in modeling_utils.py
 2019-08-23 12:42:39 +02:00
Thomas Wolf 90dcd8c05d Merge branch 'master' into generative-finetuning 2019-08-22 10:43:30 +02:00
Thomas Wolf 07681b6b58 Merge pull request #1064 from huggingface/gpt-2-large 
Adding gpt-2 large (774M parameters) model
 2019-08-21 03:05:56 +02:00
Thomas Wolf e4515faf54 Merge pull request #1057 from huggingface/fixes 
Add a few of typos corrections, bugs fixes and small improvements
 2019-08-21 01:54:05 +02:00
Thomas Wolf 41789c6c3d Merge pull request #1059 from GuillemGSubies/master 
Better use of spacy tokenizer in open ai and xlm tokenizers
 2019-08-21 01:53:48 +02:00
Thomas Wolf 260c86082d Merge pull request #1027 from samvelyan/iterative_split_on_token 
Re-implemented tokenize() iteratively in PreTrainedTokenizer.
 2019-08-21 01:46:03 +02:00
Thomas Wolf d30cbaf5dc Merge branch 'master' into iterative_split_on_token 2019-08-21 01:33:02 +02:00
Thomas Wolf 9beaa85b07 Merge pull request #1055 from qipeng/run_squad_fix 
Fix #1015 (tokenizer defaults to use_lower_case=True when loading from trained models)
 2019-08-21 01:20:46 +02:00
Thomas Wolf e753f249e1 Merge pull request #806 from wschin/fix-a-path 
Fix a path so that a test can run on Windows
 2019-08-21 01:14:40 +02:00
Thomas Wolf c3619f5536 Merge pull request #1060 from CrafterKolyan/patch-1 
Fix typo. configuratoin -> configuration
 2019-08-20 17:39:06 +02:00
Thomas Wolf 3b56427a1e Merge pull request #1040 from FeiWang96/multi_gpu 
Fix bug of multi-gpu training in lm finetuning
 2019-08-20 17:13:44 +02:00
Thomas Wolf 933841d903 Merge pull request #1056 from Morizeyao/master 
Swap of optimizer.step and scheduler.step for lm finetuning examples
 2019-08-20 12:42:24 +02:00
Thomas Wolf 5a49b793d9 Merge pull request #1023 from tuvuumass/patch-1 
fix issue #824
 2019-08-19 15:31:46 +02:00
Thomas Wolf 7729ef7381 Merge pull request #955 from FeiWang96/master 
Fix comment typo
 2019-08-07 10:11:25 +02:00
Thomas Wolf 5c6ecf37e7 Merge pull request #958 from saket404/typo-fix 
Fixed small typo
 2019-08-07 10:10:20 +02:00
Thomas Wolf b4f9464f90 Merge pull request #960 from ethanjperez/patch-1 
Fixing unused weight_decay argument
 2019-08-07 10:09:55 +02:00
Thomas Wolf 822d6768eb Merge pull request #962 from guotong1988/patch-1 
Update modeling_xlnet.py
 2019-08-07 10:09:20 +02:00
Thomas Wolf 7e6102ce74 Merge pull request #963 from guotong1988/patch-2 
Update modeling_bert.py
 2019-08-07 10:09:04 +02:00
Thomas Wolf 3773ba44f0 Merge pull request #977 from chrisgzf/master 
Fixed typo in migration guide
 2019-08-07 10:08:45 +02:00
Thomas Wolf a80aa03bda Merge pull request #973 from FeiWang96/bert_config 
Fix examples of loading pretrained models in docstring
 2019-08-07 10:08:22 +02:00
Thomas Wolf 4fc9f9ef54 Merge pull request #910 from huggingface/auto_models 
Adding AutoTokenizer and AutoModel classes that automatically detect architecture - Clean up tokenizers
 2019-08-05 19:17:47 +02:00
Thomas Wolf d43dc48b34 Merge branch 'master' into auto_models 2019-08-05 19:17:35 +02:00
Thomas Wolf 0e918707dc Merge pull request #907 from dhpollack/fix_convert_to_tf 
Fix convert to tf
 2019-08-05 12:55:04 +02:00
Thomas Wolf 6b763d04a9 Merge pull request #911 from huggingface/small_fixes 
Small fixes
 2019-07-26 21:36:21 +02:00
Thomas Wolf c054b5ee64 Merge pull request #896 from zijunsun/master 
fix multi-gpu training bug when using fp16
 2019-07-26 19:31:02 +02:00
Thomas Wolf 46cc9dd2b5 Merge pull request #899 from sukuya/master 
Fixed import to use torchscript flag.
 2019-07-25 15:03:21 +02:00
Thomas Wolf 6219ad7216 Merge pull request #888 from rococode/patch-1 
Update docs for parameter rename
 2019-07-25 15:01:22 +02:00
Thomas Wolf 0b6122e96a Merge pull request #882 from Liangtaiwan/squad_v1_bug 
fix squad v1 error (na_prob_file should be None)
 2019-07-25 14:59:59 +02:00
Thomas Wolf c244562cae Merge pull request #893 from joelgrus/patch-2 
make save_pretrained do the right thing with added tokens
 2019-07-25 14:58:48 +02:00
Thomas Wolf 067923d326 Merge pull request #873 from huggingface/identity_replacement 
Add nn.Identity replacement for old PyTorch
 2019-07-23 18:16:35 +02:00
Thomas Wolf 368670ac31 Merge pull request #866 from xanlsh/master 
Rework how PreTrainedModel.from_pretrained handles its arguments
 2019-07-23 18:05:30 +02:00
Thomas Wolf fec76a481d Update readme 2019-07-23 16:05:29 +02:00
Thomas Wolf 859c441776 Merge pull request #872 from huggingface/saving_schedules 
Updating schedules for state_dict saving/loading
 2019-07-23 16:03:06 +02:00
Thomas Wolf 268c6cc160 Merge pull request #845 from rabeehk/master 
fixed version issues in run_openai_gpt
 2019-07-23 15:29:31 +02:00
Thomas Wolf 1d7d01c080 Merge pull request #847 from lpq29743/master 
typos
 2019-07-23 15:28:31 +02:00
Thomas Wolf c4bc66886d Merge pull request #860 from Yiqing-Zhou/patch-1 
read().splitlines() -> readlines()
 2019-07-23 15:24:25 +02:00
Thomas Wolf a615499076 Merge pull request #797 from yzy5630/fix-examples 
fix some errors for distributed lm_finetuning
 2019-07-18 23:32:33 +02:00
Thomas Wolf dbecfcf321 Merge pull request #815 from praateekmahajan/update-readme-link 
Update Readme link for Fine Tune/Usage section
 2019-07-18 18:30:32 +02:00
Thomas Wolf 4bcddf6fc8 Merge pull request #801 from bzantium/master 
import sys twice
 2019-07-17 12:31:26 +02:00
Thomas Wolf 506ab34d0e Merge pull request #796 from stefan-it/minor-doc-updates 
Minor documentation updates
 2019-07-17 12:26:34 +02:00
Thomas Wolf b33a385091 update readme 2019-07-16 16:18:37 +02:00
Thomas Wolf 69dc010936 Merge pull request #786 from huggingface/doc-sphinx 
New documentation for pytorch-transformers
 2019-07-13 12:08:57 +02:00
Thomas Wolf 292140b921 Merge pull request #781 from huggingface/embeddings 
Clean up input embeddings resizing and weights tying
 2019-07-12 11:10:25 +02:00
Thomas Wolf c57e9d946f Merge branch 'xlnet' into embeddings 2019-07-12 11:10:14 +02:00
Thomas Wolf e4f9dca018 Merge pull request #773 from huggingface/doc-sphinx 
Sphinx doc, XLM Checkpoints
 2019-07-11 15:46:39 +02:00
Thomas Wolf b87eb82b4f Merge branch 'xlnet' into doc-sphinx 2019-07-11 15:46:27 +02:00
Thomas Wolf d216e798af Merge pull request #777 from huggingface/examples 
Working GLUE Example for XLNet (STS-B)
 2019-07-11 15:43:47 +02:00
Thomas Wolf 9dd2c86033 Merge pull request #767 from huggingface/doc 
Documentation
 2019-07-09 16:56:34 +02:00
Thomas Wolf 78462aad61 Merge pull request #733 from ceremonious/parallel-generation 
Added option to use multiple workers to create training data
 2019-07-05 12:04:30 +02:00
Thomas Wolf 781124b0d1 Merge pull request #620 from chrislarson1/convert-back-to-tf 
Convert pytorch models back to tensorflow
 2019-07-05 12:01:17 +02:00
Thomas Wolf e5fe2bb5e8 Merge pull request #745 from leimao/leimao 
fix evaluation bug
 2019-07-05 12:00:04 +02:00
Thomas Wolf 175fce0a55 Merge pull request #758 from huggingface/doc 
Release 0.7 - Add tokenizer API + tests
 2019-07-05 11:22:03 +02:00
Thomas Wolf 64ce4dbd86 Merge pull request #748 from huggingface/torchscript 
Release 0.7 - Add Torchscript capabilities
 2019-07-03 22:52:03 +02:00
Thomas Wolf dad3c7a485 Merge pull request #723 from tonianelope/master 
Update Adam optimizer to follow pytorch convention for betas parameter (#510)
 2019-06-28 17:28:25 +02:00