c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,718 Commits 171 Branches 49 Tags
562f864038cab68ca66925331c3f5cd7bf407a86
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wolf 562f864038 Merge branch 'master' into fix-xlnet-squad2.0 2019-12-21 12:48:10 +01:00
Thomas Wolf 8618bf15d6 Merge pull request #1736 from huggingface/fix-tf-xlnet 
Fix TFXLNet
 2019-12-21 12:42:05 +01:00
Thomas Wolf 2fa8737c44 Merge pull request #1586 from enzoampil/include_special_tokens_in_bert_examples 
Add special tokens to documentation for bert examples to resolve issue: #1561
 2019-12-21 12:36:11 +01:00
Thomas Wolf f15f087143 Merge pull request #1764 from DomHudson/bug-fix-1761 
Bug-fix: Roberta Embeddings Not Masked
 2019-12-21 12:13:27 +01:00
Thomas Wolf fae4d1c266 Merge pull request #2217 from aaugustin/test-parallelization 
Support running tests in parallel
 2019-12-21 11:54:23 +01:00
Thomas Wolf d0f8b9a978 Merge pull request #2244 from huggingface/fix-tok-pipe 
Fix Camembert and XLM-R `decode` method- Fix NER pipeline alignement
 2019-12-20 22:10:39 +01:00
Thomas Wolf a557836a70 Merge pull request #2191 from huggingface/fix_sp_np 
Numpy compatibility for sentence piece
 2019-12-20 22:08:08 +01:00
Thomas Wolf 8d5a47c79b Merge pull request #2243 from huggingface/fix-xlm-roberta 
fixing xlm-roberta tokenizer max_length and automodels
 2019-12-20 19:34:08 +01:00
Thomas Wolf 3a2c4e6f63 Merge pull request #1548 from huggingface/cli 
[2.2] - Command-line interface - Pipeline class
 2019-12-20 15:28:29 +01:00
Thomas Wolf 59941c5d1f Merge pull request #2189 from stefan-it/xlmr 
Add support for XLM-RoBERTa
 2019-12-20 13:26:38 +01:00
Thomas Wolf ff36e6d8d7 Merge pull request #2231 from huggingface/requests_user_agent 
[http] customizable requests user-agent
 2019-12-20 10:28:10 +01:00
Thomas Wolf f061606277 Merge pull request #2164 from huggingface/cleanup-configs 
[SMALL BREAKING CHANGE] Cleaning up configuration classes - Adding Model Cards
 2019-12-17 09:10:16 +01:00
Thomas Wolf a52d56c8d9 Merge branch 'master' into cleanup-configs 2019-12-14 09:43:07 +01:00
Thomas Wolf e92bcb7eb6 Merge pull request #1739 from huggingface/t5 
[WIP] Adding Google T5 model
 2019-12-14 09:40:43 +01:00
Thomas Wolf 110394b2ba Merge branch 'master' into t5 2019-12-13 16:03:32 +01:00
Thomas Wolf 90df44f0aa Merge pull request #2063 from guillaume-be/special_tokens_mask_value_not_used 
special_tokens_mask value was unused and calculated twice
 2019-12-12 08:21:46 +01:00
Thomas Wolf 707f9e9241 Merge pull request #2081 from pglock/patch-1 
handle string with only whitespaces as empty
 2019-12-12 08:20:43 +01:00
Thomas Wolf 137e20a846 Merge pull request #2075 from huggingface/check-link-validity 
Check link validity
 2019-12-12 08:09:12 +01:00
Thomas Wolf d5712f7cac Merge branch 'master' into check-link-validity 2019-12-12 08:00:51 +01:00
Thomas Wolf 9c58b236ef Merge pull request #2144 from huggingface/from-pretrained-from-url 
Allowing from_pretrained to load from url directly
 2019-12-12 07:43:40 +01:00
Thomas Wolf 386a93f0f8 Merge branch 'master' into from-pretrained-from-url 2019-12-12 07:31:05 +01:00
Thomas Wolf 2d103546ef Merge pull request #2148 from huggingface/fix_encode_plus 
Fix encode plus
 2019-12-12 07:24:47 +01:00
Thomas Wolf 51ae203290 Merge pull request #2129 from leopd/master 
Progress indicator improvements when downloading pre-trained models.
 2019-12-10 22:18:55 +01:00
Thomas Wolf e6cff60b4c Merge pull request #2069 from huggingface/cleaner-pt-tf-conversion 
clean up PT <=> TF conversion
 2019-12-10 15:34:08 +01:00
Thomas Wolf e57d00ee10 Merge pull request #1984 from huggingface/squad-refactor 
[WIP] Squad refactor
 2019-12-10 11:07:26 +01:00
Thomas Wolf ecabbf6d28 Merge pull request #2107 from huggingface/encoder-mask-shape 
create encoder attention mask from shape of hidden states
 2019-12-10 10:07:56 +01:00
Thomas Wolf 4cb9b60558 Merge pull request #2077 from patrickvonplaten/change_documentation_for_past_output_shape 
corrected documentation for past tensor shape for ctrl and gpt2 model
 2019-12-06 12:14:48 +01:00
Thomas Wolf 5482822a2b Merge pull request #2046 from jplu/tf2-ner-example 
Add NER TF2 example.
 2019-12-06 12:12:22 +01:00
Thomas Wolf fc1bb1f867 Merge pull request #2068 from huggingface/fix-2042 
Nicer error message when Bert's input is missing batch size
 2019-12-06 12:06:42 +01:00
Thomas Wolf bebaa14039 Merge pull request #2045 from aaugustin/remove-dead-code 
Remove dead code in tests.
 2019-12-05 14:41:56 +01:00
Thomas Wolf af077b15e2 Merge pull request #2065 from huggingface/fixing-camembert 
Fixing camembert tokenization
 2019-12-05 13:45:44 +01:00
Thomas Wolf 1f179f095f Merge pull request #2011 from AdityaSoni19031997/patch-1 
typo fix on the docs as per Pytorch v1.1+
 2019-12-05 12:39:04 +01:00
Thomas Wolf 1eaf44e713 Merge pull request #2007 from roskoN/xlnet_attention_fix 
fixed XLNet attention output for both attention streams whenever target_mapping is provided
 2019-12-05 12:32:39 +01:00
Thomas Wolf f9f395b21c Merge pull request #1735 from ondewo/tf-do-not-use-gpu-on-import 
Do not use GPU when importing transformers
 2019-12-05 11:56:48 +01:00
Thomas Wolf d425a4d60b Merge pull request #1870 from alexzubiaga/xlnet-for-token-classification 
XLNet for Token classification
 2019-12-05 09:54:09 +01:00
Thomas Wolf 1eb89ddf73 Merge pull request #2044 from huggingface/cli_upload 
CLI for authenticated file sharing
 2019-12-05 09:44:07 +01:00
Thomas Wolf cae641ff26 Merge pull request #1846 from tamuhey/patch/iss1845 
fix summary_type value of SequenceSummary
 2019-12-04 13:28:39 +01:00
Thomas Wolf f19a78a634 Merge pull request #1903 from valohai/master 
Valohai integration
 2019-12-03 16:13:01 +01:00
Thomas Wolf d100ad99c0 Merge pull request #2014 from aaugustin/mark-tf-auto-model-test-as-slow 
Mark tests in TFAutoModelTest as slow.
 2019-12-03 16:03:48 +01:00
Thomas Wolf 1ab8dc44b3 Merge pull request #1876 from huggingface/mean-fix 
Mean does not exist in TF2
 2019-11-29 09:26:33 +01:00
Thomas Wolf f0d22b6363 Merge pull request #1873 from stefan-it/distilbert-german 
German DistilBERT
 2019-11-29 09:25:47 +01:00
Thomas Wolf d49c43ff78 Merge pull request #1778 from eukaryote31/patch-2 
from_pretrained: convert DialoGPT format
 2019-11-28 16:08:37 +01:00
Thomas Wolf 91caf2462c Merge pull request #1770 from huggingface/initi-encoder-mask 
Only init encoder_attention_mask if stack is decoder
 2019-11-28 16:06:55 +01:00
Thomas Wolf 49a69d5b78 Merge pull request #1753 from digantamisra98/patch-1 
Added Mish Activation Function
 2019-11-28 15:24:08 +01:00
Thomas Wolf 96e7ee7238 Merge pull request #1740 from huggingface/fix-ctrl-past 
Fix CTRL past
 2019-11-27 23:28:30 +01:00
Thomas Wolf a36f981d1b Merge branch 'master' into fix-ctrl-past 2019-11-27 17:25:46 +01:00
Thomas Wolf 5afca00b47 Merge pull request #1724 from huggingface/fix_encode_plus 
Fix encode_plus
 2019-11-27 17:14:49 +01:00
Thomas Wolf 49108288ba Merge pull request #1624 from Huawei-MRC-OSI/resumable_http 
Add support for resumable downloads for HTTP protocol.
 2019-11-27 17:11:07 +01:00
Thomas Wolf 5340d1f21f Merge branch 'master' into resumable_http 2019-11-27 17:10:36 +01:00
Thomas Wolf 7fd1d42a01 Merge pull request #1592 from watkinsm/do_lower_case 
Consider do_lower_case in PreTrainedTokenizer
 2019-11-27 17:05:18 +01:00
Thomas Wolf 21637d4924 Merge branch 'master' into do_lower_case 2019-11-27 17:04:39 +01:00
Thomas Wolf 0cdfcca24b Merge pull request #1860 from stefan-it/camembert-for-token-classification 
[WIP] Add support for CamembertForTokenClassification
 2019-11-21 10:56:07 +01:00
Thomas Wolf 74ce8de7d8 Merge pull request #1792 from stefan-it/distilbert-for-token-classification 
DistilBERT for token classification
 2019-11-14 22:47:53 +01:00
Thomas Wolf 05db5bc1af added small comparison between BERT, RoBERTa and DistilBERT 2019-11-14 22:40:22 +01:00
Thomas Wolf 9629e2c676 Merge pull request #1804 from ronakice/master 
fix multi-gpu eval in torch examples
 2019-11-14 22:24:05 +01:00
Thomas Wolf 5b322a36db Merge pull request #1811 from huggingface/special-tokens 
Fix special tokens addition in decoder #1807
 2019-11-14 22:17:24 +01:00
Thomas Wolf 1a237d7f42 Merge pull request #1831 from iedmrc/gpt2-tokenization-sum-func-replacement 
sum() is replaced by itertools.chain.from_iterable()
 2019-11-14 22:11:54 +01:00
Thomas Wolf df99f8c5a1 Merge pull request #1832 from huggingface/memory-leak-schedulers 
replace LambdaLR scheduler wrappers by function
 2019-11-14 22:10:31 +01:00
Thomas Wolf 0be9ae7b3e Merge pull request #1833 from huggingface/max-length-warning 
Token indices sequence length is longer than the specified maximum sequence length for this model
 2019-11-14 22:04:49 +01:00
Thomas Wolf e99071f105 Merge pull request #1734 from orena1/patch-1 
add progress bar to convert_examples_to_features
 2019-11-05 11:34:20 +01:00
Thomas Wolf ba973342e3 Merge pull request #1553 from WilliamTambellini/timeSquadInference 
Add speed log to examples/run_squad.py
 2019-11-05 11:13:12 +01:00
Thomas Wolf 237fad339c Merge pull request #1709 from oneraghavan/master 
Fixing mode in evaluate during training
 2019-11-05 10:55:33 +01:00
Thomas Wolf d2e2577dd3 Merge pull request #1723 from huggingface/fix-1623 
Fix #1623
 2019-11-05 08:36:30 +01:00
Thomas Wolf c8f2712199 Merge pull request #1721 from huggingface/common_attributes 
Add common getter and setter for input_embeddings & output_embeddings
 2019-11-04 16:21:52 +01:00
Thomas Wolf 1d4d070256 Merge pull request #1549 from hlums/master 
Fix token order in xlnet preprocessing for SQuAD
 2019-11-04 15:37:15 +01:00
Thomas Wolf 9a3b173cd3 Merge branch 'master' into master 2019-11-04 11:41:26 +01:00
Thomas Wolf 8a62835577 Merge pull request #1679 from cregouby/master 
Fix https://github.com/huggingface/transformers/issues/1673
 2019-11-01 22:02:24 +01:00
Thomas Wolf c7058d8224 Merge pull request #1608 from focox/master 
Error raised by "tmp_eval_loss += tmp_eval_loss.item()" when using multi-gpu
 2019-10-30 17:14:07 +01:00
Thomas Wolf 22838f19fd Merge pull request #1668 from tlkh/fix-tf-xlm 
Fixed training for TF XLM
 2019-10-30 17:08:00 +01:00
Thomas Wolf 7f84fc571a Merge pull request #1670 from huggingface/templates 
Templates and explanation for adding a new model and example script
 2019-10-30 17:05:58 +01:00
Thomas Wolf 04c69db399 Merge pull request #1628 from huggingface/tfglue 
run_tf_glue works with all tasks
 2019-10-30 17:04:03 +01:00
Thomas Wolf 5c6a19a94a Merge pull request #1604 from huggingface/deploy_doc 
Versioning in documentation
 2019-10-30 17:03:14 +01:00
Thomas Wolf 3df4367244 Merge pull request #1601 from huggingface/clean-roberta 
Clean roberta model & all tokenizers now add special tokens by default (breaking change)
 2019-10-30 17:00:40 +01:00
Thomas Wolf 6d73c92cae Merge pull request #1455 from huggingface/conditional-generation 
[WIP] Sequence generation using pretrained BERT
 2019-10-30 16:54:18 +01:00
Thomas Wolf 36174696cc Merge branch 'master' into clean-roberta 2019-10-30 16:51:06 +01:00
Thomas Wolf 228cdd6a6e Merge branch 'master' into conditional-generation 2019-10-30 16:40:35 +01:00
Thomas WolfandStefan Schweter 55fbfea369 Update CONTRIBUTING.md 
Co-Authored-By: Stefan Schweter <stefan.schweter@bsb-muenchen.de>
 2019-10-30 12:25:40 +01:00
Thomas WolfandStefan Schweter cef2a8f900 Update CONTRIBUTING.md 
Co-Authored-By: Stefan Schweter <stefan.schweter@bsb-muenchen.de>
 2019-10-30 12:25:31 +01:00
Thomas Wolf b8c9ea0010 Merge pull request #1580 from pminervini/master 
Gradient norm clipping should be done right before calling the optimiser
 2019-10-22 13:59:20 +02:00
Thomas Wolf 0e64fec1ab Merge pull request #1568 from daemon/patch-1 
Fix hanging when loading pretrained models
 2019-10-21 14:31:57 +02:00
Thomas Wolf 40f14ff545 Merge pull request #1513 from slayton58/amp_fp16_einsum 
Force einsum to run in fp16
 2019-10-15 10:25:00 +02:00
Thomas Wolf e703e4dfe1 Merge pull request #1509 from julian-pani/patch-3 
remove leftover usage of DUMMY_INPUTS
 2019-10-15 10:24:13 +02:00
Thomas Wolf d147671c6c Merge pull request #1508 from tlkh/master 
Added performance enhancements (XLA, AMP) to examples
 2019-10-15 09:57:18 +02:00
Thomas Wolf 08bd8f9f39 Merge pull request #1505 from e-budur/master 
Fixed the sample code in the title 'Quick tour'.
 2019-10-15 09:50:36 +02:00
Thomas Wolf 8aa3b753bd Merge pull request #1434 from bryant1410/patch-1 
Remove unnecessary use of FusedLayerNorm in XLNet
 2019-10-15 09:44:19 +02:00
Thomas Wolf 621e7a2529 Merge pull request #1275 from stecklin/ner-fine-tuning 
Implement fine-tuning BERT on CoNLL-2003 named entity recognition task
 2019-10-15 09:35:24 +02:00
Thomas Wolf 80889a0226 Merge pull request #1512 from louismartin/fix-roberta-convert 
Fix import error in script to convert faisreq roberta checkpoints
 2019-10-14 17:40:32 +02:00
Thomas Wolf f62f992cf7 Merge pull request #1502 from jeffxtang/master 
the working example code to use BertForQuestionAnswering
 2019-10-14 16:14:52 +02:00
Thomas Wolf 4428aefc63 Merge pull request #1488 from huggingface/pytorch-tpu 
GLUE on TPU
 2019-10-11 16:33:00 +02:00
Thomas Wolf 3b43b01872 Merge pull request #1482 from huggingface/tf2_integration_tests 
Integration of TF 2.0 models with other Keras modules
 2019-10-11 16:25:43 +02:00
Thomas Wolf 700331b5ec Merge pull request #1492 from stefan-it/bert-german-dbmdz-models 
Add new BERT models for German (cased and uncased)
 2019-10-11 13:01:52 +02:00
Thomas Wolf 573dde9b44 Merge pull request #1405 from slayton58/xlnet_layer_reorder 
Re-order XLNet attention head outputs for better perf
 2019-10-11 12:10:58 +02:00
Thomas Wolf 6596e3d566 Merge pull request #1454 from bkkaggle/pytorch-built-in-tensorboard 
Change tensorboard imports to use built-in tensorboard if available
 2019-10-10 11:56:55 +02:00
Thomas Wolf 4bc4601192 Merge pull request #1480 from huggingface/fix_ctrl_tokenizer 
Fixing CTRL tokenizer - Update error messages - XLM-MLM in run_generation
 2019-10-10 11:56:20 +02:00
Thomas Wolf 58b302caf3 Merge pull request #1398 from dveselov/patch-1 
Fixed typo in docs README
 2019-10-09 03:52:42 +02:00
Thomas Wolf 439fac723a Merge pull request #1409 from brian41005/master 
Evaluation result.txt path changing #1286
 2019-10-09 03:14:34 +02:00
Thomas Wolf 1615360c71 Merge pull request #1438 from SeanBE/master 
fix pytorch-transformers migration description in README
 2019-10-07 05:02:23 -04:00
Thomas Wolf b3cfd97946 Merge pull request #1373 from TimYagan/fix-css 
Fixed critical css font-family issues
 2019-10-03 19:04:02 -04:00
Thomas Wolf 1569610f2d Merge pull request #1296 from danai-antoniou/add-duplicate-tokens-error 
Added ValueError for duplicates in list of added tokens
 2019-10-03 17:06:17 -04:00
Thomas Wolf 963529e29b Merge pull request #1288 from echan00/master 
Typo with LM Fine tuning script
 2019-10-01 18:46:07 -04:00