c-my/transformers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
5d178954c909141363df4513eb5f0cc80e5e829c
transformers/src/transformers
T
History
Sam Shleifer b2505f7db7 Cleanup bart caching logic (#5640)
2020-07-14 06:13:05 -04:00
..
benchmark
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
commands
doc: fix apparent copy-paste error in docstring (#5626)
2020-07-14 09:47:41 +02:00
data
[squad] add version tag to squad cache (#5669)
2020-07-10 16:34:21 -04:00
__init__.py
[Reformer classification head] Implement the reformer model classification head for text classification (#5198)
2020-07-14 09:16:22 +02:00
activations.py
Allow gpt2 to be exported to valid ONNX (#4244)
2020-05-11 14:55:55 -04:00
configuration_albert.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_auto.py
Add MobileBert (#4901)
2020-06-19 16:38:36 -04:00
configuration_bart.py
Add BART-base modeling and configuration (#5315)
2020-06-27 00:53:10 +08:00
configuration_bert.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_camembert.py
Kill model archive maps (#4636)
2020-06-02 09:39:33 -04:00
configuration_ctrl.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_distilbert.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_dpr.py
Add DPR model (#5279)
2020-07-07 08:56:12 -04:00
configuration_electra.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_encoder_decoder.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_flaubert.py
Kill model archive maps (#4636)
2020-06-02 09:39:33 -04:00
configuration_gpt2.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_longformer.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_marian.py
Kill model archive maps (#4636)
2020-06-02 09:39:33 -04:00
configuration_mmbt.py
Updated Configurations
2020-01-14 14:09:09 +01:00
configuration_mobilebert.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_openai.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_reformer.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_retribert.py
Eli5 examples (#4968)
2020-06-16 16:36:58 -04:00
configuration_roberta.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_t5.py
improve doc (#5185)
2020-06-22 19:00:11 +02:00
configuration_transfo_xl.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_utils.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
configuration_xlm_roberta.py
Kill model archive maps (#4636)
2020-06-02 09:39:33 -04:00
configuration_xlm.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
configuration_xlnet.py
Fixed use of memories in XLNet (caching for language generation + warning when loading improper memoryless model) (#5632)
2020-07-10 17:38:36 +02:00
convert_albert_original_tf_checkpoint_to_pytorch.py
Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057)
2020-05-07 19:44:51 -04:00
convert_bart_original_pytorch_checkpoint_to_pytorch.py
Fix CI after killing archive maps (#4724)
2020-06-02 10:21:09 -04:00
convert_bert_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
convert_bert_pytorch_checkpoint_to_original_tf.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py
[dialogpt] conversion script
2020-03-10 15:09:29 -04:00
convert_dpr_original_checkpoint_to_pytorch.py
Add DPR model (#5279)
2020-07-07 08:56:12 -04:00
convert_electra_original_tf_checkpoint_to_pytorch.py
ELECTRA (#3257)
2020-04-03 14:10:54 -04:00
convert_gpt2_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_graph_to_onnx.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
convert_longformer_original_pytorch_lightning_to_pytorch.py
[Longformer For Question Answering] Conversion script, doc, small fixes (#4593)
2020-05-26 14:58:47 +02:00
convert_marian_to_pytorch.py
Fix: unpin flake8 and fix cs errors (#4367)
2020-05-14 13:14:26 -04:00
convert_mobilebert_original_tf_checkpoint_to_pytorch.py
Add MobileBert (#4901)
2020-06-19 16:38:36 -04:00
convert_openai_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_pytorch_checkpoint_to_tf2.py
Imports organization
2020-07-06 10:27:10 -04:00
convert_reformer_trax_checkpoint_to_pytorch.py
[Reformer] Add Enwiki8 Reformer Model - Adapt convert script (#4282)
2020-05-11 16:38:07 +02:00
convert_roberta_original_pytorch_checkpoint_to_pytorch.py
Fix roberta checkpoint conversion script (#3642)
2020-04-07 12:03:23 -04:00
convert_t5_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_xlm_original_pytorch_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_xlnet_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
file_utils.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
generation_tf_utils.py
better error message (#5497)
2020-07-03 19:25:25 +02:00
generation_utils.py
better error message (#5497)
2020-07-03 19:25:25 +02:00
hf_api.py
[HfApi] Add support for pipeline_tag
2020-06-24 16:54:00 +00:00
hf_argparser.py
Tensorflow improvements (#4530)
2020-06-04 19:45:53 -04:00
modelcard.py
Pipelines: miscellanea of QoL improvements and small features... (#4632)
2020-06-03 03:51:31 -04:00
modeling_albert.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
modeling_auto.py
FlaubertForTokenClassification (#5644)
2020-07-13 14:59:53 -04:00
modeling_bart.py
Cleanup bart caching logic (#5640)
2020-07-14 06:13:05 -04:00
modeling_bert.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
modeling_camembert.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_ctrl.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_distilbert.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_dpr.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_electra.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
modeling_encoder_decoder.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_flaubert.py
FlaubertForTokenClassification (#5644)
2020-07-13 14:59:53 -04:00
modeling_gpt2.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_longformer.py
[Longformer] fix longformer global attention output (#5659)
2020-07-13 17:23:22 +02:00
modeling_marian.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
modeling_mmbt.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_mobilebert.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
modeling_openai.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_outputs.py
Document model outputs (#5673)
2020-07-10 17:31:02 -04:00
modeling_reformer.py
[Reformer classification head] Implement the reformer model classification head for text classification (#5198)
2020-07-14 09:16:22 +02:00
modeling_retribert.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
modeling_roberta.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_t5.py
Deprecate old past arguments (#5671)
2020-07-10 17:25:52 -04:00
modeling_tf_albert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_auto.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_bert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_camembert.py
fix (#4976)
2020-06-14 21:36:14 +02:00
modeling_tf_ctrl.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_distilbert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_electra.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_flaubert.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
modeling_tf_gpt2.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_mobilebert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_openai.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_pytorch_utils.py
Cleaner warning when loading pretrained models (#4557)
2020-06-22 21:58:47 +02:00
modeling_tf_roberta.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_t5.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_transfo_xl_utilities.py
💄 super
2020-01-15 18:33:50 -05:00
modeling_tf_transfo_xl.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
modeling_tf_utils.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
modeling_tf_xlm_roberta.py
fix (#4976)
2020-06-14 21:36:14 +02:00
modeling_tf_xlm.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
modeling_tf_xlnet.py
Fixed use of memories in XLNet (caching for language generation + warning when loading improper memoryless model) (#5632)
2020-07-10 17:38:36 +02:00
modeling_transfo_xl_utilities.py
Shift labels internally within TransfoXLLMHeadModel when called with labels (#3716)
2020-04-13 18:11:23 +02:00
modeling_transfo_xl.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_utils.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_xlm_roberta.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_xlm.py
Change model outputs types to self-document outputs (#5438)
2020-07-10 11:36:53 -04:00
modeling_xlnet.py
Fixed use of memories in XLNet (caching for language generation + warning when loading improper memoryless model) (#5632)
2020-07-10 17:38:36 +02:00
optimization_tf.py
Fix examples titles and optimization doc page (#5408)
2020-07-01 08:11:25 -04:00
optimization.py
Fix examples titles and optimization doc page (#5408)
2020-07-01 08:11:25 -04:00
pipelines.py
Pipeline model type check (#5679)
2020-07-12 12:34:21 +08:00
testing_utils.py
Test XLA examples (#5583)
2020-07-09 09:19:19 -04:00
tokenization_albert.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
tokenization_auto.py
Upgrade examples to pl=0.8.1(#5146)
2020-06-22 20:40:10 -04:00
tokenization_bart.py
mbart.prepare_translation_batch: pass through kwargs (#5581)
2020-07-07 13:46:05 -04:00
tokenization_bert_japanese.py
Kill model archive maps (#4636)
2020-06-02 09:39:33 -04:00
tokenization_bert.py
Various tokenizers fixes (#5558)
2020-07-06 18:27:53 -04:00
tokenization_camembert.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
tokenization_ctrl.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_distilbert.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_dpr.py
Fix tests imports dpr (#5576)
2020-07-07 16:35:12 +02:00
tokenization_electra.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_flaubert.py
Fix CI after killing archive maps (#4724)
2020-06-02 10:21:09 -04:00
tokenization_gpt2.py
Fix fast tokenizers too (#5562)
2020-07-06 18:45:01 -04:00
tokenization_longformer.py
[Longformer] more models + model cards (#4628)
2020-05-28 11:11:05 +02:00
tokenization_marian.py
MarianTokenizer.prepare_translation_batch uses new tokenizer API (#5182)
2020-07-01 10:32:50 -04:00
tokenization_mobilebert.py
Add MobileBert (#4901)
2020-06-19 16:38:36 -04:00
tokenization_openai.py
GPT2 tokenizer should not output token type IDs (#5546)
2020-07-06 11:33:57 -04:00
tokenization_reformer.py
Refactor Code samples; Test code samples (#5036)
2020-06-25 16:46:00 -04:00
tokenization_retribert.py
Eli5 examples (#4968)
2020-06-16 16:36:58 -04:00
tokenization_roberta.py
Fix fast tokenizers too (#5562)
2020-07-06 18:45:01 -04:00
tokenization_t5.py
Update tokenization_t5.py (#5717)
2020-07-14 00:02:03 -04:00
tokenization_transfo_xl.py
Tokenizers API developments (#5103)
2020-06-23 13:36:57 +02:00
tokenization_utils_base.py
More explicit error when failing to tensorize overflowing tokens (#5633)
2020-07-09 13:35:21 -04:00
tokenization_utils_fast.py
Add pad_to_multiple_of on tokenizers (reimport) (#5054)
2020-06-26 11:55:57 +02:00
tokenization_utils.py
Fix #5544 (#5551)
2020-07-06 11:22:24 -04:00
tokenization_xlm_roberta.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
tokenization_xlm.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
tokenization_xlnet.py
[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)
2020-06-26 19:48:14 +02:00
trainer_tf.py
Clean up diffs in Trainer/TFTrainer (#5417)
2020-07-01 11:00:20 -04:00
trainer_utils.py
Clean up diffs in Trainer/TFTrainer (#5417)
2020-07-01 11:00:20 -04:00
trainer.py
Fix Trainer in DataParallel setting (#5685)
2020-07-13 08:37:38 -04:00
training_args_tf.py
Clean up diffs in Trainer/TFTrainer (#5417)
2020-07-01 11:00:20 -04:00
training_args.py
Clean up diffs in Trainer/TFTrainer (#5417)
2020-07-01 11:00:20 -04:00