Pradhy729 290b6e18ac Trainer support for iterabledataset (#5834) ...

* Don't pass sampler for iterable dataset

* Added check for test and eval dataloaders.

* Formatting

* Don't pass sampler for iterable dataset

* Added check for test and eval dataloaders.

* Formatting

* Cleaner if nesting.

* Added test for trainer and iterable dataset

* Formatting for test

* Fixed import when torch is available only.

* Added require torch decorator to helper class

* Moved dataset class inside unittest

* Removed nested if and changed model in test

* Checking torch availability for IterableDataset

2020-07-20 09:07:37 -04:00

..

fixtures

BIG Reorganize examples (#4213)

2020-05-07 13:48:44 -04:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_benchmark_tf.py

[Benchmark] Add benchmarks for TF Training (#5594)

2020-07-08 12:11:09 +02:00

test_benchmark.py

fix benchmark for longformer (#5808)

2020-07-16 15:15:10 +02:00

test_configuration_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_configuration_common.py

Pass kwargs to configuration (#3147)

2020-03-05 17:16:57 -05:00

test_doc_samples.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_hf_api.py

[cli] {login, upload, s3} display more helpful error messages

2020-04-30 12:51:06 -04:00

test_hf_argparser.py

[Benchmark] Memory benchmark utils (#4198)

2020-05-27 23:22:16 +02:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_bart.py

Add mbart-large-cc25, support translation finetuning (#5129)

2020-07-07 13:23:01 -04:00

test_modeling_bert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_camembert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_common.py

Change model outputs types to self-document outputs (#5438)

2020-07-10 11:36:53 -04:00

test_modeling_ctrl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_distilbert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)

2020-07-07 18:15:53 +02:00

test_modeling_dpr.py

Fix tests imports dpr (#5576)

2020-07-07 16:35:12 +02:00

test_modeling_electra.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_encoder_decoder.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_flaubert.py

FlaubertForTokenClassification (#5644)

2020-07-13 14:59:53 -04:00

test_modeling_gpt2.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_longformer.py

[Longformer] Major Refactor (#5219)

2020-07-01 17:43:32 +02:00

test_modeling_marian.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_mbart.py

[fix] mbart_en_ro_generate test now identical to fairseq (#5731)

2020-07-14 06:12:24 -04:00

test_modeling_mobilebert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_openai.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_reformer.py

[Reformer] - Cache hidden states and buckets to speed up inference (#5578)

2020-07-17 16:17:42 +02:00

test_modeling_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_t5.py

[fix] check code quality (#5772)

2020-07-15 14:59:38 -04:00

test_modeling_tf_albert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_auto.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)

2020-07-07 18:15:53 +02:00

test_modeling_tf_bert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)

2020-07-07 18:15:53 +02:00

test_modeling_tf_camembert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_common.py

Change model outputs types to self-document outputs (#5438)

2020-07-10 11:36:53 -04:00

test_modeling_tf_ctrl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_distilbert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)

2020-07-07 18:15:53 +02:00

test_modeling_tf_electra.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_flaubert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_gpt2.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_mobilebert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_openai_gpt.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_t5.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)

2020-07-07 18:15:53 +02:00

test_modeling_tf_transfo_xl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlm.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlnet.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_transfo_xl.py

Changed expected_output_ids in TransfoXL generation test (#5462)

2020-07-02 11:56:44 +02:00

test_modeling_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_modeling_xlm.py

rename the function to match the rest of the test convention (#5692)

2020-07-13 18:09:49 +08:00

test_modeling_xlnet.py

Xlnet outputs (#5883)

2020-07-18 17:33:13 +02:00

test_onnx.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_optimization_tf.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_optimization.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_pipelines.py

Fix Inconsistent NER Grouping (Pipeline) (#4987)

2020-07-08 16:18:17 -04:00

test_tokenization_albert.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)

2020-06-15 17:12:51 -04:00

test_tokenization_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_bert_japanese.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_bert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_common.py

Add mbart-large-cc25, support translation finetuning (#5129)

2020-07-07 13:23:01 -04:00

test_tokenization_ctrl.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)

2020-06-15 17:12:51 -04:00

test_tokenization_distilbert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_dpr.py

Fix tests imports dpr (#5576)

2020-07-07 16:35:12 +02:00

test_tokenization_fast.py

Various tokenizers fixes (#5558)

2020-07-06 18:27:53 -04:00

test_tokenization_gpt2.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)

2020-06-15 17:12:51 -04:00

test_tokenization_marian.py

[fix] Marian tests import (#5442)

2020-07-01 11:42:22 -04:00

test_tokenization_mbart.py

Add mbart-large-cc25, support translation finetuning (#5129)

2020-07-07 13:23:01 -04:00

test_tokenization_openai.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)

2020-06-15 17:12:51 -04:00

test_tokenization_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_t5.py

[cleanup] test_tokenization_common.py (#4390)

2020-05-19 10:46:55 -04:00

test_tokenization_transfo_xl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_utils.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_xlm.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_tokenization_xlnet.py

Move tests/utils.py -> transformers/testing_utils.py (#5350)

2020-07-01 10:31:17 -04:00

test_trainer_distributed.py

[Tokenization] Fix #5181 - make #5155 more explicit - move back the default logging level in tests to WARNING (#5252)

2020-06-25 17:24:28 +02:00

test_trainer.py

Trainer support for iterabledataset (#5834)

2020-07-20 09:07:37 -04:00