c-my/transformers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,871 Commits 171 Branches 49 Tags
931b10978ee63e89b9e76e179483c6722e194eac
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sylvain Gugger 0c9bae0934 Remove typo 2020-11-12 22:39:57 -05:00
Sylvain Gugger 7933054638 Model sharing doc (#8498) 
* Model sharing doc

* Style
 2020-11-12 11:53:23 -05:00
Sylvain Gugger 3213d3bfae Question template (#8440) 
* Remove SO from question template

* Styling
 2020-11-10 10:07:56 -05:00
Sylvain Gugger a39218b75b Check all models are in an auto class (#8425) 2020-11-09 15:44:54 -05:00
Sylvain Gugger 52040517b8 Deprecate old data/metrics functions (#8420) 2020-11-09 12:10:09 -05:00
Sylvain GuggerandThomas Wolf 908a28894c Add new token classification example (#8340) 
* Add new token classification example

* Remove txt file

* Add test

* With actual testing done

* Less warmup is better

* Update examples/token-classification/run_ner_new.py

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>

* Address review comments

* Fix test

* Make Lysandre happy

* Last touches and rename

* Rename in tests

* Address review comments

* More run_ner -> run_ner_old

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
 2020-11-09 11:39:55 -05:00
Sylvain Gugger c7cb1aa26c Bump tokenizers (#8419) 2020-11-09 11:32:10 -05:00
Sylvain Gugger 04e442d575 Make Trainer evaluation handle dynamic seq_length (#8336) 
* Make Trainer evaluation handle dynamic seq_length

* Document behavior.

* Fix test

* Better fix

* Fixes for realsies this time

* Address review comments

* Without forgetting to save...
 2020-11-05 15:13:51 -05:00
Sylvain GuggerandLysandre Debut 9c4aa4ac1a Clean up data collators and datasets (#8308) 
* Clean up data collators and datasets

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Remove needless clone

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-11-04 17:24:49 -05:00
Sylvain Gugger b6e58db277 Speedup doc build (#8301) 
* Try -j option

* Try other thing

* Bigger machine

* Test lower sphinx version

* Remove trailing space
 2020-11-04 11:51:21 -05:00
Sylvain Gugger cf89724696 Fix validation file loading in scripts (#8298) 2020-11-04 10:42:18 -05:00
Sylvain Gugger 7f556d2e39 Data collator for token classification (#8274) 
* Add DataCollatorForTokenClassification and clean tests

* Make quality
 2020-11-03 16:33:27 -05:00
Sylvain Gugger 4c19f3baab Clean Trainer tests and datasets dep (#8268) 2020-11-03 15:50:55 -05:00
Sylvain GuggerandLysandre Debut e1b1b614b1 Add line by line option to mlm/plm scripts (#8240) 
* Make line by line optional in run_mlm

* Add option to disable dynamic padding

* Add option to plm too and update README

* Typos

* More typos

* Even more typos

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-11-02 12:27:04 -05:00
Sylvain Gugger 5406f31a1a Fix TensorBoardCallback for older versions of PyTorch (#8239) 2020-11-02 10:43:28 -05:00
Sylvain Gugger d1ad4bff44 Fix bad import with PyTorch <= 1.4.1 (#8237) 2020-11-02 10:26:37 -05:00
Sylvain Gugger 9eb3a410cd Remove deprecated arguments from new run_clm (#8197) 2020-10-30 15:27:20 -04:00
Sylvain GuggerLysandre DebutThomas Wolf
 		cdc48ce92d Finalize lm examples (#8188) 
* Finish the cleanup of the language-modeling examples

* Update main README

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Apply suggestions from code review

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>

* Propagate changes

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
 2020-10-30 14:20:18 -04:00
Sylvain Gugger 089cc1015e Doc fixes and filter warning in wandb (#8189) 2020-10-30 12:37:34 -04:00
Sylvain Gugger 691176283d Add a template for examples and apply it for mlm and plm examples (#8153) 
* Add a template for example scripts and apply it to mlm

* Formatting

* Fix test

* Add plm script

* Add a template for example scripts and apply it to mlm

* Formatting

* Fix test

* Add plm script

* Add a template for example scripts and apply it to mlm

* Formatting

* Fix test

* Add plm script

* Styling
 2020-10-29 13:38:11 -04:00
Sylvain Gugger acf56408d8 Smarter prediction loop and no- -> no_ in console args (#8151) 
* Smarter prediction loop and no- -> no_ in console args

* Fix test
 2020-10-29 10:56:25 -04:00
Sylvain Gugger b0f1c0ee30 Document tokenizer_class in configurations (#8152) 2020-10-29 10:43:45 -04:00
Sylvain Gugger 378142afdf Rename add_start_docstrings_to_callable (#8120) 2020-10-28 13:42:31 -04:00
Sylvain Gugger 6241c873cd Document the various LM Auto models (#8118) 2020-10-28 13:41:56 -04:00
Sylvain GuggerandThomas Wolf 47dfa65b0c New run_clm script (#8105) 
* New run_clm script

* Formatting

* More comments

* Remove unused imports

* Apply suggestions from code review

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>

* Address review comments

* Change link to the hub

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
 2020-10-28 10:38:58 -04:00
Sylvain Gugger 41cc5f3f59 Move installation instructions to the top (#8106) 2020-10-27 17:32:20 -04:00
Sylvain Gugger c5f3149f95 Adjust setup so that all extras run on Windows (#8102) 2020-10-27 14:39:49 -04:00
Sylvain Gugger c42596bc07 Doc styling fixes (#8074) 
* Fix a few docstrings

* More fixes

* Styling
 2020-10-27 07:54:50 -04:00
Sylvain Gugger 08f534d2da Doc styling (#8067) 
* Important files

* Styling them all

* Revert "Styling them all"

This reverts commit 7d029395fdae8513b8281cbc2a6c239f8093503e.

* Syling them for realsies

* Fix syntax error

* Fix benchmark_utils

* More fixes

* Fix modeling auto and script

* Remove new line

* Fixes

* More fixes

* Fix more files

* Style

* Add FSMT

* More fixes

* More fixes

* More fixes

* More fixes

* Fixes

* More fixes

* More fixes

* Last fixes

* Make sphinx happy
 2020-10-26 18:26:02 -04:00
Sylvain Gugger 04a17f8550 Doc fixes in preparation for the docstyle PR (#8061) 
* Fixes in preparation for doc styling

* More fixes

* Better syntax

* Fixes

* Style

* More fixes

* More fixes
 2020-10-26 15:01:09 -04:00
Sylvain Gugger 077478637d Fix label name in DataCollatorForNextSentencePrediction test (#8048) 2020-10-26 09:23:12 -04:00
Sylvain Gugger 5ae935d233 Reload checkpoint (#7984) 
* Fix checkpoint loading in Trainer

* Fix typo
 2020-10-22 15:48:52 -04:00
Sylvain Gugger 06fc3954a1 Only log total_flos at the end of training (#7981) 
* Only log total_flos at the end of training

* Fix test
 2020-10-22 14:26:55 -04:00
Sylvain GuggerJulien ChaumondThomas Wolf
 		2e5052d4f1 New run glue script (#7917) 
* Start simplification

* More progress

* Finished script

* Address comments and update tests instructions

* Wrong test

* Accept files as inputs and fix test

* Update src/transformers/trainer_utils.py

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Fix labels and add combined score

* Add special labels

* Update TPU command

* Revert to old label strategy

* Use model labels

* Fix for STT-B

* Styling

* Apply suggestions from code review

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>

* Code styling

* Fix review comments

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
 2020-10-22 11:42:22 -04:00
Sylvain Gugger 6d4f8bd02a Add Flax dummy objects (#7918) 2020-10-20 07:45:48 -04:00
Sylvain Gugger eb186bc14e Small fixes to HP search (#7839) 2020-10-16 03:23:44 -04:00
Sylvain Gugger 2ce3ddab2d Small fixes to NotebookProgressCallback (#7813) 2020-10-15 10:30:34 -04:00
Sylvain Gugger 62b5622e6b Add specific notebook ProgressCalback (#7793) 2020-10-15 05:05:08 -04:00
Sylvain Gugger bb9559a7f9 Don't use store_xxx on optional bools (#7786) 
* Don't use `store_xxx` on optional bools

* Refine test

* Refine test
 2020-10-14 12:05:02 -04:00
Sylvain GuggerandLysandre Debut a1d1b332d0 Add predict step accumulation (#7767) 
* Add eval_accumulation_step and clean distributed eval

* Add TPU test

* Add TPU stuff

* Fix arg name

* Fix Seq2SeqTrainer

* Fix total_size

* Update src/transformers/trainer_pt_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Doc and add test to TPU

* Add unit test

* Adapt name

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-10-14 11:41:45 -04:00
Sylvain Gugger 7968051aba Fix typo 2020-10-13 17:30:46 -04:00
Sylvain Gugger 13c1857718 Fix typo in all model docs (#7714) 2020-10-12 04:06:59 -04:00
Sylvain Gugger c6e18de9f8 Fix flaky test in test_trainer (#7689) 2020-10-09 20:01:15 -04:00
Sylvain Gugger 2c9e83f7b8 Fix title level in Blenderbot doc (#7687) 2020-10-09 19:24:10 -04:00
Sylvain Gugger a3cea6a8cc Better links for models in READMED and doc index (#7680) 2020-10-09 11:17:16 -04:00
Sylvain GuggerandLysandre Debut 08ba4b4902 Trainer callbacks (#7596) 
* Initial callback proposal

* Finish various callbacks

* Post-rebase conflicts

* Fix tests

* Don't use something that's not set

* Documentation

* Remove unwanted print.

* Document all models can work

* Add tests + small fixes

* Update docs/source/internal/trainer_utils.rst

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Address review comments

* Fix TF tests

* Real fix this time

* This one should work

* Fix typo

* Really fix typo

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-10-07 10:50:21 -04:00
Sylvain Gugger 03835af700 Documentation fixes (#7585) 2020-10-05 11:01:03 -04:00
Sylvain Gugger d3adb985d1 Expand test to locate flakiness (#7580) 2020-10-05 09:45:47 -04:00
Sylvain Gugger b2b7fc7814 Check and update model list in index.rst automatically (#7527) 
* Check and update model list in index.rst automatically

* Check and update model list in index.rst automatically

* Adapt template
 2020-10-05 09:40:45 -04:00
Sylvain Gugger ca05c2a47d Fix post_init of some TrainingArguments (#7525) 2020-10-05 09:19:16 -04:00
Sylvain Gugger 28d183c90c Allow soft dependencies in the namespace with ImportErrors at use (#7537) 
* PoC on RAG

* Format class name/obj name

* Better name in message

* PoC on one TF model

* Add PyTorch and TF dummy objects + script

* Treat scikit-learn

* Bad copy pastes

* Typo
 2020-10-05 09:12:04 -04:00
Sylvain Gugger 0270256b27 Allow nested tensors in predicted logits (#7542) 2020-10-05 06:33:15 -04:00
Sylvain Gugger e2c935f561 Cleanup documentation for BART, Marian, MBART and Pegasus (#7523) 
* Cleanup documentation for BART, Marian, MBART and Pegasus

* Cleanup documentation for BART, Marian, MBART and Pegasus
 2020-10-05 04:22:12 -04:00
Sylvain Gugger 95f792afb0 Remove labels from the RagModel example (#7560) 2020-10-04 17:39:23 -04:00
Sylvain Gugger bdcc4b78a2 Fix seq2seq example test (#7518) 
* Fix seq2seq example test

* Fix bad copy-paste

* Also save the state
 2020-10-01 14:13:29 -04:00
Sylvain Gugger 29baa8fabe Clean the Trainer state (#7490) 
* Trainer should not modify its TrainingArguments

* Trainer should not modify its TrainingArguments

* Trainer should not modify its TrainingArguments

* Add test of resumed training

* Fixes

* Non multiGPU test

* Clean Trainer state

* Add more to the state

* Documentation

* One last test

* Make resume training test more complete

* Unwanted changes
 2020-10-01 13:07:04 -04:00
Sylvain Gugger be51c1039d Add forgotten return_dict argument in the docs (#7483) 2020-10-01 04:41:29 -04:00
Sylvain Gugger 4c6728460a Bump isort version. (#7484) 2020-09-30 13:44:58 -04:00
Sylvain Gugger a97a73e0ee Small QOL improvements to TrainingArguments (#7475) 
* Small QOL improvements to TrainingArguments

* With the self.
 2020-09-30 12:12:03 -04:00
Sylvain Gugger dc7d2daa4c Alphabetize model lists (#7478) 2020-09-30 10:43:58 -04:00
Sylvain Gugger fdccf82e28 Remove config assumption in Trainer (#7464) 
* Remove config assumption in Trainer

* Initialize for eval
 2020-09-30 09:03:25 -04:00
Sylvain Gugger 4ba248748f Get a better error when check_copies fails (#7457) 
* Get a better error when check_copies fails

* Fix tests
 2020-09-30 10:05:14 +02:00
Sylvain Gugger 8546dc55c2 Fix Trainer tests in a multiGPU env (#7458) 2020-09-29 14:06:41 -04:00
Sylvain Gugger d0fd7154c5 Catch import datasets common errors (#7456) 2020-09-29 13:42:09 -04:00
Sylvain Gugger f1220c5fe2 Add a code of conduct (#7433) 2020-09-29 13:38:47 -04:00
Sylvain Gugger 52e8392b7e Add automatic best model loading to Trainer (#7431) 
* Add automatic best model loading to Trainer

* Some small fixes

* Formatting
 2020-09-29 10:41:18 -04:00
Sylvain Gugger 1fc4de69ed Document new features of make fixup (#7434) 2020-09-29 03:56:57 -04:00
Sylvain Gugger ca3fc36de3 Reorganize documentation navbar (#7423) 
* Reorganize documentation navbar

* Update css to have clear sections
 2020-09-28 16:22:58 +02:00
Sylvain Gugger 0611eab5e3 Document RAG again (#7377) 
Do not merge before Monday
 2020-09-28 08:31:46 -04:00
Sylvain Gugger 7563d5a3cf Catch PyTorch warning when saving/loading scheduler (#7401) 2020-09-28 08:20:10 -04:00
Sylvain Gugger ad39271ae8 Fix FP16 and attention masks in FunnelTransformer (#7374) 
* Fix #7371

* Fix training

* Fix test values

* Apply the fix to TF as well
 2020-09-25 12:20:39 -04:00
Sylvain Gugger e2e77f02c2 Fix BartModel output documentation (#7390) 2020-09-25 11:48:13 -04:00
Sylvain Gugger bbb07830ff Speedup check_copies script (#7394) 2020-09-25 11:47:22 -04:00
Sylvain Gugger a8e7982f84 Remove mentions of RAG from the docs (#7376) 
* Remove mentions of  RAG from the docs

* Deactivate check
 2020-09-24 17:07:14 -04:00
Sylvain Gugger 0ccb6f5c6d Clean RAG docs and template docs (#7348) 
* Clean RAG docs and template docs

* Fix typo

* Better doc
 2020-09-24 09:24:41 -04:00
Sylvain Gugger 27174bd4fe Make PyTorch model files independent from each other (#7352) 2020-09-24 08:53:54 -04:00
Sylvain Gugger 1ff5bd38a3 Check decorator order (#7326) 
* Check decorator order

* Adapt for parametrized decorators

* Fix typos
 2020-09-24 04:54:37 -04:00
Sylvain Gugger 0be5f4a00c Expand a bit the documentation doc (#7350) 2020-09-24 04:34:18 -04:00
Sylvain GuggerandLysandre Debut 3323146e90 Models doc (#7345) 
* Clean up model documentation

* Formatting

* Preparation work

* Long lines

* Main work on rst files

* Cleanup all config files

* Syntax fix

* Clean all tokenizers

* Work on first models

* Models beginning

* FaluBERT

* All PyTorch models

* All models

* Long lines again

* Fixes

* More fixes

* Update docs/source/model_doc/bert.rst

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update docs/source/model_doc/electra.rst

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Last fixes

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-23 13:20:45 -04:00
Sylvain Gugger 1ee2194fb6 Mark big downloads slow (#7325) 
* Make big downloads as slow

* Add import

* Right order for slow decorator

* More slow tests
 2020-09-22 12:21:52 -04:00
Sylvain Gugger 01f0fd0bab Fixes for LayoutLM (#7318) 2020-09-22 10:37:11 -04:00
Sylvain Gugger 596342c2b9 Support for Windows in check_copies (#7316) 2020-09-22 10:17:48 -04:00
Sylvain GuggerandLysandre Debut 89edf504bf Add possibility to evaluate every epoch (#7302) 
* Add possibility to evaluate every epoch

* Remove multitype arg

* Remove needless import

* Use a proper enum

* Apply suggestions from @LysandreJik

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* One else and formatting

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-22 09:52:29 -04:00
Sylvain Gugger 21ca148090 is_pretokenized -> is_split_into_words (#7236) 
* is_pretokenized -> is_split_into_words

* Fix tests
 2020-09-22 09:34:35 -04:00
Sylvain Gugger 244e1b5ba3 Fix #7304 (#7305) 2020-09-22 09:20:03 -04:00
Sylvain GuggerandLysandre Debut e4b94d8e58 Copy code from Bert to Roberta and add safeguard script (#7219) 
* Copy code from Bert to Roberta and add safeguard script

* Fix docstring

* Comment code

* Formatting

* Update src/transformers/modeling_roberta.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Add test and fix bugs

* Fix style and make new comand

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-22 05:02:27 -04:00
Sylvain Gugger 63276b76d4 Fix #7284 (#7289) 2020-09-21 10:31:26 -04:00
Sylvain Gugger 492bb6aa48 Trainer multi label (#7191) 
* Trainer accep multiple labels

* Missing import

* Fix dosctrings
 2020-09-17 08:15:37 -04:00
Sylvain GuggerandThomas Wolf 108c9aefcc Update README (#7133) 
* Rewrite and update README

* Typo and migration guide

* Apply suggestions from code review

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>

* Address Clem's comments

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
 2020-09-16 12:12:12 -04:00
Sylvain Gugger 153ec2f154 Funnel model cards (#7147) 2020-09-15 10:40:57 -04:00
Sylvain Gugger 7186ca6240 Multi predictions trainer (#7126) 
* Allow multiple outputs

* Formatting

* Move the unwrapping before metrics

* Fix typo

* Add test for non-supported config options
 2020-09-15 10:27:24 -04:00
Sylvain Gugger 2bf70e2150 Fix reproducible tests in Trainer (#7119) 
* Fix reproducible tests in Trainer

* Deal with multiple GPUs
 2020-09-15 03:32:44 -04:00
Sylvain Gugger ccc8e30c8a Clean up autoclass doc (#7081) 2020-09-14 09:26:41 -04:00
Sylvain Gugger 4cbd50e611 Compute loss method (#7074) 2020-09-11 12:06:31 -04:00
Sylvain GuggerandPatrick von Platen ae736163d0 Add tests and fix various bugs in ModelOutput (#7073) 
* Add tests and fix various bugs in ModelOutput

* Update tests/test_model_output.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2020-09-11 12:01:33 -04:00
Sylvain Gugger e841b75dec Automate the lists in auto-xxx docs (#7061) 
* More readable dict

* More nlp -> datasets

* Revert "More nlp -> datasets"

This reverts commit 3cd1883d226c63c4a686fc1fed35f2cd586ebe45.

* Automate the lists in auto-xxx docs

* More readable dict

* Revert "More nlp -> datasets"

This reverts commit 3cd1883d226c63c4a686fc1fed35f2cd586ebe45.

* Automate the lists in auto-xxx docs

* nlp -> datasets

* Fix new key
 2020-09-11 10:42:09 -04:00
Sylvain Gugger 0054a48cdd Add dep on datasets (#7058) 2020-09-11 04:43:19 -04:00
Sylvain Gugger 514486739c Fix CI with change of name of nlp (#7054) 
* nlp -> datasets

* More nlp -> datasets

* Woopsie

* More nlp -> datasets

* One last
 2020-09-10 14:51:08 -04:00
Sylvain GuggerandLysandre Debut 15a189049e Add TF Funnel Transformer (#7029) 
* Add TF Funnel Transformer

* Proper dummy input

* Formatting

* Update src/transformers/modeling_tf_funnel.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Address review comments

* One review comment forgotten

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-10 10:41:56 -04:00
Sylvain Gugger d1691d90e5 Samell fixed in tf template (#7044) 2020-09-10 10:36:02 -04:00