c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,565 Commits 171 Branches 49 Tags
a07fcff08772024ffedb19601bf4cd4624df41f5
Commit Graph
1276 Commits
Author SHA1 Message Date
sshleifer 7c6802d216 boom boom 2020-06-23 16:10:00 -04:00
sshleifer 6dd3122ad4 tests pass 2020-06-23 14:35:54 -04:00
Sam Shleifer f5c2a122e3 Upgrade examples to pl=0.8.1(#5146) 2020-06-22 20:40:10 -04:00
Patrick von Platen fa0be6d761 Benchmarks (#4912) 
* finish benchmark

* fix isort

* fix setup cfg

* retab

* fix time measuring of tf graph mode

* fix tf cuda

* clean code

* better error message
 2020-06-22 12:06:56 +02:00
Ilya Boytsov bc3a0c0607 [examples] fixes arguments for summarization finetune scripts (#5157) 
Authored-by: i.boytsov <i.boytsov@MAC867.local>
 2020-06-21 11:51:21 -04:00
Kevin Canwen Xu c0c577cf8f Fix PABEE's result table (#5158) 2020-06-20 22:56:39 +08:00
Kevin Canwen Xu 2fd28d4363 Add BERT Loses Patience (Patience-based Early Exit) (#5078) 
* Add BERT Loses Patience (Patience-based Early Exit)

* update model archive

* update format

* sort import

* flake8

* Add results

* full results

* align the table

* refactor to inherit

* default per gpu eval = 1

* Formatting

* Formatting

* isort

* modify readme

* Add check

* Fix format

* Fix format

* Doc strings

* ALBERT & BERT for sequence classification don't inherit from the original anymore

* Remove incorrect comments

* Remove incorrect comments

* Remove incorrect comments

* Sync up with new code

* Sync up with new code

* Add a test

* Add a test

* Add a test

* Add a test

* Add a test

* Add a test

* Finishing up!
 2020-06-20 13:41:46 +08:00
sshleifer 3a8f32d919 pl 0.8.1 compat 2020-06-19 14:46:51 +00:00
sshleifer 29d1eb57ac Support top, bottom init 2020-06-19 09:43:20 -04:00
Sam Shleifer 2db1e2f415 [cleanup] remove redundant code in SummarizationDataset (#5119) 2020-06-18 20:34:48 -04:00
Lysandre efeb75b805 Remove misleading comment 
closes #4958
 2020-06-17 18:24:35 -04:00
Sam Shleifer f1a3d03741 add pandas to setup.cfg (#5093) 2020-06-17 16:39:17 -04:00
Pranav Dayanand Pawar 049e14f0e3 very minor spelling correction in script command (#5090) 
actual script name - counts_parameters.py
 2020-06-17 16:08:43 -04:00
sshleifer 970fe3d833 smaller distilbart-clean delta 2020-06-17 16:03:49 -04:00
Sam Shleifer 043f9f51f9 [examples] SummarizationModule improvements (#4951) 2020-06-17 13:51:34 -04:00
Sylvain Gugger cd40f6564e Add header and fix command (#5082) 2020-06-17 11:45:05 -04:00
flozi00 af497b5672 Typo (#5069) 2020-06-16 16:46:20 -04:00
Yacine JerniteJulien ChaumondLysandre DebutLysandre
 		49c5202522 Eli5 examples (#4968) 
* add eli5 examples

* add dense query script

* query_di

* merging

* merging

* add_utils

* adds nearest neighbor wikipedia

* batch queries

* training_retriever

* new notebooks

* moved retriever traiing script

* finished wiki40b

* max_len_fix

* train_s2s

* retriever_batch_checkpointing

* cleanup

* merge

* dim_fix

* fix_indexer

* fix_wiki40b_snippets

* fix_embed_for_r

* fp32 index

* fix_sparse_q

* joint_training

* remove obsolete datasets

* add_passage_nn_results

* add_passage_nn_results

* add_batch_nn

* add_batch_nn

* add_data_scripts

* notebook

* notebook

* notebook

* fix_multi_gpu

* add_app

* full_caching

* full_caching

* notebook

* sparse_done

* images

* notebook

* add_image_gif

* with_Gif

* add_contr_image

* notebook

* notebook

* notebook

* train_functions

* notebook

* min_retrieval_length

* pandas_option

* notebook

* min_retrieval_length

* notebook

* notebook

* eval_Retriever

* notebook

* images

* notebook

* add_example

* add_example

* notebook

* fireworks

* notebook

* notebook

* joe's notebook comments

* app_update

* notebook

* notebook_link

* captions

* notebook

* assing RetriBert model

* add RetriBert to Auto

* change AutoLMHead to AutoSeq2Seq

* notebook downloads from hf models

* style_black

* style_black

* app_update

* app_update

* fix_app_update

* style

* style

* isort

* Delete WikiELI5training.ipynb

* Delete evaluate_eli5.py

* Delete WikiELI5explore.ipynb

* Delete ExploreWikiELI5Support.html

* Delete explainlikeimfive.py

* Delete wiki_snippets.py

* children before parent

* children before parent

* style_black

* style_black_only

* isort

* isort_new

* Update src/transformers/modeling_retribert.py

Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* typo fixes

* app_without_asset

* cleanup

* Delete ELI5animation.gif

* Delete ELI5contrastive.svg

* Delete ELI5wiki_index.svg

* Delete choco_bis.svg

* Delete fireworks.gif

* Delete huggingface_logo.jpg

* Delete huggingface_logo.svg

* Delete Long_Form_Question_Answering_with_ELI5_and_Wikipedia.ipynb

* Delete eli5_app.py

* Delete eli5_utils.py

* readme

* Update README.md

* unused imports

* moved_info

* default_beam

* ftuned model

* disclaimer

* Update src/transformers/modeling_retribert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* black

* add_doc

* names

* isort_Examples

* isort_Examples

* Add doc to index

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
 2020-06-16 16:36:58 -04:00
Sam Shleifer c3e607496c [cleanup] examples test_run_squad uses tiny model (#5059) 2020-06-16 14:06:45 -04:00
Sylvain Gugger d5477baf7d Convert hans to Trainer (#5025) 
* Convert hans to Trainer

* Tick box
 2020-06-16 08:06:31 -04:00
sshleifer 97e29a9cf3 allstats-option 2020-06-15 21:38:08 -04:00
sshleifer 785a1b6076 RougeTracker 2020-06-15 21:13:36 -04:00
sshleifer 9ef5581d5e boom boom 2020-06-15 18:05:27 -04:00
sshleifer 3a5999f5d4 boom boom 2020-06-15 17:50:28 -04:00
sshleifer 0efb2830f4 turn off ES callback 2020-06-15 17:43:01 -04:00
sshleifer b5099747f9 boom boom 2020-06-15 17:36:56 -04:00
sshleifer 34fd62a5ea init with copy 2020-06-15 17:36:12 -04:00
sshleifer e167e9fc74 boom boom 2020-06-15 17:19:30 -04:00
Anthony MOIThomas WolfLysandre
 		36434220fc [HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510) 
* Use tokenizers pre-tokenized pipeline

* failing pretrokenized test

* Fix is_pretokenized in python

* add pretokenized tests

* style and quality

* better tests for batched pretokenized inputs

* tokenizers clean up - new padding_strategy - split the files

* [HUGE] refactoring tokenizers - padding - truncation - tests

* style and quality

* bump up requied tokenizers version to 0.8.0-rc1

* switched padding/truncation API - simpler better backward compat

* updating tests for custom tokenizers

* style and quality - tests on pad

* fix QA pipeline

* fix backward compatibility for max_length only

* style and quality

* Various cleans up - add verbose

* fix tests

* update docstrings

* Fix tests

* Docs reformatted

* __call__ method documented

Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
 2020-06-15 17:12:51 -04:00
sshleifer 1df5e7af4a odir fix 2020-06-15 17:10:53 -04:00
sshleifer 10970ec650 fixed dec_mask, maybe 2020-06-15 12:42:54 -04:00
sshleifer 78b1c850f2 passing, unsolved 2020-06-15 12:24:39 -04:00
Sylvain GuggerandJulien Chaumond 1affde2f10 Make DataCollator a callable (#5015) 
* Make DataCollator a callable

* Update src/transformers/data/data_collator.py

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-06-15 11:58:33 -04:00
Stefan Schweter d812e6d76e NER: fix construction of input examples for RoBERTa (#4943) 
* utils_ner: do not add extra sep token for RoBERTa model

* run_pl_ner: do not add extra sep token for RoBERTa model
 2020-06-15 08:30:40 -04:00
sshleifer ac8d301786 boom boom 2020-06-14 21:56:11 -04:00
sshleifer 9f32be4fbc boom boom 2020-06-14 21:54:18 -04:00
sshleifer 74c8ac0f84 fixes 2020-06-14 21:51:09 -04:00
sshleifer 1d5e77d87b test_passing 2020-06-14 21:41:49 -04:00
sshleifer 47b3638593 boom boom 2020-06-14 21:18:15 -04:00
sshleifer f7c95805cf boom boom 2020-06-14 21:01:52 -04:00
sshleifer 0169cbbe49 all but t5 passing 2020-06-14 21:01:41 -04:00
sshleifer 8e4a74b1cb borked 2020-06-14 20:46:20 -04:00
sshleifer 86034ae640 Merge branch 'distilbart-clean' into theseus 2020-06-14 19:51:25 -04:00
sshleifer 5283878c9f Move stuff to utils 2020-06-14 19:17:31 -04:00
sshleifer 6bdfb14664 boom boom 2020-06-14 19:07:15 -04:00
sshleifer 99de2c3c3c pass through logger 2020-06-14 19:01:15 -04:00
sshleifer 9e95429843 docs 2020-06-14 18:20:02 -04:00
sshleifer c9597fef42 docs 2020-06-14 18:15:28 -04:00
sshleifer c34b886cd1 Wandb logger 2020-06-14 18:11:22 -04:00
sshleifer f179e7b37c Allow wandb logger 2020-06-14 17:58:41 -04:00