 sshleifer
|
6dd3122ad4
|
tests pass
|
2020-06-23 14:35:54 -04:00 |
|
|
Sam Shleifer
|
f5c2a122e3
|
Upgrade examples to pl=0.8.1(#5146)
|
2020-06-22 20:40:10 -04:00 |
|
|
Ilya Boytsov
|
bc3a0c0607
|
[examples] fixes arguments for summarization finetune scripts (#5157)
Authored-by: i.boytsov <i.boytsov@MAC867.local>
|
2020-06-21 11:51:21 -04:00 |
|
|
sshleifer
|
3a8f32d919
|
pl 0.8.1 compat
|
2020-06-19 14:46:51 +00:00 |
|
|
sshleifer
|
29d1eb57ac
|
Support top, bottom init
|
2020-06-19 09:43:20 -04:00 |
|
|
Sam Shleifer
|
2db1e2f415
|
[cleanup] remove redundant code in SummarizationDataset (#5119)
|
2020-06-18 20:34:48 -04:00 |
|
|
sshleifer
|
970fe3d833
|
smaller distilbart-clean delta
|
2020-06-17 16:03:49 -04:00 |
|
|
Sam Shleifer
|
043f9f51f9
|
[examples] SummarizationModule improvements (#4951)
|
2020-06-17 13:51:34 -04:00 |
|
|
sshleifer
|
97e29a9cf3
|
allstats-option
|
2020-06-15 21:38:08 -04:00 |
|
|
sshleifer
|
785a1b6076
|
RougeTracker
|
2020-06-15 21:13:36 -04:00 |
|
|
sshleifer
|
9ef5581d5e
|
boom boom
|
2020-06-15 18:05:27 -04:00 |
|
|
sshleifer
|
3a5999f5d4
|
boom boom
|
2020-06-15 17:50:28 -04:00 |
|
|
sshleifer
|
0efb2830f4
|
turn off ES callback
|
2020-06-15 17:43:01 -04:00 |
|
|
sshleifer
|
b5099747f9
|
boom boom
|
2020-06-15 17:36:56 -04:00 |
|
|
sshleifer
|
34fd62a5ea
|
init with copy
|
2020-06-15 17:36:12 -04:00 |
|
|
sshleifer
|
e167e9fc74
|
boom boom
|
2020-06-15 17:19:30 -04:00 |
|
|
|
36434220fc
|
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
* Use tokenizers pre-tokenized pipeline
* failing pretrokenized test
* Fix is_pretokenized in python
* add pretokenized tests
* style and quality
* better tests for batched pretokenized inputs
* tokenizers clean up - new padding_strategy - split the files
* [HUGE] refactoring tokenizers - padding - truncation - tests
* style and quality
* bump up requied tokenizers version to 0.8.0-rc1
* switched padding/truncation API - simpler better backward compat
* updating tests for custom tokenizers
* style and quality - tests on pad
* fix QA pipeline
* fix backward compatibility for max_length only
* style and quality
* Various cleans up - add verbose
* fix tests
* update docstrings
* Fix tests
* Docs reformatted
* __call__ method documented
Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
|
2020-06-15 17:12:51 -04:00 |
|
|
sshleifer
|
1df5e7af4a
|
odir fix
|
2020-06-15 17:10:53 -04:00 |
|
|
sshleifer
|
10970ec650
|
fixed dec_mask, maybe
|
2020-06-15 12:42:54 -04:00 |
|
|
sshleifer
|
78b1c850f2
|
passing, unsolved
|
2020-06-15 12:24:39 -04:00 |
|
|
sshleifer
|
ac8d301786
|
boom boom
|
2020-06-14 21:56:11 -04:00 |
|
|
sshleifer
|
9f32be4fbc
|
boom boom
|
2020-06-14 21:54:18 -04:00 |
|
|
sshleifer
|
74c8ac0f84
|
fixes
|
2020-06-14 21:51:09 -04:00 |
|
|
sshleifer
|
1d5e77d87b
|
test_passing
|
2020-06-14 21:41:49 -04:00 |
|
|
sshleifer
|
47b3638593
|
boom boom
|
2020-06-14 21:18:15 -04:00 |
|
|
sshleifer
|
0169cbbe49
|
all but t5 passing
|
2020-06-14 21:01:41 -04:00 |
|
|
sshleifer
|
8e4a74b1cb
|
borked
|
2020-06-14 20:46:20 -04:00 |
|
|
sshleifer
|
86034ae640
|
Merge branch 'distilbart-clean' into theseus
|
2020-06-14 19:51:25 -04:00 |
|
|
sshleifer
|
5283878c9f
|
Move stuff to utils
|
2020-06-14 19:17:31 -04:00 |
|
|
sshleifer
|
6bdfb14664
|
boom boom
|
2020-06-14 19:07:15 -04:00 |
|
|
sshleifer
|
9e95429843
|
docs
|
2020-06-14 18:20:02 -04:00 |
|
|
sshleifer
|
c9597fef42
|
docs
|
2020-06-14 18:15:28 -04:00 |
|
|
sshleifer
|
c34b886cd1
|
Wandb logger
|
2020-06-14 18:11:22 -04:00 |
|
|
sshleifer
|
f179e7b37c
|
Allow wandb logger
|
2020-06-14 17:58:41 -04:00 |
|
|
sshleifer
|
969c271bd7
|
more honest docs
|
2020-06-14 20:18:43 +00:00 |
|
|
sshleifer
|
9f98a6ac15
|
docs
|
2020-06-14 16:07:25 -04:00 |
|
|
sshleifer
|
4606bda735
|
Bash cleanup
|
2020-06-14 19:47:04 +00:00 |
|
|
sshleifer
|
6bf996f58d
|
boom boom
|
2020-06-14 15:31:46 -04:00 |
|
|
sshleifer
|
35a82ee87f
|
boom boom
|
2020-06-14 15:01:50 -04:00 |
|
|
sshleifer
|
379e8c7dba
|
Cleanup
|
2020-06-14 15:00:35 -04:00 |
|
|
sshleifer
|
350eeb7cd2
|
style
|
2020-06-14 13:17:09 -04:00 |
|
|
sshleifer
|
c06e38add3
|
boom boom
|
2020-06-14 13:15:17 -04:00 |
|
|
sshleifer
|
d94b09d285
|
started
|
2020-06-13 20:27:10 -04:00 |
|
|
sshleifer
|
eab9779732
|
better mask logic
|
2020-06-13 20:12:11 -04:00 |
|
|
sshleifer
|
4a6b23ee40
|
boom boom
|
2020-06-13 20:11:41 -04:00 |
|
|
sshleifer
|
e2d45445c3
|
style
|
2020-06-13 19:55:14 -04:00 |
|
|
sshleifer
|
de7035d9f6
|
style
|
2020-06-13 19:49:35 -04:00 |
|
|
sshleifer
|
0274338aff
|
original tests pass
|
2020-06-13 16:40:04 -04:00 |
|
|
sshleifer
|
e67ad41ae7
|
boom boom
|
2020-06-13 15:33:00 -04:00 |
|
|
sshleifer
|
c5a1de5b75
|
boom boom
|
2020-06-13 15:30:03 -04:00 |
|