 thomwolf
|
ae88eb88a4
|
set encoding to 'utf-8' in calls to open
|
2018-12-14 13:48:58 +01:00 |
|
|
thomwolf
|
e1eab59aac
|
no fp16 on evaluation
|
2018-12-13 14:54:02 +01:00 |
|
|
thomwolf
|
087798b7fa
|
fix reloading model for evaluation in examples
|
2018-12-13 14:48:12 +01:00 |
|
|
thomwolf
|
0f544625f4
|
fix swag example for work with apex
|
2018-12-13 13:35:59 +01:00 |
|
|
thomwolf
|
0cf88ff084
|
make examples work without apex
|
2018-12-13 13:28:00 +01:00 |
|
|
thomwolf
|
52c53f39d0
|
clean up apex integration
|
2018-12-13 13:02:17 +01:00 |
|
|
thomwolf
|
4946c2c500
|
run_swag example in readme
|
2018-12-13 13:02:07 +01:00 |
|
|
thomwolf
|
d23eed85bb
|
model loading apex modification
|
2018-12-13 12:53:17 +01:00 |
|
|
thomwolf
|
1cbb32a542
|
include version number + comment in setup.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
ce52177638
|
added version in __init__.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
d3fcec1a3e
|
add saving and loading model in examples
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
93f335ef86
|
add pretrained loading from state_dict
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
b3caec5a56
|
adding save checkpoint and loading in examples
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
85fff78c2d
|
compatibility PT 1.0 and 0.4.1
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
13bf0d4659
|
fixing Adam weights skip in TF convert script
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
1df6f26214
|
Merge branch 'fourth-release' of https://github.com/huggingface/pytorch-pretrained-BERT into fourth-release
|
2018-12-11 12:20:31 +01:00 |
|
|
thomwolf
|
770f805ae5
|
include version number + comment in setup.py
|
2018-12-11 12:20:22 +01:00 |
|
|
thomwolf
|
ed3b62cd3b
|
added version in __init__.py
|
2018-12-11 12:12:08 +01:00 |
|
|
thomwolf
|
b13abfa9fe
|
add saving and loading model in examples
|
2018-12-11 11:58:07 +01:00 |
|
|
thomwolf
|
270fa2f20b
|
add pretrained loading from state_dict
|
2018-12-11 11:50:38 +01:00 |
|
|
thomwolf
|
174cdbccde
|
adding save checkpoint and loading in examples
|
2018-12-09 17:04:23 -05:00 |
|
|
thomwolf
|
1db916b5be
|
compatibility PT 1.0 and 0.4.1
|
2018-12-09 16:57:51 -05:00 |
|
|
thomwolf
|
68f77303b2
|
fixing Adam weights skip in TF convert script
|
2018-12-09 16:17:11 -05:00 |
|
|
thomwolf
|
f9f3bdd60b
|
update readme
|
2018-11-30 23:05:18 +01:00 |
|
|
thomwolf
|
52ff0590ff
|
tup => tpu
|
2018-11-30 23:01:10 +01:00 |
|
|
thomwolf
|
511bce58bd
|
update new token classification model
|
2018-11-30 22:56:02 +01:00 |
|
|
thomwolf
|
258eb50086
|
bump up version
|
2018-11-30 22:55:33 +01:00 |
|
|
thomwolf
|
d787c6be8c
|
improve docstrings and fix new token classification model
|
2018-11-30 22:55:26 +01:00 |
|
|
thomwolf
|
ed302a73f4
|
add new token classification model
|
2018-11-30 22:55:03 +01:00 |
|
|
thomwolf
|
89d47230d7
|
clean up classification model output
|
2018-11-30 22:54:53 +01:00 |
|
|
thomwolf
|
7f7c41b0c1
|
tests for all model classes with and without labels
|
2018-11-30 22:54:33 +01:00 |
|
|
thomwolf
|
257a35134a
|
fix pickle dump in run_squad example
|
2018-11-30 14:23:09 +01:00 |
|
|
thomwolf
|
c588453a0f
|
fix run_squad
|
2018-11-30 14:22:40 +01:00 |
|
|
thomwolf
|
d6f06c03f4
|
fixed loading pre-trained tokenizer from directory
|
2018-11-30 14:09:06 +01:00 |
|
|
thomwolf
|
532a81d3d6
|
fixed doc_strings
|
2018-11-30 13:57:01 +01:00 |
|
|
thomwolf
|
296f006132
|
added BertForTokenClassification model
|
2018-11-30 13:56:53 +01:00 |
|
|
thomwolf
|
298107fed7
|
Added new bert models
|
2018-11-30 13:56:02 +01:00 |
|
|
thomwolf
|
0541442558
|
add do_lower_case in examples
|
2018-11-30 13:47:33 +01:00 |
|
|
thomwolf
|
32167cdf4b
|
remove convert_to_unicode and printable_text from examples
|
2018-11-26 23:33:22 +01:00 |
|
|
thomwolf
|
ce37b8e481
|
bump version in setup.py
|
2018-11-26 10:45:48 +01:00 |
|
|
thomwolf
|
05053d163c
|
update cache_dir in readme and examples
|
2018-11-26 10:45:13 +01:00 |
|
|
thomwolf
|
63ae5d2134
|
added cache_dir option in from_pretrained
|
2018-11-26 10:21:56 +01:00 |
|
|
thomwolf
|
029bdc0d50
|
fixing readme examples
|
2018-11-26 09:56:41 +01:00 |
|
|
thomwolf
|
ebaacba38b
|
fixing typo in docstring
|
2018-11-26 09:55:15 +01:00 |
|
|
thomwolf
|
870d71636e
|
fixing target size in crossentropy losses
|
2018-11-26 09:51:34 +01:00 |
|
|
thomwolf
|
982339d829
|
fixing unicode error
|
2018-11-23 12:22:12 +01:00 |
|
|
thomwolf
|
6b2136a8a9
|
fixing weights decay in run_squad example
|
2018-11-20 10:12:44 +01:00 |
|
|
thomwolf
|
eed255a58d
|
fixing CLI typo in readme
|
2018-11-20 10:02:57 +01:00 |
|
|
thomwolf
|
2f21497d3e
|
fixing param.grad is None in fp16 examples
|
2018-11-20 10:01:21 +01:00 |
|
|
thomwolf
|
27ee0fff3c
|
add no_cuda args in extract_features
|
2018-11-17 23:04:44 +01:00 |
|
|
thomwolf
|
aa50fd196f
|
remove unused arguments in example scripts
|
2018-11-17 23:01:05 +01:00 |
|
|
thomwolf
|
47a7d4ec14
|
update examples from master
|
2018-11-17 12:21:35 +01:00 |
|
|
thomwolf
|
c8cba67742
|
clean up readme and examples
|
2018-11-17 12:19:16 +01:00 |
|
|
thomwolf
|
757750d6f6
|
fix tests
|
2018-11-17 11:58:14 +01:00 |
|
|
thomwolf
|
a99b971738
|
bump up version minor
|
2018-11-17 10:43:39 +01:00 |
|
|
thomwolf
|
4e46affc34
|
updating examples
|
2018-11-17 10:30:54 +01:00 |
|
|
thomwolf
|
d0673c7dbd
|
fix links
|
2018-11-17 08:59:29 +01:00 |
|
|
thomwolf
|
68b937aa40
|
sub section overviews
|
2018-11-17 08:55:56 +01:00 |
|
|
thomwolf
|
c54d8b1847
|
fixing links in readme
|
2018-11-17 08:46:17 +01:00 |
|
|
thomwolf
|
f920eff8c3
|
update readme
|
2018-11-17 08:42:45 +01:00 |
|
|
thomwolf
|
886cb49792
|
updating readme and notebooks
|
2018-11-16 14:31:15 +01:00 |
|
|
thomwolf
|
fd647e8c87
|
comparison masked LM ok
|
2018-11-16 11:04:31 +01:00 |
|
|
thomwolf
|
02173a1a0a
|
fixing error in isnan test for optimizer_on_cpu & fp16
|
2018-11-15 21:49:12 +01:00 |
|
|
thomwolf
|
cba85a67b9
|
fix nan in optimizer_on_cpu
|
2018-11-15 21:47:41 +01:00 |
|
|
thomwolf
|
1de35b624b
|
preparing for first release
|
2018-11-15 20:56:10 +01:00 |
|
|
thomwolf
|
d940eeda54
|
typo
|
2018-11-12 15:26:46 +01:00 |
|
|
thomwolf
|
1cf0a16c67
|
cleaning up readme
|
2018-11-12 15:24:47 +01:00 |
|
|
thomwolf
|
66b0090877
|
add fp16 training
|
2018-11-12 15:15:02 +01:00 |
|
|
thomwolf
|
a81a1ef8e9
|
fixing learning rate schedule when using gradient_accumulation_steps
|
2018-11-10 16:11:14 +01:00 |
|
|
thomwolf
|
ea85cca8ab
|
adding optimize_on_cpu explanation in readme
|
2018-11-09 11:42:37 +01:00 |
|
|
thomwolf
|
5f04aa00ed
|
option to perform optimization and keep the optimizer averages on CPU
|
2018-11-09 11:28:14 +01:00 |
|
|
thomwolf
|
9e95cd8cd6
|
clean up optimizer from unused functions
|
2018-11-09 11:23:55 +01:00 |
|
|
thomwolf
|
34a1a01091
|
update code comment
|
2018-11-09 09:31:20 +01:00 |
|
|
thomwolf
|
34bdc8b54f
|
remove duplicate accumulate gradient step arguments
|
2018-11-09 09:19:45 +01:00 |
|
|
thomwolf
|
2c5d993ba4
|
update readme - fix SQuAD model on multi-GPU
|
2018-11-08 21:22:22 +01:00 |
|
|
thomwolf
|
48d4a5317c
|
typo fix in output tuple
|
2018-11-07 23:51:12 +01:00 |
|
|
thomwolf
|
dbc318a4c6
|
cleaning up - speeding up a bit multi-gpu
|
2018-11-07 22:22:55 +01:00 |
|
|
thomwolf
|
6bb7510a50
|
fixing pre-processing bug - averaging loss for gradient accumulation - no_grad on evaluation
|
2018-11-07 22:12:41 +01:00 |
|
|
thomwolf
|
a1126237a9
|
clean up logits extraction logic
|
2018-11-06 17:31:15 +01:00 |
|
|
thomwolf
|
2a97fe220b
|
fixing weights initialization in the model and out of span clamping
|
2018-11-06 17:26:33 +01:00 |
|
|
thomwolf
|
907d3569c1
|
cleaning up SQuAD notebook - more explanation - fixing error
|
2018-11-06 11:13:43 +01:00 |
|
|
thomwolf
|
88e793f31a
|
fix typos
|
2018-11-05 16:14:19 +01:00 |
|
|
thomwolf
|
3914eed505
|
update readme
|
2018-11-05 16:09:27 +01:00 |
|
|
thomwolf
|
bab5d13077
|
update optimizer documentation
|
2018-11-05 16:09:21 +01:00 |
|
|
thomwolf
|
7394eb47a5
|
update readme
|
2018-11-05 15:35:44 +01:00 |
|
|
thomwolf
|
e6646751ac
|
update notebooks
|
2018-11-05 15:02:50 +01:00 |
|
|
thomwolf
|
b705c9eff5
|
remove small script, moved notebooks to notebook folder
|
2018-11-05 14:55:08 +01:00 |
|
|
thomwolf
|
3a301d443b
|
update gitignore
|
2018-11-05 14:53:43 +01:00 |
|
|
thomwolf
|
711d3f9f2b
|
remove tensorflow_code
|
2018-11-05 14:53:03 +01:00 |
|
|
thomwolf
|
7875b1a8e0
|
notebook update
|
2018-11-05 14:50:44 +01:00 |
|
|
thomwolf
|
c3527cfbc4
|
ignore SQuAD targets outside of seq_length
|
2018-11-05 14:18:48 +01:00 |
|
|
thomwolf
|
1b99cdf71b
|
script that use a small portion of squad only
|
2018-11-05 13:54:54 +01:00 |
|
|
thomwolf
|
2f4765d3ed
|
fix multi-gpu squad loss
|
2018-11-05 13:46:14 +01:00 |
|
|
thomwolf
|
955cee33a5
|
updating SQuAD comparison
|
2018-11-05 13:21:53 +01:00 |
|
|
thomwolf
|
5622d8320f
|
allowing to load small number of examples
|
2018-11-05 13:21:24 +01:00 |
|
|
thomwolf
|
a725db4f6c
|
fixing BertForQuestionAnswering loss computation
|
2018-11-05 13:21:11 +01:00 |
|
|
thomwolf
|
bb5ce67a14
|
adding back tf code + adding models comparison on SQuAD
|
2018-11-05 12:11:32 +01:00 |
|
|
thomwolf
|
3d291dea4a
|
clean up tests
|
2018-11-04 21:27:19 +01:00 |
|
|
thomwolf
|
87da161c2a
|
finishing model test
|
2018-11-04 21:27:10 +01:00 |
|
|
thomwolf
|
d69b0b0e90
|
fixes + clean up + mask is long
|
2018-11-04 21:26:54 +01:00 |
|