 thomwolf
|
98c96fb1a7
|
splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests
|
2019-01-29 10:31:42 +01:00 |
|
|
thomwolf
|
5456d82311
|
more versatile model loading
|
2019-01-29 09:54:18 +01:00 |
|
|
thomwolf
|
9b2540b5a7
|
update __init__
|
2019-01-29 09:54:08 +01:00 |
|
|
thomwolf
|
bd3b3aee9c
|
update
|
2019-01-28 17:47:29 +01:00 |
|
|
thomwolf
|
a45a9cc0e1
|
update tests
|
2019-01-28 17:16:02 +01:00 |
|
|
thomwolf
|
b12616fd8e
|
updating code organization to fix imports
|
2019-01-28 17:03:39 +01:00 |
|
|
thomwolf
|
d77dd62ff8
|
directly load from TF checkpoints + code cleanup
|
2019-01-28 16:50:23 +01:00 |
|
|
thomwolf
|
9c35c132fa
|
apex LayerNorm
|
2019-01-17 09:19:19 +01:00 |
|
|
thomwolf
|
b9c77b98d5
|
fix transposition in model conversion and memory initialization
|
2019-01-17 00:33:21 +01:00 |
|
|
thomwolf
|
009101de12
|
fix loading bug and check full conversion of model
|
2019-01-16 12:16:20 +01:00 |
|
|
thomwolf
|
fea15cc9f5
|
update model conversion
|
2019-01-16 11:54:54 +01:00 |
|
|
thomwolf
|
a28dfc8659
|
fix eval for wt103
|
2019-01-16 11:18:19 +01:00 |
|
|
thomwolf
|
c03c12687f
|
fix __main__ entry script
|
2019-01-16 10:55:22 +01:00 |
|
|
thomwolf
|
8831c68803
|
fixing various parts of model conversion, loading and weights sharing
|
2019-01-16 10:31:16 +01:00 |
|
|
thomwolf
|
bcd4aa8fe0
|
update evaluation example
|
2019-01-15 23:32:34 +01:00 |
|
|
thomwolf
|
a69ec2c722
|
improved corpus and tokenization conversion - added evaluation script
|
2019-01-15 23:17:46 +01:00 |
|
|
thomwolf
|
7d03c53718
|
conversion working
|
2019-01-15 16:07:25 +01:00 |
|
|
thomwolf
|
3a9c88377f
|
adding Transformer XL
|
2019-01-15 12:59:38 +01:00 |
|
|
thomwolf
|
e5c78c6684
|
update readme and few typos
|
2019-01-10 01:40:00 +01:00 |
|
|
thomwolf
|
fa5222c296
|
update readme
|
2019-01-10 01:25:28 +01:00 |
|
|
thomwolf
|
ab90d4cddd
|
adding docs and example for OpenAI GPT
|
2019-01-09 00:12:43 +01:00 |
|
|
thomwolf
|
dc5df92fa8
|
added LM head for OpenAI
|
2019-01-08 17:18:47 +01:00 |
|
|
thomwolf
|
3cf12b235a
|
added tests + fixed losses
|
2019-01-08 16:24:23 +01:00 |
|
|
thomwolf
|
eed51c5bdf
|
add OpenAI GPT
|
2019-01-08 12:26:58 +01:00 |
|
|
thomwolf
|
793dcd236b
|
Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT into fifth-release
|
2019-01-07 13:37:55 +01:00 |
|
|
thomwolf
|
2e4db64cab
|
add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples
|
2019-01-07 13:06:42 +01:00 |
|
|
thomwolf
|
c9fd350567
|
remove default when action is store_true in arguments
|
2019-01-07 13:01:54 +01:00 |
|
|
thomwolf
|
93f563b8a8
|
adding OpenAI GPT
|
2019-01-07 12:55:36 +01:00 |
|
|
thomwolf
|
d821358884
|
update readme
|
2018-12-14 15:15:17 +01:00 |
|
|
thomwolf
|
37378898a2
|
adding DockerFile
|
2018-12-14 15:02:32 +01:00 |
|
|
thomwolf
|
4a4b0e5783
|
remove logging. basicConfig from library code
|
2018-12-14 14:46:25 +01:00 |
|
|
thomwolf
|
ae88eb88a4
|
set encoding to 'utf-8' in calls to open
|
2018-12-14 13:48:58 +01:00 |
|
|
thomwolf
|
e1eab59aac
|
no fp16 on evaluation
|
2018-12-13 14:54:02 +01:00 |
|
|
thomwolf
|
087798b7fa
|
fix reloading model for evaluation in examples
|
2018-12-13 14:48:12 +01:00 |
|
|
thomwolf
|
0f544625f4
|
fix swag example for work with apex
|
2018-12-13 13:35:59 +01:00 |
|
|
thomwolf
|
0cf88ff084
|
make examples work without apex
|
2018-12-13 13:28:00 +01:00 |
|
|
thomwolf
|
52c53f39d0
|
clean up apex integration
|
2018-12-13 13:02:17 +01:00 |
|
|
thomwolf
|
4946c2c500
|
run_swag example in readme
|
2018-12-13 13:02:07 +01:00 |
|
|
thomwolf
|
d23eed85bb
|
model loading apex modification
|
2018-12-13 12:53:17 +01:00 |
|
|
thomwolf
|
1cbb32a542
|
include version number + comment in setup.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
ce52177638
|
added version in __init__.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
d3fcec1a3e
|
add saving and loading model in examples
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
93f335ef86
|
add pretrained loading from state_dict
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
b3caec5a56
|
adding save checkpoint and loading in examples
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
85fff78c2d
|
compatibility PT 1.0 and 0.4.1
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
13bf0d4659
|
fixing Adam weights skip in TF convert script
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
1df6f26214
|
Merge branch 'fourth-release' of https://github.com/huggingface/pytorch-pretrained-BERT into fourth-release
|
2018-12-11 12:20:31 +01:00 |
|
|
thomwolf
|
770f805ae5
|
include version number + comment in setup.py
|
2018-12-11 12:20:22 +01:00 |
|
|
thomwolf
|
ed3b62cd3b
|
added version in __init__.py
|
2018-12-11 12:12:08 +01:00 |
|
|
thomwolf
|
b13abfa9fe
|
add saving and loading model in examples
|
2018-12-11 11:58:07 +01:00 |
|
|
thomwolf
|
270fa2f20b
|
add pretrained loading from state_dict
|
2018-12-11 11:50:38 +01:00 |
|
|
thomwolf
|
174cdbccde
|
adding save checkpoint and loading in examples
|
2018-12-09 17:04:23 -05:00 |
|
|
thomwolf
|
1db916b5be
|
compatibility PT 1.0 and 0.4.1
|
2018-12-09 16:57:51 -05:00 |
|
|
thomwolf
|
68f77303b2
|
fixing Adam weights skip in TF convert script
|
2018-12-09 16:17:11 -05:00 |
|
|
thomwolf
|
f9f3bdd60b
|
update readme
|
2018-11-30 23:05:18 +01:00 |
|
|
thomwolf
|
52ff0590ff
|
tup => tpu
|
2018-11-30 23:01:10 +01:00 |
|
|
thomwolf
|
511bce58bd
|
update new token classification model
|
2018-11-30 22:56:02 +01:00 |
|
|
thomwolf
|
258eb50086
|
bump up version
|
2018-11-30 22:55:33 +01:00 |
|
|
thomwolf
|
d787c6be8c
|
improve docstrings and fix new token classification model
|
2018-11-30 22:55:26 +01:00 |
|
|
thomwolf
|
ed302a73f4
|
add new token classification model
|
2018-11-30 22:55:03 +01:00 |
|
|
thomwolf
|
89d47230d7
|
clean up classification model output
|
2018-11-30 22:54:53 +01:00 |
|
|
thomwolf
|
7f7c41b0c1
|
tests for all model classes with and without labels
|
2018-11-30 22:54:33 +01:00 |
|
|
thomwolf
|
257a35134a
|
fix pickle dump in run_squad example
|
2018-11-30 14:23:09 +01:00 |
|
|
thomwolf
|
c588453a0f
|
fix run_squad
|
2018-11-30 14:22:40 +01:00 |
|
|
thomwolf
|
d6f06c03f4
|
fixed loading pre-trained tokenizer from directory
|
2018-11-30 14:09:06 +01:00 |
|
|
thomwolf
|
532a81d3d6
|
fixed doc_strings
|
2018-11-30 13:57:01 +01:00 |
|
|
thomwolf
|
296f006132
|
added BertForTokenClassification model
|
2018-11-30 13:56:53 +01:00 |
|
|
thomwolf
|
298107fed7
|
Added new bert models
|
2018-11-30 13:56:02 +01:00 |
|
|
thomwolf
|
0541442558
|
add do_lower_case in examples
|
2018-11-30 13:47:33 +01:00 |
|
|
thomwolf
|
32167cdf4b
|
remove convert_to_unicode and printable_text from examples
|
2018-11-26 23:33:22 +01:00 |
|
|
thomwolf
|
ce37b8e481
|
bump version in setup.py
|
2018-11-26 10:45:48 +01:00 |
|
|
thomwolf
|
05053d163c
|
update cache_dir in readme and examples
|
2018-11-26 10:45:13 +01:00 |
|
|
thomwolf
|
63ae5d2134
|
added cache_dir option in from_pretrained
|
2018-11-26 10:21:56 +01:00 |
|
|
thomwolf
|
029bdc0d50
|
fixing readme examples
|
2018-11-26 09:56:41 +01:00 |
|
|
thomwolf
|
ebaacba38b
|
fixing typo in docstring
|
2018-11-26 09:55:15 +01:00 |
|
|
thomwolf
|
870d71636e
|
fixing target size in crossentropy losses
|
2018-11-26 09:51:34 +01:00 |
|
|
thomwolf
|
982339d829
|
fixing unicode error
|
2018-11-23 12:22:12 +01:00 |
|
|
thomwolf
|
6b2136a8a9
|
fixing weights decay in run_squad example
|
2018-11-20 10:12:44 +01:00 |
|
|
thomwolf
|
eed255a58d
|
fixing CLI typo in readme
|
2018-11-20 10:02:57 +01:00 |
|
|
thomwolf
|
2f21497d3e
|
fixing param.grad is None in fp16 examples
|
2018-11-20 10:01:21 +01:00 |
|
|
thomwolf
|
27ee0fff3c
|
add no_cuda args in extract_features
|
2018-11-17 23:04:44 +01:00 |
|
|
thomwolf
|
aa50fd196f
|
remove unused arguments in example scripts
|
2018-11-17 23:01:05 +01:00 |
|
|
thomwolf
|
47a7d4ec14
|
update examples from master
|
2018-11-17 12:21:35 +01:00 |
|
|
thomwolf
|
c8cba67742
|
clean up readme and examples
|
2018-11-17 12:19:16 +01:00 |
|
|
thomwolf
|
757750d6f6
|
fix tests
|
2018-11-17 11:58:14 +01:00 |
|
|
thomwolf
|
a99b971738
|
bump up version minor
|
2018-11-17 10:43:39 +01:00 |
|
|
thomwolf
|
4e46affc34
|
updating examples
|
2018-11-17 10:30:54 +01:00 |
|
|
thomwolf
|
d0673c7dbd
|
fix links
|
2018-11-17 08:59:29 +01:00 |
|
|
thomwolf
|
68b937aa40
|
sub section overviews
|
2018-11-17 08:55:56 +01:00 |
|
|
thomwolf
|
c54d8b1847
|
fixing links in readme
|
2018-11-17 08:46:17 +01:00 |
|
|
thomwolf
|
f920eff8c3
|
update readme
|
2018-11-17 08:42:45 +01:00 |
|
|
thomwolf
|
886cb49792
|
updating readme and notebooks
|
2018-11-16 14:31:15 +01:00 |
|
|
thomwolf
|
fd647e8c87
|
comparison masked LM ok
|
2018-11-16 11:04:31 +01:00 |
|
|
thomwolf
|
02173a1a0a
|
fixing error in isnan test for optimizer_on_cpu & fp16
|
2018-11-15 21:49:12 +01:00 |
|
|
thomwolf
|
cba85a67b9
|
fix nan in optimizer_on_cpu
|
2018-11-15 21:47:41 +01:00 |
|
|
thomwolf
|
1de35b624b
|
preparing for first release
|
2018-11-15 20:56:10 +01:00 |
|
|
thomwolf
|
d940eeda54
|
typo
|
2018-11-12 15:26:46 +01:00 |
|
|
thomwolf
|
1cf0a16c67
|
cleaning up readme
|
2018-11-12 15:24:47 +01:00 |
|
|
thomwolf
|
66b0090877
|
add fp16 training
|
2018-11-12 15:15:02 +01:00 |
|
|
thomwolf
|
a81a1ef8e9
|
fixing learning rate schedule when using gradient_accumulation_steps
|
2018-11-10 16:11:14 +01:00 |
|