 thomwolf
|
b80684b23f
|
fixing run openai gpt example
|
2019-02-08 22:31:32 +01:00 |
|
|
thomwolf
|
80607874c1
|
fix layer norm epsilon in OpenAI GPT
|
2019-02-08 21:49:05 +01:00 |
|
|
thomwolf
|
7b4b0cf966
|
logging
|
2019-02-08 11:16:29 +01:00 |
|
|
thomwolf
|
4bbb9f2d68
|
log loss - helpers
|
2019-02-08 11:14:29 +01:00 |
|
|
thomwolf
|
5d7e845712
|
fix model on cuda
|
2019-02-08 11:08:43 +01:00 |
|
|
thomwolf
|
eccb2f0163
|
hot fix
|
2019-02-08 11:05:20 +01:00 |
|
|
thomwolf
|
5adc20723b
|
add distant debugging
|
2019-02-08 11:03:59 +01:00 |
|
|
thomwolf
|
5ee4f17234
|
adding option to load on cpu
|
2019-02-08 10:37:40 +01:00 |
|
|
thomwolf
|
777459b471
|
run openai example running
|
2019-02-08 10:33:14 +01:00 |
|
|
thomwolf
|
edcb56fd96
|
more explicit variable name
|
2019-02-08 09:54:49 +01:00 |
|
|
thomwolf
|
6bc082da0a
|
updating examples
|
2019-02-08 00:02:26 +01:00 |
|
|
thomwolf
|
eb8fda51f4
|
update docstrings
|
2019-02-07 23:15:20 +01:00 |
|
|
thomwolf
|
e77721e4fe
|
renamed examples
|
2019-02-07 23:15:15 +01:00 |
|
|
thomwolf
|
009b581316
|
updated readme
|
2019-02-07 23:15:05 +01:00 |
|
|
thomwolf
|
f99f2fb661
|
docstrings
|
2019-02-07 17:07:22 +01:00 |
|
|
thomwolf
|
438db43d46
|
update adaptive softmax head
|
2019-02-07 17:07:15 +01:00 |
|
|
thomwolf
|
c306869ea2
|
add two transformer xl models
|
2019-02-07 17:07:03 +01:00 |
|
|
thomwolf
|
d482e3d79d
|
adding examples for openai and transformer-xl
|
2019-02-07 17:06:41 +01:00 |
|
|
thomwolf
|
9c3c24800b
|
split saved model in config & weights
|
2019-02-07 17:06:17 +01:00 |
|
|
thomwolf
|
2df41663f1
|
added test
|
2019-02-07 17:05:49 +01:00 |
|
|
thomwolf
|
ed47cb6cba
|
fixing transfo eval script
|
2019-02-06 16:22:17 +01:00 |
|
|
thomwolf
|
973926431e
|
fix differencies with tensorflow version (mem cells and adaptive sofmax clusters)
|
2019-02-06 15:42:29 +01:00 |
|
|
thomwolf
|
ba9e4eb354
|
fix unicode in tokenization tests
|
2019-02-06 00:28:00 +01:00 |
|
|
thomwolf
|
34bdb7f9cb
|
update circle-ci for python 2.7 and 3.5
|
2019-02-06 00:25:12 +01:00 |
|
|
thomwolf
|
448937c00d
|
python 2 compatibility
|
2019-02-06 00:07:46 +01:00 |
|
|
thomwolf
|
ba37ddc5ce
|
fix run_lm_modeling example command line
|
2019-02-06 00:07:08 +01:00 |
|
|
thomwolf
|
822915142b
|
fix docstring
|
2019-02-05 16:34:32 +01:00 |
|
|
thomwolf
|
d609ba24cb
|
resolving merge conflicts
|
2019-02-05 16:14:25 +01:00 |
|
|
thomwolf
|
bde1eeebe0
|
rename
|
2019-02-05 16:11:22 +01:00 |
|
|
thomwolf
|
3ea3b00e59
|
merge squad example in single example
|
2019-02-05 16:10:27 +01:00 |
|
|
thomwolf
|
d8e3bdbb4c
|
moved up to current master
|
2019-02-05 16:09:39 +01:00 |
|
|
thomwolf
|
0ad9b239a1
|
gitignore
|
2019-02-05 15:43:11 +01:00 |
|
|
thomwolf
|
1579c53635
|
more explicit notation: num_train_step => num_train_optimization_steps
|
2019-02-05 15:36:33 +01:00 |
|
|
thomwolf
|
6179f537a3
|
clean up tokenization spaces
|
2019-02-04 17:41:22 +01:00 |
|
|
thomwolf
|
850da1cc36
|
strip decoded outputs
|
2019-02-04 17:35:05 +01:00 |
|
|
thomwolf
|
01a3966bc6
|
more options on special tokens
|
2019-02-04 17:26:25 +01:00 |
|
|
thomwolf
|
05f961840b
|
logging
|
2019-02-04 13:06:19 +01:00 |
|
|
thomwolf
|
3a848111e6
|
update config, docstrings and readme to switch to seperated tokens and position embeddings
|
2019-01-29 11:00:11 +01:00 |
|
|
thomwolf
|
98c96fb1a7
|
splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests
|
2019-01-29 10:31:42 +01:00 |
|
|
thomwolf
|
5456d82311
|
more versatile model loading
|
2019-01-29 09:54:18 +01:00 |
|
|
thomwolf
|
9b2540b5a7
|
update __init__
|
2019-01-29 09:54:08 +01:00 |
|
|
thomwolf
|
bd3b3aee9c
|
update
|
2019-01-28 17:47:29 +01:00 |
|
|
thomwolf
|
a45a9cc0e1
|
update tests
|
2019-01-28 17:16:02 +01:00 |
|
|
thomwolf
|
b12616fd8e
|
updating code organization to fix imports
|
2019-01-28 17:03:39 +01:00 |
|
|
thomwolf
|
d77dd62ff8
|
directly load from TF checkpoints + code cleanup
|
2019-01-28 16:50:23 +01:00 |
|
|
thomwolf
|
9c35c132fa
|
apex LayerNorm
|
2019-01-17 09:19:19 +01:00 |
|
|
thomwolf
|
b9c77b98d5
|
fix transposition in model conversion and memory initialization
|
2019-01-17 00:33:21 +01:00 |
|
|
thomwolf
|
009101de12
|
fix loading bug and check full conversion of model
|
2019-01-16 12:16:20 +01:00 |
|
|
thomwolf
|
fea15cc9f5
|
update model conversion
|
2019-01-16 11:54:54 +01:00 |
|
|
thomwolf
|
a28dfc8659
|
fix eval for wt103
|
2019-01-16 11:18:19 +01:00 |
|
|
thomwolf
|
c03c12687f
|
fix __main__ entry script
|
2019-01-16 10:55:22 +01:00 |
|
|
thomwolf
|
8831c68803
|
fixing various parts of model conversion, loading and weights sharing
|
2019-01-16 10:31:16 +01:00 |
|
|
thomwolf
|
bcd4aa8fe0
|
update evaluation example
|
2019-01-15 23:32:34 +01:00 |
|
|
thomwolf
|
a69ec2c722
|
improved corpus and tokenization conversion - added evaluation script
|
2019-01-15 23:17:46 +01:00 |
|
|
thomwolf
|
7d03c53718
|
conversion working
|
2019-01-15 16:07:25 +01:00 |
|
|
thomwolf
|
3a9c88377f
|
adding Transformer XL
|
2019-01-15 12:59:38 +01:00 |
|
|
thomwolf
|
e5c78c6684
|
update readme and few typos
|
2019-01-10 01:40:00 +01:00 |
|
|
thomwolf
|
fa5222c296
|
update readme
|
2019-01-10 01:25:28 +01:00 |
|
|
thomwolf
|
ab90d4cddd
|
adding docs and example for OpenAI GPT
|
2019-01-09 00:12:43 +01:00 |
|
|
thomwolf
|
dc5df92fa8
|
added LM head for OpenAI
|
2019-01-08 17:18:47 +01:00 |
|
|
thomwolf
|
3cf12b235a
|
added tests + fixed losses
|
2019-01-08 16:24:23 +01:00 |
|
|
thomwolf
|
eed51c5bdf
|
add OpenAI GPT
|
2019-01-08 12:26:58 +01:00 |
|
|
thomwolf
|
793dcd236b
|
Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT into fifth-release
|
2019-01-07 13:37:55 +01:00 |
|
|
thomwolf
|
2e4db64cab
|
add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples
|
2019-01-07 13:06:42 +01:00 |
|
|
thomwolf
|
c9fd350567
|
remove default when action is store_true in arguments
|
2019-01-07 13:01:54 +01:00 |
|
|
thomwolf
|
93f563b8a8
|
adding OpenAI GPT
|
2019-01-07 12:55:36 +01:00 |
|
|
thomwolf
|
d821358884
|
update readme
|
2018-12-14 15:15:17 +01:00 |
|
|
thomwolf
|
37378898a2
|
adding DockerFile
|
2018-12-14 15:02:32 +01:00 |
|
|
thomwolf
|
4a4b0e5783
|
remove logging. basicConfig from library code
|
2018-12-14 14:46:25 +01:00 |
|
|
thomwolf
|
ae88eb88a4
|
set encoding to 'utf-8' in calls to open
|
2018-12-14 13:48:58 +01:00 |
|
|
thomwolf
|
e1eab59aac
|
no fp16 on evaluation
|
2018-12-13 14:54:02 +01:00 |
|
|
thomwolf
|
087798b7fa
|
fix reloading model for evaluation in examples
|
2018-12-13 14:48:12 +01:00 |
|
|
thomwolf
|
0f544625f4
|
fix swag example for work with apex
|
2018-12-13 13:35:59 +01:00 |
|
|
thomwolf
|
0cf88ff084
|
make examples work without apex
|
2018-12-13 13:28:00 +01:00 |
|
|
thomwolf
|
52c53f39d0
|
clean up apex integration
|
2018-12-13 13:02:17 +01:00 |
|
|
thomwolf
|
4946c2c500
|
run_swag example in readme
|
2018-12-13 13:02:07 +01:00 |
|
|
thomwolf
|
d23eed85bb
|
model loading apex modification
|
2018-12-13 12:53:17 +01:00 |
|
|
thomwolf
|
1cbb32a542
|
include version number + comment in setup.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
ce52177638
|
added version in __init__.py
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
d3fcec1a3e
|
add saving and loading model in examples
|
2018-12-13 12:50:44 +01:00 |
|
|
thomwolf
|
93f335ef86
|
add pretrained loading from state_dict
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
b3caec5a56
|
adding save checkpoint and loading in examples
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
85fff78c2d
|
compatibility PT 1.0 and 0.4.1
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
13bf0d4659
|
fixing Adam weights skip in TF convert script
|
2018-12-13 12:48:13 +01:00 |
|
|
thomwolf
|
1df6f26214
|
Merge branch 'fourth-release' of https://github.com/huggingface/pytorch-pretrained-BERT into fourth-release
|
2018-12-11 12:20:31 +01:00 |
|
|
thomwolf
|
770f805ae5
|
include version number + comment in setup.py
|
2018-12-11 12:20:22 +01:00 |
|
|
thomwolf
|
ed3b62cd3b
|
added version in __init__.py
|
2018-12-11 12:12:08 +01:00 |
|
|
thomwolf
|
b13abfa9fe
|
add saving and loading model in examples
|
2018-12-11 11:58:07 +01:00 |
|
|
thomwolf
|
270fa2f20b
|
add pretrained loading from state_dict
|
2018-12-11 11:50:38 +01:00 |
|
|
thomwolf
|
174cdbccde
|
adding save checkpoint and loading in examples
|
2018-12-09 17:04:23 -05:00 |
|
|
thomwolf
|
1db916b5be
|
compatibility PT 1.0 and 0.4.1
|
2018-12-09 16:57:51 -05:00 |
|
|
thomwolf
|
68f77303b2
|
fixing Adam weights skip in TF convert script
|
2018-12-09 16:17:11 -05:00 |
|
|
thomwolf
|
f9f3bdd60b
|
update readme
|
2018-11-30 23:05:18 +01:00 |
|
|
thomwolf
|
52ff0590ff
|
tup => tpu
|
2018-11-30 23:01:10 +01:00 |
|
|
thomwolf
|
511bce58bd
|
update new token classification model
|
2018-11-30 22:56:02 +01:00 |
|
|
thomwolf
|
258eb50086
|
bump up version
|
2018-11-30 22:55:33 +01:00 |
|
|
thomwolf
|
d787c6be8c
|
improve docstrings and fix new token classification model
|
2018-11-30 22:55:26 +01:00 |
|
|
thomwolf
|
ed302a73f4
|
add new token classification model
|
2018-11-30 22:55:03 +01:00 |
|
|
thomwolf
|
89d47230d7
|
clean up classification model output
|
2018-11-30 22:54:53 +01:00 |
|
|
thomwolf
|
7f7c41b0c1
|
tests for all model classes with and without labels
|
2018-11-30 22:54:33 +01:00 |
|