Commit Graph
98 Commits
Author SHA1 Message Date
thomwolf b80684b23f fixing run openai gpt example 2019-02-08 22:31:32 +01:00
thomwolf 7b4b0cf966 logging 2019-02-08 11:16:29 +01:00
thomwolf 4bbb9f2d68 log loss - helpers 2019-02-08 11:14:29 +01:00
thomwolf 5d7e845712 fix model on cuda 2019-02-08 11:08:43 +01:00
thomwolf eccb2f0163 hot fix 2019-02-08 11:05:20 +01:00
thomwolf 5adc20723b add distant debugging 2019-02-08 11:03:59 +01:00
thomwolf 777459b471 run openai example running 2019-02-08 10:33:14 +01:00
thomwolf 6bc082da0a updating examples 2019-02-08 00:02:26 +01:00
thomwolf e77721e4fe renamed examples 2019-02-07 23:15:15 +01:00
thomwolf d482e3d79d adding examples for openai and transformer-xl 2019-02-07 17:06:41 +01:00
thomwolf ed47cb6cba fixing transfo eval script 2019-02-06 16:22:17 +01:00
Thomas Wolf 848aae49e1 Merge branch 'master' into python_2 2019-02-06 00:13:20 +01:00
thomwolf 448937c00d python 2 compatibility 2019-02-06 00:07:46 +01:00
thomwolf d609ba24cb resolving merge conflicts 2019-02-05 16:14:25 +01:00
Thomas Wolf 64ce900974 Merge pull request #248 from JoeDumoulin/squad1.1-fix
fix prediction on run-squad.py example
2019-02-05 16:00:51 +01:00
Thomas Wolf e9e77cd3c4 Merge pull request #218 from matej-svejda/master
Fix learning rate problems in run_classifier.py
2019-02-05 15:40:44 +01:00
thomwolf 1579c53635 more explicit notation: num_train_step => num_train_optimization_steps 2019-02-05 15:36:33 +01:00
joe dumoulin aa90e0c36a fix prediction on run-squad.py example 2019-02-01 10:15:44 -08:00
Thomas Wolf 8f8bbd4a4c Merge pull request #244 from deepset-ai/prettify_lm_masking
Avoid confusion of inplace LM masking
2019-02-01 12:17:50 +01:00
tholor ce75b169bd avoid confusion of inplace masking of tokens_a / tokens_b 2019-01-31 11:42:06 +01:00
Surya Kasturi 9bf528877e Update run_squad.py 2019-01-30 15:09:31 -05:00
Surya Kasturi af2b78601b Update run_squad2.py 2019-01-30 15:08:56 -05:00
Matej Svejda 5169069997 make examples consistent, revert error in num_train_steps calculation 2019-01-30 11:47:25 +01:00
Matej Svejda 9c6a48c8c3 fix learning rate/fp16 and warmup problem for all examples 2019-01-27 14:07:24 +01:00
Matej Svejda 01ff4f82ba learning rate problems in run_classifier.py 2019-01-22 23:40:06 +01:00
liangtaiwan be9fa192f0 don't save if do not train 2019-01-18 00:41:55 +08:00
thomwolf a28dfc8659 fix eval for wt103 2019-01-16 11:18:19 +01:00
thomwolf 8831c68803 fixing various parts of model conversion, loading and weights sharing 2019-01-16 10:31:16 +01:00
thomwolf bcd4aa8fe0 update evaluation example 2019-01-15 23:32:34 +01:00
thomwolf a69ec2c722 improved corpus and tokenization conversion - added evaluation script 2019-01-15 23:17:46 +01:00
Thomas Wolf 4e0cba1053 Merge pull request #191 from nhatchan/20190113_py35_finetune
lm_finetuning compatibility with Python 3.5
2019-01-14 09:40:07 +01:00
nhatchan 6c65cb2492 lm_finetuning compatibility with Python 3.5
dicts are not ordered in Python 3.5 or prior, which is a cause of #175.
This PR replaces one with a list, to keep its order.
2019-01-13 21:09:13 +09:00
Li Dong a2da2b4109 [bug fix] args.do_lower_case is always True
The "default=True" makes args.do_lower_case always True.

```python
parser.add_argument("--do_lower_case",
                        default=True,
                        action='store_true')
```
2019-01-13 19:51:11 +08:00
tholor 506e5bb0c8 add do_lower_case arg and adjust model saving for lm finetuning. 2019-01-11 08:32:46 +01:00
Thomas Wolf e485829a41 Merge pull request #174 from abeljim/master
Added Squad 2.0
2019-01-10 23:40:45 +01:00
Sang-Kil Park 64326dccfb Fix it to run properly even if without --do_train param.
It was modified similar to `run_classifier.py`, and Fixed to run properly even if without `--do_train` param.
2019-01-10 21:51:39 +09:00
thomwolf e5c78c6684 update readme and few typos 2019-01-10 01:40:00 +01:00
thomwolf fa5222c296 update readme 2019-01-10 01:25:28 +01:00
Unknown b3628f117e Added Squad 2.0 2019-01-08 15:13:13 -08:00
thomwolf ab90d4cddd adding docs and example for OpenAI GPT 2019-01-09 00:12:43 +01:00
thomwolf 2e4db64cab add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples 2019-01-07 13:06:42 +01:00
thomwolf c9fd350567 remove default when action is store_true in arguments 2019-01-07 13:01:54 +01:00
Thomas Wolf d3d56f9a0b Merge pull request #166 from likejazz/patch-1
Fix error when `bert_model` param is path or url.
2019-01-07 12:40:55 +01:00
Thomas Wolf 766c6b2ce3 Merge pull request #159 from jaderabbit/master
Allow do_eval to be used without do_train and to use the pretrained model in the output folder
2019-01-07 12:31:06 +01:00
Thomas Wolf 77966a43a4 Merge pull request #156 from rodgzilla/cl_args_doc
Adding new pretrained model to the help of the `bert_model` argument.
2019-01-07 12:27:16 +01:00
Thomas Wolf 2e8c5c00ec Merge pull request #141 from SinghJasdeep/patch-1
loading saved model when n_classes != 2
2019-01-07 12:21:13 +01:00
Sang-Kil Park ca4e7aaa72 Fix error when bert_model param is path or url.
Error occurs when `bert_model` param is path or url. Therefore, if it is path, specify the last path to prevent error.
2019-01-05 11:42:54 +09:00
Jade Abbott 193e2df8ba Remove rogue comment 2019-01-03 13:13:06 +02:00
Jade Abbott c64de50ea4 nb_tr_steps is not initialized 2019-01-03 12:34:57 +02:00
Jade Abbott b96149a19b Training loss is not initialized if only do_eval is specified 2019-01-03 10:32:10 +02:00