John Hewitt
|
e14c6b52e3
|
add BertTokenizer flag to skip basic tokenization
|
2019-02-26 20:11:24 -08:00 |
|
Joel Grus
|
8722e9eb3b
|
finish updating docstrings
|
2019-02-23 06:31:59 -08:00 |
|
Stanislas Polu
|
ff22b3acc0
|
Few small nits in GPT-2's code examples
|
2019-02-21 09:15:27 +00:00 |
|
Tong Guo
|
09efcece75
|
Update README.md
|
2019-02-21 11:25:33 +08:00 |
|
Tony Lin
|
5b0e0b61f0
|
fix typo in readme
|
2019-02-19 20:34:18 +08:00 |
|
Davide Fiocco
|
0ae8eece55
|
MInor README typos corrected
|
2019-02-18 21:28:28 +01:00 |
|
sam-qordoba
|
1cb9c76ec5
|
Fix typo in GPT2Model code sample
Typo prevented code from running
|
2019-02-18 09:27:26 -08:00 |
|
Thomas Wolf
|
a25d056b7a
|
update readme
|
2019-02-18 15:30:11 +01:00 |
|
Thomas Wolf
|
517d7c8624
|
update readme
|
2019-02-18 14:39:55 +01:00 |
|
Thomas Wolf
|
ada22a1c9e
|
more details in GPT-2 usage example
|
2019-02-18 14:37:41 +01:00 |
|
Thomas Wolf
|
522733f6cb
|
readme typo fixes
|
2019-02-18 14:32:10 +01:00 |
|
thomwolf
|
d44db1145c
|
update readme
|
2019-02-18 11:12:09 +01:00 |
|
Thomas Wolf
|
0e774e57a6
|
Update readme
Adding details on how to extract a full list of hidden states for the Transformer-XL
|
2019-02-14 08:39:58 +01:00 |
|
Thomas Wolf
|
4e56da38d9
|
Merge pull request #268 from wangxiaodiu/master
fixed a minor bug in README.md
|
2019-02-13 10:19:25 +01:00 |
|
thomwolf
|
67376c02e2
|
update readme for tokenizers
|
2019-02-13 10:11:11 +01:00 |
|
Liang Niu
|
e1b3cfb504
|
fixed a minor bug in README.md
|
2019-02-12 15:54:23 +04:00 |
|
Thomas Wolf
|
3c33499f87
|
fix typo in readme
|
2019-02-12 10:22:54 +01:00 |
|
thomwolf
|
1e71f11dec
|
Release: 0.5.0
|
2019-02-11 14:16:27 +01:00 |
|
thomwolf
|
eebc8abbe2
|
clarify and unify model saving logic in examples
|
2019-02-11 14:04:19 +01:00 |
|
thomwolf
|
81c7e3ec9f
|
fix typo in readme
|
2019-02-11 13:37:12 +01:00 |
|
thomwolf
|
884ca81d87
|
transposing the inputs of Transformer-XL to have a unified interface
|
2019-02-11 13:19:59 +01:00 |
|
thomwolf
|
32fea876bb
|
add distant debugging to run_transfo_xl
|
2019-02-11 12:53:32 +01:00 |
|
thomwolf
|
b31ba23913
|
cuda on in the examples by default
|
2019-02-11 12:15:43 +01:00 |
|
thomwolf
|
2071a9b86e
|
fix python 2.7 imports
|
2019-02-11 10:35:36 +01:00 |
|
thomwolf
|
b514a60c36
|
added tests for OpenAI GPT and Transformer-XL tokenizers
|
2019-02-11 10:17:16 +01:00 |
|
thomwolf
|
9f9909ea2f
|
update readme
|
2019-02-09 16:59:21 +01:00 |
|
thomwolf
|
0c1a6f9b1d
|
update readme
|
2019-02-08 22:32:25 +01:00 |
|
thomwolf
|
009b581316
|
updated readme
|
2019-02-07 23:15:05 +01:00 |
|
thomwolf
|
f99f2fb661
|
docstrings
|
2019-02-07 17:07:22 +01:00 |
|
Thomas Wolf
|
848aae49e1
|
Merge branch 'master' into python_2
|
2019-02-06 00:13:20 +01:00 |
|
thomwolf
|
ba37ddc5ce
|
fix run_lm_modeling example command line
|
2019-02-06 00:07:08 +01:00 |
|
Girishkumar
|
0dd2b750ca
|
Minor update in README
Update links to classes in `modeling.py`
|
2019-01-30 23:49:15 +05:30 |
|
thomwolf
|
3a848111e6
|
update config, docstrings and readme to switch to seperated tokens and position embeddings
|
2019-01-29 11:00:11 +01:00 |
|
Davide Fiocco
|
35115eaf93
|
(very) minor update to README
|
2019-01-16 21:05:24 +01:00 |
|
nhatchan
|
8edc898f63
|
Fix documentation (missing backslashes)
This PR adds missing backslashes in LM Fine-tuning subsection in README.md.
|
2019-01-13 21:23:19 +09:00 |
|
thomwolf
|
e5c78c6684
|
update readme and few typos
|
2019-01-10 01:40:00 +01:00 |
|
thomwolf
|
fa5222c296
|
update readme
|
2019-01-10 01:25:28 +01:00 |
|
Thomas Wolf
|
c18bdb4433
|
Merge pull request #124 from deepset-ai/master
Add example for fine tuning BERT language model
|
2019-01-07 12:03:51 +01:00 |
|
Julien Chaumond
|
8da280ebbe
|
Setup CI
|
2018-12-20 16:33:39 -05:00 |
|
tholor
|
e5fc98c542
|
add exemplary training data. update to nvidia apex. refactor 'item -> line in doc' mapping. add warning for unknown word.
|
2018-12-20 18:30:52 +01:00 |
|
tholor
|
67f4dd56a3
|
update readme for run_lm_finetuning
|
2018-12-19 09:22:37 +01:00 |
|
Julien Chaumond
|
d57763f582
|
Fix typos
|
2018-12-18 19:23:22 -05:00 |
|
Thomas Wolf
|
786cc41299
|
Typos in readme
|
2018-12-17 09:22:18 +01:00 |
|
Daniel Khashabi
|
8b1b93947f
|
Minor fix.
|
2018-12-14 14:10:36 -05:00 |
|
Thomas Wolf
|
8809eb6c93
|
update readme with information on NVIDIA's apex
|
2018-12-14 16:59:39 +01:00 |
|
thomwolf
|
d821358884
|
update readme
|
2018-12-14 15:15:17 +01:00 |
|
thomwolf
|
087798b7fa
|
fix reloading model for evaluation in examples
|
2018-12-13 14:48:12 +01:00 |
|
thomwolf
|
0f544625f4
|
fix swag example for work with apex
|
2018-12-13 13:35:59 +01:00 |
|
thomwolf
|
4946c2c500
|
run_swag example in readme
|
2018-12-13 13:02:07 +01:00 |
|
Thomas Wolf
|
91aab2a6d3
|
Merge pull request #116 from FDecaYed/deyuf/fp16_with_apex
Change to use apex for better fp16 and multi-gpu support
|
2018-12-13 12:32:37 +01:00 |
|