c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
490 Commits 171 Branches 49 Tags
d38caba1690c82943ab312e7b783784726f282d9
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
thomwolf d38caba169 typo in run_squad 2019-02-11 14:10:27 +01:00
thomwolf af62cc5f20 fix run_squad example 2019-02-11 14:06:32 +01:00
thomwolf eebc8abbe2 clarify and unify model saving logic in examples 2019-02-11 14:04:19 +01:00
thomwolf 81c7e3ec9f fix typo in readme 2019-02-11 13:37:12 +01:00
thomwolf e8fe6b7140 adapting transfo tokenizer to transposed inputs 2019-02-11 13:30:04 +01:00
thomwolf 884ca81d87 transposing the inputs of Transformer-XL to have a unified interface 2019-02-11 13:19:59 +01:00
thomwolf 32fea876bb add distant debugging to run_transfo_xl 2019-02-11 12:53:32 +01:00
thomwolf b31ba23913 cuda on in the examples by default 2019-02-11 12:15:43 +01:00
thomwolf 0a9860daa7 tests pass on python 2 and 3 2019-02-11 10:47:52 +01:00
thomwolf 2071a9b86e fix python 2.7 imports 2019-02-11 10:35:36 +01:00
thomwolf 8197eb9f10 update Circle CI config 2019-02-11 10:22:10 +01:00
thomwolf 525eba68ab update Circle CI 2019-02-11 10:19:25 +01:00
thomwolf b514a60c36 added tests for OpenAI GPT and Transformer-XL tokenizers 2019-02-11 10:17:16 +01:00
thomwolf 9bdcba53fd fix tests 2019-02-09 17:07:12 +01:00
thomwolf f0bf81e141 back compatibility with Path inputs in fle_utils 2019-02-09 17:05:23 +01:00
thomwolf 9f9909ea2f update readme 2019-02-09 16:59:21 +01:00
thomwolf 6cd769957e update transfo xl example 2019-02-09 16:59:17 +01:00
thomwolf 1320e4ec0c mc_token_mask => mc_token_ids 2019-02-09 16:58:53 +01:00
thomwolf f4a07a392c mems not splitted 2019-02-09 16:14:31 +01:00
thomwolf 43b9af0cac mems initialized to None in run_transfo 2019-02-09 16:12:19 +01:00
thomwolf cfcb95417c fix hasattr 2019-02-08 23:08:53 +01:00
thomwolf 0c1a6f9b1d update readme 2019-02-08 22:32:25 +01:00
thomwolf 1756b5e956 fix loading from Transfo-XL LM model 2019-02-08 22:32:17 +01:00
thomwolf dadd0c1b13 updating __main__ 2019-02-08 22:31:57 +01:00
thomwolf 102c6b238c adding file cache to __init__ 2019-02-08 22:31:46 +01:00
thomwolf b80684b23f fixing run openai gpt example 2019-02-08 22:31:32 +01:00
thomwolf 80607874c1 fix layer norm epsilon in OpenAI GPT 2019-02-08 21:49:05 +01:00
thomwolf 7b4b0cf966 logging 2019-02-08 11:16:29 +01:00
thomwolf 4bbb9f2d68 log loss - helpers 2019-02-08 11:14:29 +01:00
thomwolf 5d7e845712 fix model on cuda 2019-02-08 11:08:43 +01:00
thomwolf eccb2f0163 hot fix 2019-02-08 11:05:20 +01:00
thomwolf 5adc20723b add distant debugging 2019-02-08 11:03:59 +01:00
thomwolf 5ee4f17234 adding option to load on cpu 2019-02-08 10:37:40 +01:00
thomwolf 777459b471 run openai example running 2019-02-08 10:33:14 +01:00
thomwolf edcb56fd96 more explicit variable name 2019-02-08 09:54:49 +01:00
thomwolf 6bc082da0a updating examples 2019-02-08 00:02:26 +01:00
thomwolf eb8fda51f4 update docstrings 2019-02-07 23:15:20 +01:00
thomwolf e77721e4fe renamed examples 2019-02-07 23:15:15 +01:00
thomwolf 009b581316 updated readme 2019-02-07 23:15:05 +01:00
thomwolf f99f2fb661 docstrings 2019-02-07 17:07:22 +01:00
thomwolf 438db43d46 update adaptive softmax head 2019-02-07 17:07:15 +01:00
thomwolf c306869ea2 add two transformer xl models 2019-02-07 17:07:03 +01:00
thomwolf d482e3d79d adding examples for openai and transformer-xl 2019-02-07 17:06:41 +01:00
thomwolf 9c3c24800b split saved model in config & weights 2019-02-07 17:06:17 +01:00
thomwolf 2df41663f1 added test 2019-02-07 17:05:49 +01:00
thomwolf ed47cb6cba fixing transfo eval script 2019-02-06 16:22:17 +01:00
thomwolf 973926431e fix differencies with tensorflow version (mem cells and adaptive sofmax clusters) 2019-02-06 15:42:29 +01:00
thomwolf ba9e4eb354 fix unicode in tokenization tests 2019-02-06 00:28:00 +01:00
thomwolf 34bdb7f9cb update circle-ci for python 2.7 and 3.5 2019-02-06 00:25:12 +01:00
thomwolf 448937c00d python 2 compatibility 2019-02-06 00:07:46 +01:00
thomwolf ba37ddc5ce fix run_lm_modeling example command line 2019-02-06 00:07:08 +01:00
thomwolf 822915142b fix docstring 2019-02-05 16:34:32 +01:00
thomwolf d609ba24cb resolving merge conflicts 2019-02-05 16:14:25 +01:00
thomwolf bde1eeebe0 rename 2019-02-05 16:11:22 +01:00
thomwolf 3ea3b00e59 merge squad example in single example 2019-02-05 16:10:27 +01:00
thomwolf d8e3bdbb4c moved up to current master 2019-02-05 16:09:39 +01:00
thomwolf 0ad9b239a1 gitignore 2019-02-05 15:43:11 +01:00
thomwolf 1579c53635 more explicit notation: num_train_step => num_train_optimization_steps 2019-02-05 15:36:33 +01:00
thomwolf 6179f537a3 clean up tokenization spaces 2019-02-04 17:41:22 +01:00
thomwolf 850da1cc36 strip decoded outputs 2019-02-04 17:35:05 +01:00
thomwolf 01a3966bc6 more options on special tokens 2019-02-04 17:26:25 +01:00
thomwolf 05f961840b logging 2019-02-04 13:06:19 +01:00
thomwolf 3a848111e6 update config, docstrings and readme to switch to seperated tokens and position embeddings 2019-01-29 11:00:11 +01:00
thomwolf 98c96fb1a7 splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests 2019-01-29 10:31:42 +01:00
thomwolf 5456d82311 more versatile model loading 2019-01-29 09:54:18 +01:00
thomwolf 9b2540b5a7 update __init__ 2019-01-29 09:54:08 +01:00
thomwolf bd3b3aee9c update 2019-01-28 17:47:29 +01:00
thomwolf a45a9cc0e1 update tests 2019-01-28 17:16:02 +01:00
thomwolf b12616fd8e updating code organization to fix imports 2019-01-28 17:03:39 +01:00
thomwolf d77dd62ff8 directly load from TF checkpoints + code cleanup 2019-01-28 16:50:23 +01:00
thomwolf 9c35c132fa apex LayerNorm 2019-01-17 09:19:19 +01:00
thomwolf b9c77b98d5 fix transposition in model conversion and memory initialization 2019-01-17 00:33:21 +01:00
thomwolf 009101de12 fix loading bug and check full conversion of model 2019-01-16 12:16:20 +01:00
thomwolf fea15cc9f5 update model conversion 2019-01-16 11:54:54 +01:00
thomwolf a28dfc8659 fix eval for wt103 2019-01-16 11:18:19 +01:00
thomwolf c03c12687f fix __main__ entry script 2019-01-16 10:55:22 +01:00
thomwolf 8831c68803 fixing various parts of model conversion, loading and weights sharing 2019-01-16 10:31:16 +01:00
thomwolf bcd4aa8fe0 update evaluation example 2019-01-15 23:32:34 +01:00
thomwolf a69ec2c722 improved corpus and tokenization conversion - added evaluation script 2019-01-15 23:17:46 +01:00
thomwolf 7d03c53718 conversion working 2019-01-15 16:07:25 +01:00
thomwolf 3a9c88377f adding Transformer XL 2019-01-15 12:59:38 +01:00
thomwolf e5c78c6684 update readme and few typos 2019-01-10 01:40:00 +01:00
thomwolf fa5222c296 update readme 2019-01-10 01:25:28 +01:00
thomwolf ab90d4cddd adding docs and example for OpenAI GPT 2019-01-09 00:12:43 +01:00
thomwolf dc5df92fa8 added LM head for OpenAI 2019-01-08 17:18:47 +01:00
thomwolf 3cf12b235a added tests + fixed losses 2019-01-08 16:24:23 +01:00
thomwolf eed51c5bdf add OpenAI GPT 2019-01-08 12:26:58 +01:00
thomwolf 793dcd236b Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT into fifth-release 2019-01-07 13:37:55 +01:00
thomwolf 2e4db64cab add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples 2019-01-07 13:06:42 +01:00
thomwolf c9fd350567 remove default when action is store_true in arguments 2019-01-07 13:01:54 +01:00
thomwolf 93f563b8a8 adding OpenAI GPT 2019-01-07 12:55:36 +01:00
thomwolf d821358884 update readme 2018-12-14 15:15:17 +01:00
thomwolf 37378898a2 adding DockerFile 2018-12-14 15:02:32 +01:00
thomwolf 4a4b0e5783 remove logging. basicConfig from library code 2018-12-14 14:46:25 +01:00
thomwolf ae88eb88a4 set encoding to 'utf-8' in calls to open 2018-12-14 13:48:58 +01:00
thomwolf e1eab59aac no fp16 on evaluation 2018-12-13 14:54:02 +01:00
thomwolf 087798b7fa fix reloading model for evaluation in examples 2018-12-13 14:48:12 +01:00
thomwolf 0f544625f4 fix swag example for work with apex 2018-12-13 13:35:59 +01:00
thomwolf 0cf88ff084 make examples work without apex 2018-12-13 13:28:00 +01:00
thomwolf 52c53f39d0 clean up apex integration 2018-12-13 13:02:17 +01:00