Commit Graph
21 Commits
Author SHA1 Message Date
thomwolf 0bab55d5d5 [BIG] name change 2019-07-05 11:55:36 +02:00
samuel.broscheit 3bf3f9596f Fixing the issues reported in https://github.com/huggingface/pytorch-pretrained-BERT/issues/556
Reason for issue was that optimzation steps where computed from example size, which is different from actual size of dataloader when an example is chunked into multiple instances.

Solution in this pull request is to compute num_optimization_steps directly from len(data_loader).
2019-05-12 00:13:45 +02:00
MottoX 74dbba64bc Prepare optimizer only when args.do_train is True 2019-05-02 19:09:29 +08:00
Aneesh Pappu 365fb34c6c small fix to remove shifting of lm labels during pre process of roc stories, as this shifting happens interanlly in the model 2019-04-30 13:53:04 -07:00
thomwolf 60ea6c59d2 added best practices for serialization in README and examples 2019-04-15 15:00:33 +02:00
thomwolf 179a2c2ff6 update example to work with new serialization semantic 2019-04-15 14:33:23 +02:00
thomwolf 7cc35c3104 fix openai gpt example and updating readme 2019-03-06 11:43:21 +01:00
thomwolf 5c85fc3977 fix typo - logger info 2019-03-06 10:05:21 +01:00
Catalin Voss c0cf0a04d5 Fix typo 2019-02-27 18:01:06 -08:00
Ben Johnson 8607233679 Update run_openai_gpt.py 2019-02-20 13:58:54 -05:00
thomwolf 1320e4ec0c mc_token_mask => mc_token_ids 2019-02-09 16:58:53 +01:00
thomwolf b80684b23f fixing run openai gpt example 2019-02-08 22:31:32 +01:00
thomwolf 7b4b0cf966 logging 2019-02-08 11:16:29 +01:00
thomwolf 4bbb9f2d68 log loss - helpers 2019-02-08 11:14:29 +01:00
thomwolf 5d7e845712 fix model on cuda 2019-02-08 11:08:43 +01:00
thomwolf eccb2f0163 hot fix 2019-02-08 11:05:20 +01:00
thomwolf 5adc20723b add distant debugging 2019-02-08 11:03:59 +01:00
thomwolf 777459b471 run openai example running 2019-02-08 10:33:14 +01:00
thomwolf 6bc082da0a updating examples 2019-02-08 00:02:26 +01:00
thomwolf fa5222c296 update readme 2019-01-10 01:25:28 +01:00
thomwolf ab90d4cddd adding docs and example for OpenAI GPT 2019-01-09 00:12:43 +01:00