Commit Graph
49 Commits
Author SHA1 Message Date
lukovnikov 56a47ce2b7 - replaced OpenAIGPTAdam with OpenAIAdam in docs 2019-04-25 16:05:28 +02:00
lukovnikov 331a46ff04 - replaced OpenAIGPTAdam with OpenAIAdam in docs 2019-04-25 16:04:37 +02:00
lukovnikov 704037ad51 - updated docs for new LR API
- added some images for illustration
- updated comments in optimization
2019-04-25 15:59:39 +02:00
lukovnikov 69850b4011 python 2 compat 2019-04-21 14:02:38 +02:00
lukovnikov bb7557d3ab - removed __all__ in optimization
- removed unused plotting code
- using ABC for LRSchedule
- added some schedule object init tests
2019-04-21 13:48:33 +02:00
lukovnikov 34ccc8ebf4 Merge remote-tracking branch 'upstream/master' 2019-04-21 13:16:15 +02:00
lukovnikov fc7693adc3 schedule fix 2019-04-03 18:16:47 +02:00
lukovnikov 20686b78fc schedule fix 2019-04-03 18:13:52 +02:00
lukovnikov 1b4ce76c38 schedule fix 2019-04-03 17:40:12 +02:00
lukovnikov 5fed5bb3d6 schedule fix 2019-04-03 17:20:29 +02:00
lukovnikov 23bd2eebf5 schedule fix 2019-04-03 17:10:34 +02:00
lukovnikov 91a073f804 schedule fix 2019-04-03 17:10:08 +02:00
lukovnikov b64cc63a77 optimization schedule test update 2019-04-03 16:42:40 +02:00
lukovnikov d164867d90 - updated docs for optimization 2019-04-03 16:13:51 +02:00
lukovnikov 1758c8fc72 - updated docs for optimization 2019-04-03 16:08:34 +02:00
lukovnikov 725a56329d Merge remote-tracking branch 'upstream/master' into optim
# Conflicts:
#	pytorch_pretrained_bert/optimization.py

- updated docs for optimization
2019-04-03 16:07:50 +02:00
lukovnikov 262a9992d7 class weights 2019-03-18 18:29:12 +01:00
lukovnikov 19cc2c084e same 2019-03-18 15:13:35 +01:00
lukovnikov 2283dcca5e import revert 2019-03-18 13:40:12 +01:00
lukovnikov b6c1cae67b branches, optim cosine fix 2019-03-18 13:32:04 +01:00
lukovnikov ef28b2c747 branches, optim cosine fix 2019-03-18 13:18:07 +01:00
lukovnikov 90430ae7ec Merge remote-tracking branch 'origin/master'
# Conflicts:
#	pytorch_pretrained_bert/optimization.py
2019-03-18 13:15:29 +01:00
lukovnikov bed6408dcc branches, optim cosine fix 2019-03-18 13:09:55 +01:00
lukovnikov 20e652209c relation classification: replacing entity mention with mask token 2019-03-13 16:13:37 +01:00
lukovnikov eac039d21f changing docker 2019-03-12 13:45:12 +01:00
lukovnikov 471daf1b6c changing docker 2019-03-12 13:32:42 +01:00
lukovnikov 9024613337 changing docker 2019-03-12 13:23:58 +01:00
lukovnikov baf66d1419 restart cosine lr schedule 2019-03-12 13:22:23 +01:00
lukovnikov 51efde54a9 cos fix 2019-03-09 02:45:25 +01:00
lukovnikov f113a2dfdc readme de 2019-03-09 02:29:57 +01:00
lukovnikov 90a41dbe14 BertAdam schedule objects 2019-03-09 02:23:20 +01:00
lukovnikov 88874f6cf0 BertAdam schedule objects 2019-03-08 19:08:30 +01:00
lukovnikov 35410da758 added warning 2019-02-27 17:11:42 +01:00
lukovnikov 4d79e0d386 added warning 2019-02-27 16:50:05 +01:00
lukovnikov 66a84b63b0 added warning 2019-02-27 16:38:00 +01:00
lukovnikov 070f3b21d8 added warning 2019-02-27 16:26:45 +01:00
lukovnikov 46ef646016 added warning 2019-02-27 16:22:27 +01:00
lukovnikov 9bc3773c84 added warning 2019-02-27 16:10:31 +01:00
lukovnikov 60a372387f added warning 2019-02-27 15:54:09 +01:00
lukovnikov da2d8ca265 fix for negative learning rate with warmup_linear in BertAdam (happens when t_total is specified incorrectly)
+ copied BERT optimization warmup functions to OpenAI optimization file + added comments
2019-02-26 17:16:06 +01:00
lukovnikov e04bab59e1 fix for negative learning rate with warmup_linear in BertAdam (happens when t_total is specified incorrectly)
+ copied BERT optimization warmup functions to OpenAI optimization file + added comments
2019-02-26 16:22:52 +01:00
lukovnikov 470076e419 Merge remote-tracking branch 'origin/master' 2018-11-13 16:49:26 +01:00
lukovnikov 9f3cd27187 clean up pr 2018-11-13 16:48:59 +01:00
lukovnikov d64db6dfb9 clean up pr 2018-11-13 16:41:01 +01:00
lukovnikov 7ba83730c4 clean up pr 2018-11-13 16:31:20 +01:00
lukovnikov fa0c5a2ea1 clean up pr 2018-11-13 16:24:53 +01:00
lukovnikov f4d79f44c9 Merge remote-tracking branch 'upstream/master' 2018-11-13 16:22:23 +01:00
lukovnikov bd91ae654f moved bert to qelos-util 2018-11-06 18:21:44 +01:00
lukovnikov 4e52188433 bert weight loading from tf 2018-11-06 17:47:03 +01:00