c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

updating examples and doc

Browse Source
This commit is contained in:
thomwolf committed 2019-07-14 23:20:10 +02:00
1 parent c490f5ce87
commit 2397f958f9
16 files changed
+601 -667
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/model_doc/overview.rst
+1 -1
View File
@@ -236,7 +236,7 @@ Learning Rate Schedules
The ``.optimization`` module also provides additional schedules in the form of schedule objects that inherit from ``_LRSchedule``.
All ``_LRSchedule`` subclasses accept ``warmup`` and ``t_total`` arguments at construction.
When an ``_LRSchedule`` object is passed into ``BertAdam`` or ``OpenAIAdam``\ ,
When an ``_LRSchedule`` object is passed into ``AdamW``\ ,
the ``warmup`` and ``t_total`` arguments on the optimizer are ignored and the ones in the ``_LRSchedule`` object are used.
An overview of the implemented schedules: