c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

TF ALBERT + TF Utilities + Fix warnings

Browse Source
This commit is contained in:
Lysandre authored and Lysandre Debut committed 2020-01-23 09:38:45 -05:00
1 parent 00df3d4de0
commit 3922a2497e
6 files changed
+148 -126
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/main_classes/optimizer_schedules.rst
+2 -5
View File
@@ -20,14 +20,12 @@ The ``.optimization`` module provides:
:members:
.. autofunction:: transformers.create_optimizer
:members:
Schedules
----------------------------------------------------
Learning Rate Schedules
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
.. autofunction:: transformers.get_constant_schedule
@@ -39,7 +37,6 @@ Learning Rate Schedules
.. autofunction:: transformers.get_cosine_schedule_with_warmup
:members:
.. image:: /imgs/warmup_cosine_schedule.png
:target: /imgs/warmup_cosine_schedule.png
@@ -63,7 +60,7 @@ Learning Rate Schedules
``Warmup``
~~~~~~~~~~~~~~~~
.. autoclass:: transformers.Warmup
.. autoclass:: transformers.WarmUp
:members:
Gradient Strategies
docs/source/model_doc/albert.rst
+1 -1
View File
@@ -59,7 +59,7 @@ AlbertForMaskedLM
AlbertForSequenceClassification
~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
.. autoclass:: transformers.AlbertForSequenceClassification
:members: