c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Run the examples in slow

Browse Source
This commit is contained in:
Lysandre authored and Lysandre Debut committed 2020-01-23 09:38:45 -05:00
1 parent 9ddf60b694
commit 24d5ad1dcc
24 files changed
+249 -54
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/model_doc/gpt.rst
+1 -1
View File
@@ -4,7 +4,7 @@ OpenAI GPT
Overview
~~~~~~~~~~~~~~~~~~~~~
OpenAI GPT model was proposed in `Improving Language Understanding by Generative Pre-Training`_
OpenAI GPT model was proposed in `Improving Language Understanding by Generative Pre-Training <https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf>`__
by Alec Radford, Karthik Narasimhan, Tim Salimans and Ilya Sutskever. It's a causal (unidirectional)
transformer pre-trained using language modeling on a large corpus will long range dependencies, the Toronto Book Corpus.