c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,420 Commits 171 Branches 49 Tags
e03129ad447ad7670fcc6206e5eb27a5435d4d86
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lysandre 07a79db505 Fix failing doc samples 2020-03-04 19:11:31 -05:00
Lysandre f9ec5ca90b Release: v2.5.1 2020-02-24 18:22:54 -05:00
Lysandre 2708b44ee9 Patch ALBERT with heads in TensorFlow 2020-02-19 18:46:25 -05:00
Lysandre 1abd53b1aa Patch ALBERT with heads in TensorFlow 2020-02-19 18:24:40 -05:00
Lysandre 59c23ad9c9 README link + better instructions for release 2020-02-19 11:57:17 -05:00
Lysandre 22b2b5790e Documentation v2.5.0 2020-02-19 11:53:30 -05:00
Lysandre fb560dcb07 Release: v2.5.0 
Welcome Rust Tokenizers
 2020-02-19 11:46:19 -05:00
Lysandre f54a5bd37f Raise error when using an mlm flag for a clm model + correct TextDataset 2020-02-12 13:23:14 -05:00
Lysandre 569897ce2c Fix a few issues regarding the language modeling script 2020-02-12 13:23:14 -05:00
Lysandre 539f601be7 intermediate_size > hidden_dim in distilbert config docstrings 2020-02-10 13:45:57 -05:00
Lysandre cfb7d108bd FlauBERT lang embeddings only when n_langs > 1 2020-02-10 13:24:04 -05:00
Lysandre fd639e5be3 Correct quickstart example when using the past 2020-02-10 11:25:56 -05:00
Lysandre 125a75a121 Correctly compute tokens when padding on the left 2020-02-10 10:47:42 -05:00
Lysandre 520e7f2119 Correct docstring for xlnet 2020-02-07 16:42:35 -05:00
Lysandre dd28830327 Update RoBERTa tips 2020-02-07 16:42:35 -05:00
Lysandre db97930122 Update XLM-R tips 2020-02-07 16:42:35 -05:00
Lysandre 7046de2991 E231 2020-02-07 15:28:13 -05:00
Lysandre 2184f87003 RoBERTa TensorFlow Tests 2020-02-04 18:05:35 -05:00
Lysandre e615269cb8 Correct slow test 2020-02-04 18:05:35 -05:00
Lysandre 5f96ebc0be Style 2020-02-04 18:05:35 -05:00
Lysandre 950c6a4f09 Flaubert PyTorch tests 2020-02-04 18:05:35 -05:00
Lysandre d28b81dc29 RoBERTa Pytorch tests 2020-02-04 18:05:35 -05:00
Lysandre 3bf5417258 Revert erroneous fix 2020-02-04 16:31:07 -05:00
Lysandre 1ebfeb7946 Cast to long when masking tokens 2020-02-04 15:56:16 -05:00
Lysandre 9c67196b83 Update quickstart 2020-02-04 11:11:37 -05:00
Lysandre 90ab15cb7a Remove redundant hidden states 2020-02-04 10:59:32 -05:00
Lysandre 6c1b23554f Sample instead of greedy decoding by default in generate 2020-02-03 17:23:53 -05:00
Lysandre 239dd23f64 [Follow up 213] 
Masked indices should have -1 and not -100. Updating documentation + scripts that were forgotten
 2020-02-03 16:08:05 -05:00
Lysandre d426b58b9e Patch: v2.4.1 2020-01-31 14:55:33 -05:00
Lysandre 1e82cd8457 Flaubert auto tokenizer + tests 
cc @julien-c
 2020-01-31 14:16:52 -05:00
Lysandre d18d47be67 run_generation style 2020-01-31 12:05:48 -05:00
Lysandre ff6f1492e8 FlauBERT load in AutoModel 
The FlauBERT configuration file inherits from XLMConfig, and is recognized as such when loading from AutoModels as the XLMConfig is checked before the FlaubertConfig.

Changing the order solves this problem, but a test should be added.
 2020-01-31 12:05:15 -05:00
Lysandre 7365f01d43 do_sample should be set to True in run_generation.py 2020-01-31 11:49:32 -05:00
Lysandre 0aa40e9569 v2.4.0 documentation 2020-01-31 09:55:34 -05:00
Lysandre 8036ceb7c5 Update commands for pypi test 2020-01-31 09:48:15 -05:00
Lysandre 6664ea943d Release: v2.4.0 2020-01-31 09:40:32 -05:00
Lysandre 01a14ebd8d Add FlauBERT to automodels 2020-01-30 18:40:22 -05:00
Lysandre df27648bd9 Rename test_examples to test_doc_samples 2020-01-30 10:07:22 -05:00
Lysandre 93dccf527b Pretrained models 2020-01-30 10:04:18 -05:00
Lysandre 90787fed81 Style 2020-01-30 10:04:18 -05:00
Lysandre 73306d028b FlauBERT documentation 2020-01-30 10:04:18 -05:00
Lysandre ce2f4227ab Fix failing FlauBERT test 2020-01-30 10:04:18 -05:00
Lysandre e63a81dd25 Style 2020-01-29 16:29:20 -05:00
Lysandre 217349016a Copy object instead of passing the reference 2020-01-29 16:15:39 -05:00
Lysandre c69b082601 Update documentation 2020-01-29 12:06:13 -05:00
Lysandre b5625f131d Style 2020-01-29 11:47:49 -05:00
Lysandre 44a5b4bbe7 Update documentation 2020-01-29 11:47:49 -05:00
Lysandre 335dd5e68a Default save steps 50 to 500 in all scripts 2020-01-28 09:42:11 -05:00
Lysandre ea2600bd5f Absolute definitive HeisenDistilBug solve 
cc @julien-c @thomwolf
 2020-01-27 21:58:36 -05:00
Lysandre 9ca21c838b Style 2020-01-27 14:49:12 -05:00
Lysandre 875c4ae48f Definitive HeisenDistilBug fix 
cc @julien-c @@thomwolf
 2020-01-27 12:09:58 -05:00
Lysandre f09f42d4d3 Input Embeddings should be assigned 
cc @julien-c
 2020-01-27 11:46:00 -05:00
Lysandre babd41e7fa Code quality 2020-01-24 17:06:55 -05:00
Lysandre 974d083c7b Accurate model for configuration 2020-01-24 16:46:03 -05:00
Lysandre 983fef469c AutoModels doc 2020-01-24 16:37:30 -05:00
Lysandre 009fcb0ec1 Configuration utils 2020-01-24 16:37:30 -05:00
Lysandre 908230d261 Pickle CamemBERT tokenizer 2020-01-24 10:08:59 -05:00
Lysandre 24d5ad1dcc Run the examples in slow 2020-01-23 09:38:45 -05:00
Lysandre 9ddf60b694 Tips + whitespaces 2020-01-23 09:38:45 -05:00
Lysandre 0e9899f451 Fixes 2020-01-23 09:38:45 -05:00
Lysandre 48ac24020d TF CTRL 2020-01-23 09:38:45 -05:00
Lysandre 7511f3dd89 PyTorch CTRL + Style 2020-01-23 09:38:45 -05:00
Lysandre 980211a63a XLM-RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre 6bc966793a TF DistilBERT 2020-01-23 09:38:45 -05:00
Lysandre db1a7f27a1 PyTorch DistilBERT 2020-01-23 09:38:45 -05:00
Lysandre b28020f590 TF RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre 3e1bc27e1b Pytorch RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre f44ff574d3 Camembert 2020-01-23 09:38:45 -05:00
Lysandre 264eb23912 TF XLM 2020-01-23 09:38:45 -05:00
Lysandre ccebcae75f PyTorch XLM 2020-01-23 09:38:45 -05:00
Lysandre 92b3cb786d TF XLNet 2020-01-23 09:38:45 -05:00
Lysandre cd656fb21a PyTorch XLNet 2020-01-23 09:38:45 -05:00
Lysandre 83fa8d9fb5 TF Transformer-XL 2020-01-23 09:38:45 -05:00
Lysandre 98edad418e PyTorch Transformer-XL 2020-01-23 09:38:45 -05:00
Lysandre 96d21ad06b TF OpenAI GPT 2020-01-23 09:38:45 -05:00
Lysandre 850795c487 Pytorch GPT 2020-01-23 09:38:45 -05:00
Lysandre 1487b840d3 TF GPT2 2020-01-23 09:38:45 -05:00
Lysandre bd0d3fd76e GPT-2 PyTorch models + better tips for BERT 2020-01-23 09:38:45 -05:00
Lysandre dbeb7fb4e6 BERT TensorFlow 2020-01-23 09:38:45 -05:00
Lysandre cd77c750c5 BERT PyTorch models 2020-01-23 09:38:45 -05:00
Lysandre 3922a2497e TF ALBERT + TF Utilities + Fix warnings 2020-01-23 09:38:45 -05:00
Lysandre 00df3d4de0 ALBERT Modeling + required changes to utilities 2020-01-23 09:38:45 -05:00
Lysandre f81b6c95f2 Flake8 violation 2020-01-23 09:38:45 -05:00
Lysandre 632675ea88 Can test examples spread over multiple blocks 2020-01-23 09:38:45 -05:00
Lysandre eaa6b9afc6 Require Torch when testing examples 2020-01-23 09:38:45 -05:00
Lysandre 9bab9b83d2 Glossary 2020-01-23 09:38:45 -05:00
Lysandre 64abd3e0aa Multi-line examples can be tested + ALBERT patch for CircleCI 
All tests should now work fine.
 2020-01-23 09:38:45 -05:00
Lysandre 837577256b Automatic testing of examples 
The CircleCI test should fail.
 2020-01-23 09:38:45 -05:00
Lysandre c7f79815e7 Cleanup unused variables 2020-01-21 11:40:24 -05:00
Lysandre 15579e2d55 [SQuAD v2] Code quality 2020-01-21 11:36:46 -05:00
Lysandre 088fa7b759 Correct segment ID for XLNet single sequence 2020-01-21 11:33:45 -05:00
Lysandre 073219b43f Manage impossible examples SQuAD v2 2020-01-21 11:24:43 -05:00
Lysandre ca6ce3040d Fix style 2020-01-20 10:56:23 -05:00
Lysandre 6e2c28a14a Run SQuAD warning when the doc stride may be too high 2020-01-16 13:59:26 -05:00
Lysandre dfe012ad9d Fix misleading RoBERTa token type ids 2020-01-14 17:47:28 -05:00
Lysandre c024ab98df Improve padding side documentation 2020-01-14 17:44:23 -05:00
Lysandre 9aeb0b9b8a Improve padding side documentation 2020-01-14 17:43:00 -05:00
Lysandre 100e3b6f21 Bias should be resized with the weights 
Created a link between the linear layer bias and the model attribute bias. This does not change anything for the user nor for the conversion scripts, but allows the `resize_token_embeddings` method to resize the bias as well as the weights of the decoder.

Added a test.
 2020-01-14 13:43:45 -05:00
Lysandre 6c32d8bb95 Size > Dimensionality + Remove final TODOs 2020-01-14 14:09:09 +01:00
Lysandre 760164d63b RoBERTa example 2020-01-14 14:09:09 +01:00