c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,915 Commits 171 Branches 49 Tags
65be574aeca3e8c4bfb25065ea98deed7f3cc471
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lysandre 2e57824374 Pin isort and tf <= 2.1.0 2020-05-07 14:42:00 -04:00
Lysandre e7cfc1a313 Release: v2.9.0 2020-05-07 14:15:20 -04:00
LysandreJik 31baeed614 Update quotes 
cc @julien-c
 2020-04-09 09:09:00 -04:00
LysandreJik 500aa12318 close #3699 2020-04-08 14:32:47 -04:00
LysandreJik ea6dba2787 Re-pin isort 2020-04-06 10:09:54 -04:00
LysandreJik 11c3257a18 unpin isort for pypi 2020-04-06 10:06:41 -04:00
LysandreJik 36bffc81b3 Release: v2.8.0 2020-04-06 10:03:53 -04:00
LysandreJik eff757f2e3 Re-pin isort version 2020-03-30 09:00:47 -04:00
LysandreJik a009d751c2 Un-pin isort for v2.7.0 pypi 2020-03-30 08:55:10 -04:00
LysandreJik 6f5a12a583 Release: v2.7.0 2020-03-30 08:49:24 -04:00
LysandreJik e2c05f06ef Correct indentation in docstring 
For some reason Sphinx extremely dislikes this and crashes.
 2020-03-27 09:28:52 -04:00
LysandreJik fbc5bf10cf v2.6.0 release: isort un-pinned 2020-03-24 11:52:02 -04:00
LysandreJik 471cce24b3 Release: v2.6.0 2020-03-24 10:37:32 -04:00
LysandreJik e52482909b Correct order for dev/quality dependencies 
cc @julien-c
 2020-03-23 12:01:23 -04:00
Lysandre 525b6b1c54 TFQA pipeline marked as slow test 2020-03-09 16:52:30 -04:00
Lysandre eb3e6cb04f cased -> uncased in BERT SQuAD example 
closes #3183
 2020-03-09 10:54:18 -04:00
Lysandre 07a79db505 Fix failing doc samples 2020-03-04 19:11:31 -05:00
Lysandre f9ec5ca90b Release: v2.5.1 2020-02-24 18:22:54 -05:00
Lysandre 2708b44ee9 Patch ALBERT with heads in TensorFlow 2020-02-19 18:46:25 -05:00
Lysandre 1abd53b1aa Patch ALBERT with heads in TensorFlow 2020-02-19 18:24:40 -05:00
Lysandre 59c23ad9c9 README link + better instructions for release 2020-02-19 11:57:17 -05:00
Lysandre 22b2b5790e Documentation v2.5.0 2020-02-19 11:53:30 -05:00
Lysandre fb560dcb07 Release: v2.5.0 
Welcome Rust Tokenizers
 2020-02-19 11:46:19 -05:00
Lysandre f54a5bd37f Raise error when using an mlm flag for a clm model + correct TextDataset 2020-02-12 13:23:14 -05:00
Lysandre 569897ce2c Fix a few issues regarding the language modeling script 2020-02-12 13:23:14 -05:00
Lysandre 539f601be7 intermediate_size > hidden_dim in distilbert config docstrings 2020-02-10 13:45:57 -05:00
Lysandre cfb7d108bd FlauBERT lang embeddings only when n_langs > 1 2020-02-10 13:24:04 -05:00
Lysandre fd639e5be3 Correct quickstart example when using the past 2020-02-10 11:25:56 -05:00
Lysandre 125a75a121 Correctly compute tokens when padding on the left 2020-02-10 10:47:42 -05:00
Lysandre 520e7f2119 Correct docstring for xlnet 2020-02-07 16:42:35 -05:00
Lysandre dd28830327 Update RoBERTa tips 2020-02-07 16:42:35 -05:00
Lysandre db97930122 Update XLM-R tips 2020-02-07 16:42:35 -05:00
Lysandre 7046de2991 E231 2020-02-07 15:28:13 -05:00
Lysandre 2184f87003 RoBERTa TensorFlow Tests 2020-02-04 18:05:35 -05:00
Lysandre e615269cb8 Correct slow test 2020-02-04 18:05:35 -05:00
Lysandre 5f96ebc0be Style 2020-02-04 18:05:35 -05:00
Lysandre 950c6a4f09 Flaubert PyTorch tests 2020-02-04 18:05:35 -05:00
Lysandre d28b81dc29 RoBERTa Pytorch tests 2020-02-04 18:05:35 -05:00
Lysandre 3bf5417258 Revert erroneous fix 2020-02-04 16:31:07 -05:00
Lysandre 1ebfeb7946 Cast to long when masking tokens 2020-02-04 15:56:16 -05:00
Lysandre 9c67196b83 Update quickstart 2020-02-04 11:11:37 -05:00
Lysandre 90ab15cb7a Remove redundant hidden states 2020-02-04 10:59:32 -05:00
Lysandre 6c1b23554f Sample instead of greedy decoding by default in generate 2020-02-03 17:23:53 -05:00
Lysandre 239dd23f64 [Follow up 213] 
Masked indices should have -1 and not -100. Updating documentation + scripts that were forgotten
 2020-02-03 16:08:05 -05:00
Lysandre d426b58b9e Patch: v2.4.1 2020-01-31 14:55:33 -05:00
Lysandre 1e82cd8457 Flaubert auto tokenizer + tests 
cc @julien-c
 2020-01-31 14:16:52 -05:00
Lysandre d18d47be67 run_generation style 2020-01-31 12:05:48 -05:00
Lysandre ff6f1492e8 FlauBERT load in AutoModel 
The FlauBERT configuration file inherits from XLMConfig, and is recognized as such when loading from AutoModels as the XLMConfig is checked before the FlaubertConfig.

Changing the order solves this problem, but a test should be added.
 2020-01-31 12:05:15 -05:00
Lysandre 7365f01d43 do_sample should be set to True in run_generation.py 2020-01-31 11:49:32 -05:00
Lysandre 0aa40e9569 v2.4.0 documentation 2020-01-31 09:55:34 -05:00
Lysandre 8036ceb7c5 Update commands for pypi test 2020-01-31 09:48:15 -05:00
Lysandre 6664ea943d Release: v2.4.0 2020-01-31 09:40:32 -05:00
Lysandre 01a14ebd8d Add FlauBERT to automodels 2020-01-30 18:40:22 -05:00
Lysandre df27648bd9 Rename test_examples to test_doc_samples 2020-01-30 10:07:22 -05:00
Lysandre 93dccf527b Pretrained models 2020-01-30 10:04:18 -05:00
Lysandre 90787fed81 Style 2020-01-30 10:04:18 -05:00
Lysandre 73306d028b FlauBERT documentation 2020-01-30 10:04:18 -05:00
Lysandre ce2f4227ab Fix failing FlauBERT test 2020-01-30 10:04:18 -05:00
Lysandre e63a81dd25 Style 2020-01-29 16:29:20 -05:00
Lysandre 217349016a Copy object instead of passing the reference 2020-01-29 16:15:39 -05:00
Lysandre c69b082601 Update documentation 2020-01-29 12:06:13 -05:00
Lysandre b5625f131d Style 2020-01-29 11:47:49 -05:00
Lysandre 44a5b4bbe7 Update documentation 2020-01-29 11:47:49 -05:00
Lysandre 335dd5e68a Default save steps 50 to 500 in all scripts 2020-01-28 09:42:11 -05:00
Lysandre ea2600bd5f Absolute definitive HeisenDistilBug solve 
cc @julien-c @thomwolf
 2020-01-27 21:58:36 -05:00
Lysandre 9ca21c838b Style 2020-01-27 14:49:12 -05:00
Lysandre 875c4ae48f Definitive HeisenDistilBug fix 
cc @julien-c @@thomwolf
 2020-01-27 12:09:58 -05:00
Lysandre f09f42d4d3 Input Embeddings should be assigned 
cc @julien-c
 2020-01-27 11:46:00 -05:00
Lysandre babd41e7fa Code quality 2020-01-24 17:06:55 -05:00
Lysandre 974d083c7b Accurate model for configuration 2020-01-24 16:46:03 -05:00
Lysandre 983fef469c AutoModels doc 2020-01-24 16:37:30 -05:00
Lysandre 009fcb0ec1 Configuration utils 2020-01-24 16:37:30 -05:00
Lysandre 908230d261 Pickle CamemBERT tokenizer 2020-01-24 10:08:59 -05:00
Lysandre 24d5ad1dcc Run the examples in slow 2020-01-23 09:38:45 -05:00
Lysandre 9ddf60b694 Tips + whitespaces 2020-01-23 09:38:45 -05:00
Lysandre 0e9899f451 Fixes 2020-01-23 09:38:45 -05:00
Lysandre 48ac24020d TF CTRL 2020-01-23 09:38:45 -05:00
Lysandre 7511f3dd89 PyTorch CTRL + Style 2020-01-23 09:38:45 -05:00
Lysandre 980211a63a XLM-RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre 6bc966793a TF DistilBERT 2020-01-23 09:38:45 -05:00
Lysandre db1a7f27a1 PyTorch DistilBERT 2020-01-23 09:38:45 -05:00
Lysandre b28020f590 TF RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre 3e1bc27e1b Pytorch RoBERTa 2020-01-23 09:38:45 -05:00
Lysandre f44ff574d3 Camembert 2020-01-23 09:38:45 -05:00
Lysandre 264eb23912 TF XLM 2020-01-23 09:38:45 -05:00
Lysandre ccebcae75f PyTorch XLM 2020-01-23 09:38:45 -05:00
Lysandre 92b3cb786d TF XLNet 2020-01-23 09:38:45 -05:00
Lysandre cd656fb21a PyTorch XLNet 2020-01-23 09:38:45 -05:00
Lysandre 83fa8d9fb5 TF Transformer-XL 2020-01-23 09:38:45 -05:00
Lysandre 98edad418e PyTorch Transformer-XL 2020-01-23 09:38:45 -05:00
Lysandre 96d21ad06b TF OpenAI GPT 2020-01-23 09:38:45 -05:00
Lysandre 850795c487 Pytorch GPT 2020-01-23 09:38:45 -05:00
Lysandre 1487b840d3 TF GPT2 2020-01-23 09:38:45 -05:00
Lysandre bd0d3fd76e GPT-2 PyTorch models + better tips for BERT 2020-01-23 09:38:45 -05:00
Lysandre dbeb7fb4e6 BERT TensorFlow 2020-01-23 09:38:45 -05:00
Lysandre cd77c750c5 BERT PyTorch models 2020-01-23 09:38:45 -05:00
Lysandre 3922a2497e TF ALBERT + TF Utilities + Fix warnings 2020-01-23 09:38:45 -05:00
Lysandre 00df3d4de0 ALBERT Modeling + required changes to utilities 2020-01-23 09:38:45 -05:00
Lysandre f81b6c95f2 Flake8 violation 2020-01-23 09:38:45 -05:00
Lysandre 632675ea88 Can test examples spread over multiple blocks 2020-01-23 09:38:45 -05:00