c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,052 Commits 171 Branches 49 Tags
1487b840d3457bf8b0f1fcacd02d3a2fae407fe5
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lysandre 1487b840d3 TF GPT2 2020-01-23 09:38:45 -05:00
Lysandre bd0d3fd76e GPT-2 PyTorch models + better tips for BERT 2020-01-23 09:38:45 -05:00
Lysandre dbeb7fb4e6 BERT TensorFlow 2020-01-23 09:38:45 -05:00
Lysandre cd77c750c5 BERT PyTorch models 2020-01-23 09:38:45 -05:00
Lysandre 3922a2497e TF ALBERT + TF Utilities + Fix warnings 2020-01-23 09:38:45 -05:00
Lysandre 00df3d4de0 ALBERT Modeling + required changes to utilities 2020-01-23 09:38:45 -05:00
Lysandre f81b6c95f2 Flake8 violation 2020-01-23 09:38:45 -05:00
Lysandre 632675ea88 Can test examples spread over multiple blocks 2020-01-23 09:38:45 -05:00
Lysandre eaa6b9afc6 Require Torch when testing examples 2020-01-23 09:38:45 -05:00
Lysandre 9bab9b83d2 Glossary 2020-01-23 09:38:45 -05:00
Lysandre 64abd3e0aa Multi-line examples can be tested + ALBERT patch for CircleCI 
All tests should now work fine.
 2020-01-23 09:38:45 -05:00
Lysandre 837577256b Automatic testing of examples 
The CircleCI test should fail.
 2020-01-23 09:38:45 -05:00
Lysandre c7f79815e7 Cleanup unused variables 2020-01-21 11:40:24 -05:00
Lysandre 15579e2d55 [SQuAD v2] Code quality 2020-01-21 11:36:46 -05:00
Lysandre 088fa7b759 Correct segment ID for XLNet single sequence 2020-01-21 11:33:45 -05:00
Lysandre 073219b43f Manage impossible examples SQuAD v2 2020-01-21 11:24:43 -05:00
Lysandre ca6ce3040d Fix style 2020-01-20 10:56:23 -05:00
Lysandre 6e2c28a14a Run SQuAD warning when the doc stride may be too high 2020-01-16 13:59:26 -05:00
Lysandre dfe012ad9d Fix misleading RoBERTa token type ids 2020-01-14 17:47:28 -05:00
Lysandre c024ab98df Improve padding side documentation 2020-01-14 17:44:23 -05:00
Lysandre 9aeb0b9b8a Improve padding side documentation 2020-01-14 17:43:00 -05:00
Lysandre 100e3b6f21 Bias should be resized with the weights 
Created a link between the linear layer bias and the model attribute bias. This does not change anything for the user nor for the conversion scripts, but allows the `resize_token_embeddings` method to resize the bias as well as the weights of the decoder.

Added a test.
 2020-01-14 13:43:45 -05:00
Lysandre 6c32d8bb95 Size > Dimensionality + Remove final TODOs 2020-01-14 14:09:09 +01:00
Lysandre 760164d63b RoBERTa example 2020-01-14 14:09:09 +01:00
Lysandre 387217bd3e Added example usage 2020-01-14 14:09:09 +01:00
Lysandre 7d1bb7f256 Add missing XLNet and XLM models 2020-01-14 14:09:09 +01:00
Lysandre a1cb100460 Wrap up configurations 2020-01-14 14:09:09 +01:00
Lysandre c11b6fd393 Update links in all configurations 2020-01-14 14:09:09 +01:00
Lysandre Debut 632682726f Updated Configurations 2020-01-14 14:09:09 +01:00
Lysandre 164c794eb3 New SQuAD API for distillation script 2020-01-10 11:42:53 +01:00
Lysandre 801f2ac8c7 Add PRETRAINED_INIT_CONFIGURATION to DistilBERT tokenizer 2020-01-10 11:42:21 +01:00
Lysandre 16ce15ed4b DistilBERT token type ids removed from inputs in run_squad 2020-01-08 13:18:30 +01:00
Lysandre Debut f24232cd1b Fix error with global step in run_squad.py 2020-01-08 11:39:00 +01:00
Lysandre Debut 27c1b656cc Fix error with global step in run_lm_finetuning.py 2020-01-07 16:16:12 +01:00
Lysandre 24df44d9c7 Black version python 3.5 2020-01-07 15:53:42 +01:00
Lysandre Debut 73be60c47b Quotes 2020-01-07 15:34:23 +01:00
Lysandre 6806f8204e fix #2410 2020-01-07 15:20:45 +01:00
Lysandre Debut 1efc208ff3 Complete DataProcessor class 2020-01-06 15:02:25 +01:00
Lysandre 74755c89b9 Example snippet for BertForQuestionAnswering 2020-01-06 14:41:53 +01:00
Lysandre a436574bfd Release: v2.3.0 2019-12-20 16:22:20 -05:00
Lysandre cb6d54bfda Numpy compatibility for sentence piece 
convert to int earlier
 2019-12-20 15:06:28 -05:00
Lysandre 65c75fc587 Clean special tokens test 2019-12-20 11:34:16 -05:00
Lysandre fb393ad994 Added test for all special tokens 2019-12-20 11:29:58 -05:00
Lysandre 33adab2b91 Fix albert example 2019-12-19 12:40:43 -05:00
Lysandre a1f1dce0ae Correct max position for SQUAD and TFDS 2019-12-19 12:25:55 -05:00
Lysandre 8efc6dd544 fix #2214 2019-12-18 10:47:59 -05:00
Lysandre 5e289f69bc regex 2019.12.17 install fails with Python 2 2019-12-17 15:54:05 -05:00
Lysandre 2cff4bd8f3 Fix segmentation fault 2019-12-17 15:54:05 -05:00
Lysandre 18a879f475 fix #2180 2019-12-16 16:44:29 -05:00
Lysandre d803409215 Fix run squad evaluate during training 2019-12-16 16:31:38 -05:00
Lysandre 7bd11dda6f Release: v2.2.2 2019-12-13 16:45:30 -05:00
LysandreJik c3248cf122 Tests for all tokenizers 2019-12-13 16:41:44 -05:00
Lysandre d461472948 return for SQuAD [BLACKED] 2019-12-13 15:31:52 -05:00
Lysandre f24a228a93 Speed up tokenization process 2019-12-13 14:50:35 -05:00
Lysandre c8ed1c82c8 [SQUAD] Load checkpoint when evaluating without training 2019-12-13 12:13:48 -05:00
LysandreJik 7296f1010b Cleanup squad and add allow train_file and predict_file usage 2019-12-12 13:01:04 -05:00
LysandreJik 3fd71c4431 Update example scripts 2019-12-12 12:08:54 -05:00
LysandreJik fe92755b99 Fix special tokens mask in encode 2019-12-12 11:37:19 -05:00
LysandreJik 3d57c51111 Fix encode plus 2019-12-11 15:10:17 -05:00
LysandreJik 4c12860f7a Remove misleading documentation 2019-12-11 09:22:37 -05:00
LysandreJik b72f9d340e Correct index in script 2019-12-10 18:33:17 -05:00
LysandreJik ec6fb25c21 Patch documentation 2019-12-10 15:49:20 -05:00
LysandreJik 418589244d Uniforming the ignored indices 2019-12-10 15:26:19 -05:00
LysandreJik 6a73382706 Complete warning + cleanup 2019-12-10 14:33:24 -05:00
Lysandre dc4e9e5cb3 DataParallel for SQuAD + fix XLM 2019-12-10 19:21:20 +00:00
LysandreJik 2a4ef098d6 Add ALBERT and XLM to SQuAD script 2019-12-09 10:46:47 -05:00
LysandreJik e9217da5ff Cleanup 
Improve global visibility on the run_squad script, remove unused files and fixes related to XLNet.
 2019-12-05 16:01:51 -05:00
LysandreJik 9ecd83dace Patch evaluation for impossible values + cleanup 2019-12-05 14:44:57 -05:00
LysandreJik ce158a076f Return dataset (pytorch) 2019-12-04 17:55:52 -05:00
LysandreJik 7a03519975 Documentation 2019-12-04 17:24:35 -05:00
LysandreJik 33508ae310 Remove only_first 2019-12-04 16:26:45 -05:00
LysandreJik f7e4a7cdfa Cleanup 2019-12-04 16:24:15 -05:00
LysandreJik a7ca6d738b Padding side is tokenizer-dependant 2019-12-04 15:43:34 -05:00
LysandreJik cca75e7884 Kill the demon spawn 2019-12-04 15:42:29 -05:00
LysandreJik bf119c0568 TFDS dataset can now be evaluated 2019-12-04 11:34:59 -05:00
LysandreJik 9ddc3f1a12 Naming update + XLNet/XLM evaluation 2019-12-04 10:37:00 -05:00
LysandreJik de276de1c1 Working evaluation 2019-12-03 17:15:51 -05:00
LysandreJik c835bc85c2 Compute predictions 2019-12-03 15:28:16 -05:00
LysandreJik 285b1241e3 Added SquadResult 2019-12-03 15:00:49 -05:00
LysandreJik 8101924a68 Patch: v2.2.1 2019-12-03 11:20:26 -05:00
LysandreJik fbaf05bd92 Remove annoying tokenization message 2019-12-02 18:23:00 -05:00
Lysandre e85855f2c4 Fix ALBERT exports with pretraining + sp classifier; Fix naming for ALBERT TF models 2019-12-02 18:00:19 -05:00
Lysandre b3d834ae11 Reorganize ALBERT conversion script 2019-12-02 15:01:52 -05:00
Lysandre 1e9ac5a7cf New -> normal 2019-11-28 17:43:47 -05:00
Lysandre 0b84b9fd8a Add processors to __init__ 2019-11-28 17:38:52 -05:00
Lysandre f671997ef7 Interface with TFDS 2019-11-28 17:17:20 -05:00
Lysandre bd41e8292a Cleanup & Evaluation now works 2019-11-28 16:03:56 -05:00
Lysandre 45d767297a Updated v2.2.0 doc 2019-11-27 10:12:20 -05:00
Lysandre 361620954a Remove TFBertForPreTraining from ALBERT doc 2019-11-27 10:11:37 -05:00
Lysandre cc7968227e Updated v2.2.0 doc 2019-11-26 15:52:25 -05:00
Lysandre ce02550d50 Fix pretrained models table 2019-11-26 15:47:02 -05:00
Lysandre cf26a0c85e Fix pretrained models table 2019-11-26 15:40:03 -05:00
Lysandre 44b82c777f Updated v2.2.0 doc 2019-11-26 15:15:11 -05:00
Lysandre ee4647bd5c CamemBERT & ALBERT doc 2019-11-26 15:10:51 -05:00
Lysandre 7c6000e412 Updated v2.2.0 doc 2019-11-26 14:55:29 -05:00
Lysandre 668aac45d2 Pretrained models 2019-11-26 14:52:42 -05:00
Lysandre ae98d45991 Release: v2.2.0 2019-11-26 14:12:44 -05:00
Lysandre f2f329408d Fix input embeddings 2019-11-26 13:08:12 -05:00
LysandreJik c536c2a480 ALBERT Input Embeds 2019-11-26 13:08:12 -05:00
LysandreJik f873b55e43 Warning for ALBERT-v2 models 2019-11-26 13:08:12 -05:00