Commit Graph
76 Commits
Author SHA1 Message Date
VictorSanh 57272d5ddf fix for glue 2019-08-22 00:25:49 -04:00
VictorSanh b006a7a12f fix for squad 2019-08-22 00:25:42 -04:00
VictorSanh 6f877d9daf Update dev results on GLUE (bert-base-uncased) w/ median on 5 runs 2019-08-21 03:43:29 +00:00
VictorSanh ee0308f79d fix typo 2019-06-06 17:30:49 +02:00
VictorSanh 2d07f945ad fix error with torch.no_grad and loss computation 2019-06-06 17:10:24 +02:00
VictorSanh 6b8d227092 some cleaning 2019-06-06 17:07:03 +02:00
VictorSanh 122d5c52ac distinguish was is not trained 2019-06-06 17:02:51 +02:00
VictorSanh 2647ac3294 forgot bertForPreTraining 2019-06-06 16:57:40 +02:00
VictorSanh cf44d98392 Add more examples to BERT models for torchhub 2019-06-06 16:36:02 +02:00
VictorSanh 826496580b Revert "add output_attentions for BertModel"
This reverts commit de5e5682a1.
2019-06-03 17:10:25 -04:00
VictorSanh de5e5682a1 add output_attentions for BertModel 2019-06-03 17:05:24 -04:00
VictorSanh 312fdd7752 fix doc error 2019-06-01 17:43:26 -04:00
VictorSanh cdf0f2fec3 fix typo/presentation 2019-06-01 17:42:00 -04:00
VictorSanh 8f97f6c57f fix typo
cc @thomwolf
2019-06-01 17:29:07 -04:00
VictorSanh 466a96543a fix bug/typos 2019-06-01 17:28:56 -04:00
VictorSanh c198ff5f1f fix typos/bugs 2019-06-01 16:28:42 -04:00
VictorSanh 592d1e3aae fix typos 2019-06-01 16:19:32 -04:00
VictorSanh f836130bff update hubconf 2019-06-01 16:08:29 -04:00
VictorSanh c0c7ff5751 add transformer xl compatibility for torchhub 2019-06-01 16:08:24 -04:00
VictorSanh 48a58646e8 small fix in doc 2019-06-01 16:06:50 -04:00
VictorSanh 2576a5c6db update hubconf for gpt2 torchhub compatibility 2019-06-01 15:28:01 -04:00
VictorSanh a92b6dc3c1 add GPT2 torchhub compatibility 2019-06-01 15:27:43 -04:00
VictorSanh 45d21502f0 update doc 2019-05-31 01:04:16 -04:00
VictorSanh 98f5c7864f decorelate dependencies + fix bug 2019-05-31 01:00:29 -04:00
VictorSanh c8bd026ef6 move dependecies list to hubconf 2019-05-31 00:36:58 -04:00
VictorSanh 19ef2b0a66 Fix typo in hubconf 2019-05-31 00:33:33 -04:00
VictorSanh d0f591051c gpt_hubconf 2019-05-31 00:28:10 -04:00
VictorSanh 4a210c9fc6 Move bert_hubconf to hubconfs 2019-05-31 00:28:00 -04:00
VictorSanh 0c5a4fe9c9 modify from_pretrained for OpenAIGPT 2019-05-31 00:27:18 -04:00
VictorSanh 372a5c1cee Hubconf doc - Specia case loading 2019-05-30 16:06:21 -04:00
Victor SANH 96592b544b default in __init__s for classification BERT models (#650) 2019-05-30 15:53:13 -04:00
VictorSanh 4cda86b08f Update hubconf for torchhub: paths+examples+doc 2019-05-30 18:38:00 +00:00
VictorSanh 290633b882 Fix args.gradient_accumulation_steps used before assigment. 2018-11-04 17:31:50 -05:00
VictorSanh 649e9774cd Fix bug train_batch_size not an int.
Division makes args.train_batch_size becoming a float.
cc @thomwolf
2018-11-04 17:19:40 -05:00
VictorSanh d55c3ae83f Small logger bug (multi-gpu, distribution) in training 2018-11-04 16:28:10 -05:00
VictorSanh 3c24e4bef1 Multi-Gpu loss - Cleaning 2018-11-03 18:03:17 -04:00
VictorSanh 1ba5b58c20 fix typo 2018-11-03 17:10:23 -04:00
VictorSanh 5858e8e4dd Fix both loss and eval metrics -> more coherence on the loss (eval vs train and tf vs pt) 2018-11-03 16:48:24 -04:00
VictorSanh cd09cd5b40 Fix import on initalization 2018-11-03 15:38:30 -04:00
VictorSanh a1af5247e1 Add seed in initialization 2018-11-03 14:00:36 -04:00
VictorSanh 8bd6b235b7 typo on tokenization 2018-11-03 10:27:59 -04:00
VictorSanh 2c55568c40 scatter_ and scatter 2018-11-03 10:27:38 -04:00
VictorSanh a6efe1235f Merge pull request #1 from huggingface/multi-gpu-support
Create DataParallel model if several GPUs
2018-11-03 10:10:34 -04:00
VictorSanh 5f432480c0 Create DataParallel model if several GPUs 2018-11-03 10:10:01 -04:00
VictorSanh 5889765a7c Update README.md 2018-11-03 09:18:44 -04:00
VictorSanh 8c932e37f9 Update the comparison notebook 2018-11-03 09:08:05 -04:00
VictorSanh 391a4ec2f3 Small typo in trange
I seriously don't understand why they defined num_train_epochs as a float in the originial tf code.
I Will change it at the end to avoir merge conflicts for now.
2018-11-03 08:25:15 -04:00
VictorSanh 5676d6f799 Remove BERT pretraining files for now 2018-11-03 08:17:22 -04:00
VictorSanh 72ab10399f Fix loss
Please review @thomwolf but i think this is equivqlent (and it mimics the loss computation of the original loss)
2018-11-02 18:06:21 -04:00
VictorSanh 25d5ca48e0 Fix scatter LopngTensor 2018-11-02 17:57:46 -04:00
VictorSanh e6a710f684 device 2018-11-02 17:54:22 -04:00
VictorSanh 3ebf1a13c9 Fix loss computation for indexes bigger than max_seq_length. 2018-11-02 17:49:35 -04:00
VictorSanh 38f740a1d5 Fix bug writing predictions in run_squad_pytorch 2018-11-02 11:29:45 -04:00
VictorSanh ee29871f8d Debug run_squad_pytorch 2018-11-02 11:07:32 -04:00
VictorSanh 101eabff90 Debug run_squad_pytorch 2018-11-02 10:44:08 -04:00
VictorSanh bb0a510330 Print for debug run_squad 2018-11-02 10:16:07 -04:00
VictorSanh 844b2f0e6f Small update Readme 2018-11-02 08:57:15 -04:00
VictorSanh beb59080b3 Fix size compatibility for model.forward
Error was coming from "modeling_pytorch.py", line 484, in forward: start_loss = loss_fct(start_logits, start_positions) --> ValueError: Expected target size (12, 1), got torch.Size([12])
2018-11-02 04:36:42 -04:00
VictorSanh 8cbe7d6af8 FIX errors in loading eval Dataset in run_squad_pytorch 2018-11-02 04:09:53 -04:00
VictorSanh 833c3a7a25 FIX errors in loading Dataset in run_squad_pytorch 2018-11-02 04:00:00 -04:00
VictorSanh 72d69a4ef4 Update README 2018-11-02 03:37:39 -04:00
VictorSanh 62ac7e9a60 Fix small bug in run_squad_pytorch.py 2018-11-02 03:32:35 -04:00
VictorSanh 98b9771dfe Quick fix metrics evaluation on run_classif_pytorch 2018-11-02 03:02:06 -04:00
VictorSanh bf65d4dbb7 Begin Updating the README.md 2018-11-02 02:51:07 -04:00
VictorSanh b54de837c2 Quick fix on eval accuracy 2018-11-02 02:46:17 -04:00
VictorSanh 1d53f9cb72 Fix cuda compability for evaluation 2018-11-02 01:39:15 -04:00
VictorSanh 1d8511f8f2 FIX small bugs in run_classifier_pytorch.py 2018-11-02 01:12:52 -04:00
VictorSanh 936eb4c3ad FIX small bugs in run_classifier_pytorch.py 2018-11-02 01:11:25 -04:00
VictorSanh cc228089ef Small fix to ensure Python3 compativility. 2018-11-02 00:02:36 -04:00
VictorSanh 7af7f8173b Fix oubli 2018-11-01 15:44:52 -04:00
VictorSanh d3a8df6b9f typos in input_fn_builder 2018-11-01 14:17:55 -04:00
VictorSanh 836faed985 wip 2018-11-01 14:17:12 -04:00
VictorSanh 90d360a7a9 WIP 2018-11-01 12:09:23 -04:00
VictorSanh 555b7d66c9 input_fn_builder WIP 2018-11-01 02:10:46 -04:00
VictorSanh f8e347b557 Convert all DataProcessors, _truncate_seq_pair and convert_examples_to_features 2018-11-01 01:33:01 -04:00
VictorSanh b1dade34db Convert flags to argparse in run_classifier_pytorch.py 2018-11-01 01:05:11 -04:00