Commit Graph
1882 Commits
Author SHA1 Message Date
thomwolf 4ddc31ff40 update readme with migration change 2019-09-26 12:00:38 +02:00
thomwolf f47f7f4611 add logo 2019-09-26 11:28:44 +02:00
thomwolf 9fabc0b6a9 wip readme 2019-09-26 11:21:34 +02:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf 2f071fcb02 clean up TFConv1D API 2019-09-26 10:09:45 +02:00
thomwolf 5705333441 add initialization for everybody 2019-09-26 10:06:20 +02:00
thomwolf f2a337b3ed fix tokenization tests for gpt2 roberta 2019-09-26 09:02:43 +02:00
Thomas Wolf 4a233e5b2c Merge pull request #1315 from bryant1410/patch-1
Remove unnecessary use of FusedLayerNorm
2019-09-26 08:50:02 +02:00
thomwolf 7a99e4b196 fix #1196 and fix #1285 2019-09-26 08:41:02 +02:00
thomwolf 7c9f8f93f9 fix tests 2019-09-26 01:59:53 +02:00
thomwolf d6dde438ea add batch dimension in encode 2019-09-26 01:45:55 +02:00
thomwolf 4a21c4d88d add warning if neither pt nor tf are found 2019-09-26 01:30:06 +02:00
thomwolf 2967de06f4 adding intialization to bert 2019-09-25 22:08:38 +02:00
thomwolf a6bcfb8015 fix tests 2019-09-25 21:14:12 +02:00
thomwolf 78863f6b36 fix tokenizer to tensors 2019-09-25 21:09:46 +02:00
thomwolf 8a618e0af5 clean up __init__ 2019-09-25 21:04:52 +02:00
thomwolf 3b7fb48c3b fix loading from tf/pt 2019-09-25 17:46:16 +02:00
thomwolf a049c8043b push fix to training 2019-09-25 17:33:16 +02:00
thomwolf 5def3302f4 update run_glue 2019-09-25 12:38:08 +02:00
thomwolf f71758f7a4 update internal glue processors 2019-09-25 12:00:50 +02:00
thomwolf 0f091062d4 Merge branch 'glue-example' into tf2 2019-09-25 10:21:52 +02:00
thomwolf c4acc3a8e9 let encode accept tensor inputs 2019-09-25 10:19:14 +02:00
Thomas Wolf e8e956dbb2 Merge pull request #1327 from huggingface/tf2-determinism
Pytorch/TF2 determinism
2019-09-24 22:49:57 +02:00
Thomas Wolf e4022d96f7 Merge pull request #1325 from huggingface/glue-included
[Proposal] GLUE processors included in library
2019-09-24 21:40:10 +02:00
LysandreJik 1761d2091a Check to see if the models have the same results when in eval mode (pt) or when training=False (tf) 2019-09-24 14:59:10 -04:00
thomwolf 789ea72037 fix output_token_type in glue 2019-09-24 17:32:01 +02:00
thomwolf 1cbd566c63 Merge branch 'glue-example' into glue-included 2019-09-24 17:24:52 +02:00
thomwolf 743e383d4b py2 fix 2019-09-24 17:21:54 +02:00
thomwolf 99a90e43d4 update data processors __init__ 2019-09-24 17:16:46 +02:00
thomwolf b5ec526f85 updated data processor and metrics 2019-09-24 17:10:50 +02:00
thomwolf a6981076ec various updates 2019-09-24 16:46:26 +02:00
LysandreJik 0b82e3d0d9 Relative imports 2019-09-24 09:52:25 -04:00
LysandreJik f09e5ecef0 [Proposal] GLUE processors included in library 2019-09-24 09:47:34 -04:00
thomwolf 128bdd4c35 fix tests pt/tf 2019-09-24 15:43:39 +02:00
LysandreJik 72402d1acd Fixed DistilBERT tokenizer 2019-09-24 09:41:14 -04:00
thomwolf 28a30af6d1 fix auto models 2019-09-24 15:33:39 +02:00
thomwolf de203853cc docstring for xlnet 2019-09-24 15:30:55 +02:00
thomwolf 559790f9e4 docstring for xlm 2019-09-24 15:26:57 +02:00
thomwolf b3087ddde8 docstring t-xl 2019-09-24 15:21:51 +02:00
thomwolf 4761a39781 doctring roberta 2019-09-24 15:19:09 +02:00
thomwolf 45a6f2edd9 docstring for GPT 2019-09-24 15:15:47 +02:00
thomwolf e7ba5bc85b docstring for GPT2 2019-09-24 15:12:36 +02:00
LysandreJik d340e2329e create_mask_from_sequences -> create_token_type_ids_from_sequences 2019-09-24 09:09:28 -04:00
thomwolf b94f73bab7 distilbert docstring 2019-09-24 15:06:51 +02:00
thomwolf 9678c49419 docstrings for bert 2019-09-24 14:57:05 +02:00
thomwolf f3d1511b5b fix imports 2019-09-24 14:42:09 +02:00
thomwolf dd2d90f344 update automodels 2019-09-24 14:39:41 +02:00
thomwolf ee261439a9 add save_pretrained 2019-09-24 14:30:28 +02:00
thomwolf 29bb3e4eb0 double loading ok 2019-09-24 14:23:46 +02:00
thomwolf f5397ffc3b update loading logics 2019-09-24 14:03:58 +02:00