c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,341 Commits 171 Branches 49 Tags
912a377e904d1ec10ce2555c80035c074ff51e12
Commit Graph
182 Commits
Author SHA1 Message Date
thomwolf 912a377e90 dilbert -> distilbert 2019-08-28 13:59:42 +02:00
thomwolf c9bce1811c fixing model to add torchscript, embedding resizing, head pruning and masking + tests 2019-08-28 13:22:45 +02:00
thomwolf 62df4ba59a add dilbert tokenizer and tests 2019-08-28 12:22:56 +02:00
VictorSanh a5fe16687b fix typo 2019-08-28 07:22:54 +00:00
VictorSanh 19b7c9b0b7 add DilBert model for squad 2019-08-28 06:25:44 +00:00
LysandreJik c513415b19 Dilbert tests from CommonTests 2019-08-27 23:59:00 -04:00
LysandreJik 778a263f09 GilBert added to AutoModels 2019-08-27 23:14:00 -04:00
VictorSanh 74d78beeb4 fix: add qa_dropout and seq_classif_dropout 2019-08-28 03:13:11 +00:00
VictorSanh 7f5d85347e fix small typo 2019-08-28 02:44:51 +00:00
VictorSanh 906581ae3c add s3 links for dilbert (+fix small typo) 2019-08-28 02:43:33 +00:00
VictorSanh 5d29f8e99b fix bugs 2019-08-28 00:57:16 +00:00
VictorSanh a8ad83040d fix bugs 2019-08-28 00:45:33 +00:00
VictorSanh 60c984da6c fix bugs 2019-08-27 22:25:55 +00:00
VictorSanh 42968138c8 wip wouf 2019-08-27 22:00:38 +00:00
VictorSanh 1d23240068 wip 2019-08-27 14:27:47 +00:00
LysandreJik e08c01aa1a fix #1102 2019-08-26 18:13:06 -04:00
Abhishek Rao c603d099aa reraise EnvironmentError in from_pretrained functions of Model and Tokenizer 2019-08-22 15:25:40 -07:00
Abhishek Rao 14eef67eb2 Fix at config rather than model 2019-08-21 15:48:43 -07:00
Abhishek Rao 296df2b18c reraise exception 2019-08-21 15:29:30 -07:00
thomwolf fdc487d8b3 Add max length 2019-08-21 02:35:01 +02:00
thomwolf aa05dc8935 adding gpt-2 large 2019-08-21 02:29:34 +02:00
Thomas Wolf e4515faf54 Merge pull request #1057 from huggingface/fixes 
Add a few of typos corrections, bugs fixes and small improvements
 2019-08-21 01:54:05 +02:00
Thomas Wolf 41789c6c3d Merge pull request #1059 from GuillemGSubies/master 
Better use of spacy tokenizer in open ai and xlm tokenizers
 2019-08-21 01:53:48 +02:00
Thomas Wolf d30cbaf5dc Merge branch 'master' into iterative_split_on_token 2019-08-21 01:33:02 +02:00
Thomas Wolf e753f249e1 Merge pull request #806 from wschin/fix-a-path 
Fix a path so that a test can run on Windows
 2019-08-21 01:14:40 +02:00
thomwolf 43489756ad adding proxies options for the from_pretrained methods 2019-08-20 16:59:11 +02:00
Guillem García Subies 388e3251fa Update tokenization_xlm.py 2019-08-20 14:19:39 +02:00
Guillem García Subies f5e2ed0fd8 Update tokenization_openai.py 2019-08-20 14:19:25 +02:00
Guillem García Subies 562b998366 Update tokenization_openai.py 2019-08-20 14:10:19 +02:00
Guillem García Subies bb04446285 Update tokenization_openai.py 2019-08-20 14:07:40 +02:00
Guillem García Subies bfd75056b0 Update tokenization_xlm.py 2019-08-20 14:06:17 +02:00
thomwolf 6d0aa73981 fix #1034 2019-08-20 12:20:21 +02:00
Julien Chaumond b0b9b8091b minor typo 2019-08-20 11:33:46 +02:00
thomwolf 53c8f700f4 fix #808 2019-08-20 11:29:26 +02:00
thomwolf 901dde0e45 fix #1014 2019-08-20 11:05:51 +02:00
thomwolf fecaed0ed4 add force_download option to from_pretrained methods 2019-08-20 10:56:12 +02:00
Lysandre c589862b78 Doc: loading from config alone does not load the model weights 2019-08-19 10:17:47 -04:00
LysandreJik ab05280666 Order of strings in AutoModel/AutoTokenizer updated. 2019-08-16 09:53:26 -04:00
LysandreJik 83dba0b67b Added RoBERTa tokenizer to AutoTokenizer 2019-08-15 17:07:07 -04:00
LysandreJik e24e19ce3b Added RoBERTa to AutoModel/AutoConfig 2019-08-15 14:02:11 -04:00
LysandreJik fe02e45e48 Release: 1.1.0 2019-08-15 11:15:08 -04:00
Lysandre Debut 88efc65bac Merge pull request #964 from huggingface/RoBERTa 
RoBERTa: model conversion, inference, tests 🔥
 2019-08-15 11:11:10 -04:00
LysandreJik 8308170156 Warning for RoBERTa sequences encoded without special tokens. 2019-08-15 10:29:04 -04:00
LysandreJik 572dcfd1db Doc 2019-08-14 14:56:14 -04:00
samvelyan 9ce36e3e4b Re-implemented tokenize() iteratively in PreTrainedTokenizer. 2019-08-14 08:57:09 +00:00
LysandreJik 39f426be65 Added special tokens <pad> and <mask> to RoBERTa. 2019-08-13 15:19:50 -04:00
LysandreJik 3d87991f60 Fixed error with encoding 2019-08-13 12:00:24 -04:00
LysandreJik 634a3172d8 Added integration tests for sequence builders. 2019-08-12 15:14:15 -04:00
LysandreJik 22ac004a7c Added documentation and changed parameters for special_tokens_sentences_pair. 2019-08-12 15:13:53 -04:00
Julien Chaumond b3d83d68db Fixup 9d0603148b 2019-08-12 12:28:55 -04:00