Commit Graph
1882 Commits
Author SHA1 Message Date
Lysandre Debut 2431fea98a Merge pull request #1383 from keskarnitish/master
Adding CTRL
2019-10-09 11:31:05 -04:00
thomwolf d9e60f4f0d Merge branch 'master' into pr/1383 2019-10-09 17:25:08 +02:00
Lysandre Debut e84470ef81 Merge pull request #1384 from huggingface/encoding-qol
Quality of life enhancements in encoding + patch MLM masking
2019-10-09 11:18:24 -04:00
thomwolf 07d055f849 higher tolerance 2019-10-09 17:10:04 +02:00
thomwolf 48b438ff2a doc and conversion 2019-10-09 17:06:30 +02:00
jinoobaek-qz 69629c4f0f Improve naming and only do regex when necessary 2019-10-09 08:48:40 -04:00
jinoobaek-qz bf34a252b8 Golden path 2019-10-09 08:48:40 -04:00
jinoobaek-qz 528d3f327b Improve readability and improve make less assumptions about checkpoint format 2019-10-09 08:48:40 -04:00
jinoobaek-qz 56301bd9e8 Extract method 2019-10-09 08:48:40 -04:00
jinoobaek-qz d6c5469712 Delete older checkpoint after saving new checkpoint 2019-10-09 08:48:40 -04:00
jinoobaek-qz 54a31f50fb Add save_total_limit 2019-10-09 08:48:40 -04:00
thomwolf c19b8e4ae0 fixing CTRL tests and OpenAI GPT tests 2019-10-09 13:51:05 +02:00
thomwolf 6dce6dda1b fixing TF 2.0 model - adding more severe test on pt/tf equivalence 2019-10-09 11:57:55 +02:00
thomwolf c56d921dda adding TF 2.0 model 2019-10-09 11:07:43 +02:00
thomwolf 1c5079952f simpler distilbert mask - fix tf tests 2019-10-09 04:26:20 +02:00
Thomas Wolf 58b302caf3 Merge pull request #1398 from dveselov/patch-1
Fixed typo in docs README
2019-10-09 03:52:42 +02:00
Thomas Wolf 439fac723a Merge pull request #1409 from brian41005/master
Evaluation result.txt path changing #1286
2019-10-09 03:14:34 +02:00
thomwolf 23b7138ab4 fix #1378 and #1453 2019-10-09 01:54:44 +02:00
Julien Chaumond d688af19e5 Update link to swift-coreml-transformers
cc @lysandrejik
2019-10-08 16:37:52 -04:00
thomwolf 45dc04f33d tf model [WIP] 2019-10-08 17:37:17 +02:00
thomwolf 248314772f fix tokenization 2019-10-08 17:19:28 +02:00
thomwolf 03c2c762a6 update tokenizer 2019-10-08 17:12:03 +02:00
thomwolf 3edfa1d6aa update model to use past 2019-10-08 17:11:58 +02:00
Rémi Louf f4d41fe33e Merge pull request #1448 from huggingface/contributing
add contribution guidelines
2019-10-08 16:55:34 +02:00
Rémi Louf 45de313a9e add bullet point on modifying an existing PR 2019-10-08 11:54:10 +02:00
Rémi Louf ade05b6cef add code contribution 2019-10-07 23:20:25 +02:00
Rémi Louf e9c09052a4 add issues and requests guidelines 2019-10-07 22:30:55 +02:00
LysandreJik 8fcc6507ce Multilingual 2019-10-07 15:02:42 -04:00
Rémi Louf 6e3e1c959e Merge pull request #1447 from huggingface/dev-requirements
Provide requirements.txt for development dependencies
2019-10-07 18:49:26 +02:00
VictorSanh 7ce83b4931 update weights for distilgpt2 2019-10-07 12:30:27 -04:00
VictorSanh 9f81f1cba8 fix convert pt_to_tf2 for custom weights 2019-10-07 12:30:19 -04:00
Rémi Louf 7afd00a661 freeze dev requirements 2019-10-07 17:58:13 +02:00
thomwolf bd5363cc83 update CTRL configuration 2019-10-07 15:37:30 +02:00
thomwolf dc89441167 update CTRL pytorch model 2019-10-07 15:37:25 +02:00
thomwolf 320b7a7e01 fix #1416 2019-10-07 14:26:59 +02:00
Thomas Wolf 1615360c71 Merge pull request #1438 from SeanBE/master
fix pytorch-transformers migration description in README
2019-10-07 05:02:23 -04:00
seanBE 6dc6c716c5 fix pytorch-transformers migration description in README 2019-10-07 09:59:54 +01:00
Christopher Goh 904158ac4d Rephrase forward method to reduce ambiguity 2019-10-06 23:40:52 -04:00
Christopher Goh 0f65d8cbbe Fix some typos in README 2019-10-06 23:40:52 -04:00
LysandreJik f3e0218fbb Correct device assignment in run_generation 2019-10-05 21:05:16 -04:00
thomwolf 78ef1a9930 fixes 2019-10-04 17:59:44 -04:00
thomwolf 6c1d0bc066 update encode_plus - add truncation strategies 2019-10-04 17:38:38 -04:00
VictorSanh 0820bb0555 unecessary carriage return 2019-10-04 17:23:15 -04:00
VictorSanh f5891c3821 run_squad --> run_squad_w_distillation 2019-10-04 17:23:15 -04:00
VictorSanh 764a7923ec add distillation+finetuning option in run_squad 2019-10-04 17:23:15 -04:00
Lysandre Debut bb464289ce New model addition issue template 2019-10-04 16:41:26 -04:00
thomwolf 92c0f2fb90 Merge remote-tracking branch 'origin/julien_multiple-choice' into encoding-qol 2019-10-04 15:48:06 -04:00
Julien Chaumond 9e136ff57c Honor args.overwrite_cache (h/t @erenup) 2019-10-04 15:00:56 -04:00
LysandreJik 7bddb45a6f Decode documentaton 2019-10-04 14:27:38 -04:00
keskarnitish dbed1c5d94 Adding CTRL (squashed commit)
adding conversion script

adding first draft of modeling & tokenization

adding placeholder for test files

bunch of changes

registering the tokenizer/model/etc

tests

change link; something is very VERY wrong here

weird end-of-word thingy going on

i think the tokenization works now ; wrote the unit tests

overall structure works;load w next

the monster is alive!

works after some cleanup as well

adding emacs autosave to gitignore

currently only supporting the 48 layer one; seems to infer fine on my macbook

cleanup

fixing some documentation

fixing some documentation

tests passing?

now works on CUDA also

adding greedy?

adding greedy sampling

works well
2019-10-03 22:29:03 -07:00