Commit Graph
29 Commits
Author SHA1 Message Date
Thomas Wolf 18601c3b6e Merge pull request #2173 from erenup/master
run_squad with roberta
2019-12-21 14:33:16 +01:00
Lysandre a1f1dce0ae Correct max position for SQUAD and TFDS 2019-12-19 12:25:55 -05:00
erenup d000195ee6 add comment for example_index and unique_id in single process 2019-12-17 11:28:34 +08:00
erenup c7780700f5 Merge branch 'refs/heads/squad_roberta'
# Conflicts:
#	transformers/data/processors/squad.py
2019-12-14 08:53:59 +08:00
erenup 8e9526b4b5 add multiple processing 2019-12-14 08:43:58 +08:00
Lysandre d461472948 return for SQuAD [BLACKED] 2019-12-13 15:31:52 -05:00
Lysandre f24a228a93 Speed up tokenization process 2019-12-13 14:50:35 -05:00
erenup 9b312f9d41 initial version for roberta squad 2019-12-13 14:51:40 +08:00
LysandreJik 7296f1010b Cleanup squad and add allow train_file and predict_file usage 2019-12-12 13:01:04 -05:00
LysandreJik e9217da5ff Cleanup
Improve global visibility on the run_squad script, remove unused files and fixes related to XLNet.
2019-12-05 16:01:51 -05:00
LysandreJik 9ecd83dace Patch evaluation for impossible values + cleanup 2019-12-05 14:44:57 -05:00
LysandreJik ce158a076f Return dataset (pytorch) 2019-12-04 17:55:52 -05:00
LysandreJik 7a03519975 Documentation 2019-12-04 17:24:35 -05:00
LysandreJik 33508ae310 Remove only_first 2019-12-04 16:26:45 -05:00
LysandreJik f7e4a7cdfa Cleanup 2019-12-04 16:24:15 -05:00
LysandreJik a7ca6d738b Padding side is tokenizer-dependant 2019-12-04 15:43:34 -05:00
LysandreJik cca75e7884 Kill the demon spawn 2019-12-04 15:42:29 -05:00
LysandreJik bf119c0568 TFDS dataset can now be evaluated 2019-12-04 11:34:59 -05:00
LysandreJik de276de1c1 Working evaluation 2019-12-03 17:15:51 -05:00
LysandreJik 285b1241e3 Added SquadResult 2019-12-03 15:00:49 -05:00
Lysandre 1e9ac5a7cf New -> normal 2019-11-28 17:43:47 -05:00
Lysandre f671997ef7 Interface with TFDS 2019-11-28 17:17:20 -05:00
Lysandre bd41e8292a Cleanup & Evaluation now works 2019-11-28 16:03:56 -05:00
Lysandre 0669c1fcd1 SQuAD v2 BERT + XLNet 2019-11-25 19:22:21 -05:00
Lysandre e0e55bc550 Manage training example & refactor the refactor 2019-11-22 16:27:45 -05:00
Lysandre c3ba645237 Works for XLNet 2019-11-22 16:27:37 -05:00
LysandreJik a5a8a6175f Works for BERT 2019-11-22 16:27:31 -05:00
Lysandre 72e506b22e wip 2019-11-22 16:26:00 -05:00
Lysandre ea52f82455 Moved some SQuAD logic to /data 2019-11-22 16:25:52 -05:00