c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Updating run_squad information in readme

Browse Source
This commit is contained in:
Thomas Wolf authored and GitHub committed 2018-11-06 08:53:01 +01:00
1 parent 79e1b95e75
commit 1a5bbd83dc
1 file changed
+2
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2
View File
@@ -194,3 +194,5 @@ python run_squad.py \
--doc_stride 128 \
--output_dir ../debug_squad/
```
There is currently a bug in the `run_squad.py` script that we are investigating. The reported numbers are very low (F1 of 41.8 and exact match of 21.7) even though the correct answer is usually in the n-best predictions. We are investigating that right now on the develop branch, follow [this issue](https://github.com/huggingface/pytorch-pretrained-BERT/issues/3) for more updates.