c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
462 Commits 171 Branches 49 Tags
4bbb9f2d680f7f84ef53e18b1d0f448bcf94546f
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Li Dong a2da2b4109 [bug fix] args.do_lower_case is always True 
The "default=True" makes args.do_lower_case always True.

```python
parser.add_argument("--do_lower_case",
                        default=True,
                        action='store_true')
```
 2019-01-13 19:51:11 +08:00
Li Dong d0d9b384f2 LayerNorm initialization 
The LayerNorm gamma and beta should be initialized by .fill_(1.0) and .zero_().

reference links:

https://github.com/tensorflow/tensorflow/blob/989e78c412a7e0f5361d4d7dfdfb230c8136e749/tensorflow/contrib/layers/python/layers/layers.py#L2298

https://github.com/tensorflow/tensorflow/blob/989e78c412a7e0f5361d4d7dfdfb230c8136e749/tensorflow/contrib/layers/python/layers/layers.py#L2308
 2019-01-07 15:51:33 +08:00