change to apex for better fp16 and multi-gpu support

This commit is contained in:
Deyu Fu committed 2018-12-11 17:13:58 -08:00
1 parent a3a3180c86
commit c8ea286048
6 files changed
+142 -169

No files matched your search

+1 -1
View File
@@ -326,7 +326,7 @@ The optimizer accepts the following arguments:
- `b1` : Adams b1. Default : `0.9`
- `b2` : Adams b2. Default : `0.999`
- `e` : Adams epsilon. Default : `1e-6`
- `weight_decay_rate:` Weight decay. Default : `0.01`
- `weight_decay:` Weight decay. Default : `0.01`
- `max_grad_norm` : Maximum norm for the gradients (`-1` means no clipping). Default : `1.0`
## Examples