mirrors/rocm_jax
1
0
Fork 0
mirror of https://github.com/ROCm/jax.git synced 2025-04-17 20:36:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1446 from joaogui1/selu

Browse Source 
[Done] Fixed selu activation
This commit is contained in:
James Bradbury 2019-10-07 12:00:54 -07:00 committed by GitHub
commit 2b46e0dbde
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
jax/nn/functions.py
View File

@ -51,7 +51,7 @@ def selu(x):
"""Scaled exponential linear unit activation"""
alpha = 1.6732632423543772848170429916717
scale = 1.0507009873554804934193349852946
return scale * leaky_relu(x, alpha)
return scale * elu(x, alpha)
@jarrett
def gelu(x):