steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

machine-learning.functions: Add selu

modern-harvey2
Doug Coleman 2017-07-30 11:40:25 -05:00
parent a515af7d68
commit bfd830f6b4
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
extra/machine-learning/functions/functions.factor
View File

@ -11,6 +11,10 @@ IN: machine-learning.functions
: leaky-relu ( x a -- x' ) : leaky-relu ( x a -- x' )
over 0 < [ * ] [ drop ] if ; inline over 0 < [ * ] [ drop ] if ; inline
! https://arxiv.org/pdf/1706.02515.pdf
: selu ( x a -- x' )
over 0 < [ [ [ e^ ] dip * ] keep - ] [ drop ] if ; inline
: default-leaky-relu ( x -- x' ) : default-leaky-relu ( x -- x' )
.01 leaky-relu ; inline .01 leaky-relu ; inline