Skip to content

Activation Functions

Ned Taylor edited this page Feb 17, 2024 · 1 revision

The activation (transfer) functions currently available within the ATHENA library are:

  • gaussian
  • linear
  • piecewise
  • relu
  • leaky_relu
  • sigmoid
  • softmax
  • tanh
  • none

Most of them employ a scaling factor that can be set manually, but defaults to 1.0.

Definitions of these different forms of normalisation can be found at either Keras, or many other places online.