LBANN  0.103.0
LivermoreBigArtificialNeuralNetworkToolkit
lbann::softplus_layer Class Reference

Smooth approximation to ReLU function. More...

#include <activations.hpp>

Detailed Description

Smooth approximation to ReLU function.

\[ \text{softplus}(x) = \log (e^x + 1) \]

See https://en.wikipedia.org/wiki/Rectifier_(neural_networks)


The documentation for this class was generated from the following file: