Google Classroom
GeoGebraGeoGebra Classroom

Playing with ReLU

We will examine the output of a network with one input parameter, two hidden neurons, and one output parameter.

ReLU

Leaky ReLU: a is slope parameter.