Are activation functions applied to feature maps?

1

If I have a convolutional neural network, and I convolve my input tensor with a kernel, the output is a feature map. Is an activation function then applied to this feature map?

If its an image that is a 2D tensor, would the activation function change every single value on this image?

Khan

Posted 2020-05-07T15:14:16.510

Reputation: 165

Answers

1

Yes, it is applied element-wise on every single value of the feature map. Assuming ReLU as your nonlinearity function, all negative values of the image feature map are set to zero, and the rest of the elements stay unchanged.

Amir

Posted 2020-05-07T15:14:16.510

Reputation: 61