Question

Which of the following activation function outputs is zero-centered?

• A. Hyperbolic tangent
• B. Sigmoid
• C. Softmax
• D. Rectified Linear Unit (ReLU)

Hint:

Use hyperbolic tangent (tanh) for zero-centered activations, especially in hidden layers, to improve optimization.

Answer 1

The Correct Option is A

The hyperbolic tangent (tanh) function outputs values in the range [−1, 1], making it zero-centered. This property ensures that the mean activation is closer to zero, improving optimization. Other functions like sigmoid, softmax, and ReLU are not zero-centered.