There is an important ommision, the RELU function that has been used with an overwhelming breaktrough the introduction of deep learning for image recognition.

Relu (rectified linear unit) has the following shape _____/

Thank you and everyone feel free to discuss, I'm implementing neural network to an android application right now.