Check and correct activation functions

[JakeRoggenbuck]

Correct activation functions

• List activation functions
• Check all listed functions

Make a graph of each function and display it

[adamhutchings]

Is this issue still open? Or did it get resolved?

[JakeRoggenbuck]

I can double check every function. Should they all be through the origin?

[adamhutchings]

No, not necessarily. The sigmoid as it is normally defined is 0.5 at x=0, for example.