Sigmoid or tanh function.

[moi-taiga]

Trial using Sigmoid and tanh functions.

"the sigmoid and tanh activation functions consistently outperform other commonly used functions including ReLU"

Xi, N.M. and Li, J.J., 2023. Exploring the optimization of autoencoder design for imputing single-cell RNA sequencing data. Computational and Structural Biotechnology Journal, 21, pp.4079-4095.