Paper Info
Complex-valued neural networks with nonparametric activation functions
S Scardapane, S Van Vaerenbergh, A Hussain, A Uncini
IEEE Transactions on Emerging Topics in Computational Intelligence 4
(2), 140-150, 2018.
Reviews
From
yassendobrev, rated
5/5.
June 7, 2021. Edited on June 15, 2021.
It's an interesting paper discussing different activation functions for complex valued neural networks. It starts with a good overview of the literature and presents a new activation function. Then it compares the different activation functions in 3 experiments. ModRELU finishes second after the relatively complicated activation function proposed in this paper which is also an interesting result.
Complex-valued neural networks with nonparametric activation functions
S Scardapane, S Van Vaerenbergh, A Hussain, A Uncini
IEEE Transactions on Emerging Topics in Computational Intelligence 4 (2), 140-150, 2018.
Reviews
From
yassendobrev, rated
5/5.
June 7, 2021. Edited on June 15, 2021.
It's an interesting paper discussing different activation functions for complex valued neural networks. It starts with a good overview of the literature and presents a new activation function. Then it compares the different activation functions in 3 experiments. ModRELU finishes second after the relatively complicated activation function proposed in this paper which is also an interesting result.