[30
DeVore R. Hanin B. & Petrova G. Neural network approximation. Acta Numerica 30 327–444 (2021). This work describes approximation properties of neural networks as they are presently understood and also discusses their performance with other methods of approximation where ReLU are centred in the analysis involving univariate and multivariate forms with both shallow and deep architectures.
[31
Xu J. Boom T. Schutter B. & Wang S. Irredundant lattice representations of continuous piecewise affine functions. Automatica 70 109–120 (2016). This paper formally describe the PWLNNs with irredundant lattice representations which possess universal representation ability for any continuous PWL functions and yet has not been fully explored to construct the potentially promising deep architectures.
[32
Hu Q. Zhang H. Gao F. Xing C. & An J. Analysis on the number of linear regions of piecewise linear neural networks. IEEE Transactions on Neural Networks Learn. Syst. 33 644–653 (2022).
[33
Zhang X. & Wu D. Empirical studies on the properties of linear regions in deep neural networks. In Proceeding of the International Conference on Learning Representations (2020).
[34
Maas A. Hannun A. Y. & Ng A. Y. Rectifier nonlinearities improve neural network acoustic models. Proc. ICML 30 3 (2013).
推荐阅读
- 《前沿》子刊神经科学报道！诱导多能干细胞治疗缺血性中风
- 该领域4本被剔除SCIE的期刊，你知道吗？
- 如果百万吨重的黄金小行星撞击地球，会引发全球金融危机吗？
- 努力在当下，别的都随缘。因为生命本身就是个偶然
- 巴甫洛夫大脑由什么构成？
- 处于地远山险的瑰丽物种，其实就在我们「身边」
- 南佛罗里达大学医学院：通过干细胞疗法可以隔离帕金森病的炎症
- 神秘巨人石像是外星人建造的？运输和打造过程成为谜团，非常艰难
- 韦伯太空望远镜为我们展示了一个前所未见的海王星