RNN和LSTM资料推荐

最近想着研究一下RNN和LSTM,希望各位推荐几个好的入门资料,另外最好能给几篇近一两年使用RNN和LSTM取得突破性进展的文章(图像处理领域)。
已邀请:

辛淼 - CaffeCN社区创始人

赞同来自: 王斌_ICT smallrock 不可理喻 disheng ruirui_ICT pakchoi moyan更多 »

本内容作者仅授权给CaffeCN社区(caffecn.cn)使用,如需转载请附上内容来源说明。

古代的一些论文(BPTT、LSTM、BLSTM...):
  • Graves A. Long Short-Term Memory[J]. Neural Computation, 1997, 9(8):1735-1780.
  • Graves A, Schmidhuber J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures[J]. Neural Networks, 2005, 18(s 5–6):602-610.
  • Werbos P J. Backpropagation through time: what it does and how to do it[J]. Proceedings of the IEEE, 1990, 78(10):1550-1560.

近代的一些论文(ForgetGate、Poophole...)
  • Gers F A, Schmidhuber J, Cummins F. Learning to Forget: Continual Prediction with LSTM[J]. Neural Computation, 2000, 12(10):2451-2471.
  • Gers F A, Schmidhuber J. Recurrent Nets that Time and Count[C]// Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 3 - Volume 3. IEEE Computer Society, 2000:3189.

现代的一些论文(Hessian-free、GRU、CLSTM)
  • Martens J, Sutskever I. Learning Recurrent Neural Networks with Hessian-Free Optimization[J]. Opusc.zool.budapest –, 2011:1033-1040.
  • Chung J, Gulcehre C, Cho K H, et al. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling[J]. Eprint Arxiv, 2014.
  • Xingjian S H I, Chen Z, Wang H, et al. Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting[C]//Advances in Neural Information Processing Systems. 2015: 802-810.

 20160123 更新中...

YJango - 在日研究生,人工智能专业

赞同来自: shuokay 王斌_ICT GongGP moyan

LSTM强烈推荐的文章Understanding LSTMs
其次是四篇连续的postIntroduction to RNNs

要回复问题请先登录注册