Learning The Sequential Temporal Information With Recurrent Neural Networks

Abstract

Recurrent Networks are one of the most powerful and promising artificial neural network algorithms to processing the sequential data such as natural languages, sound, time series data. Unlike traditional feed-forward network, Recurrent Network has a inherent feed back loop that allows to store the temporal context information and pass the state of information to the entire sequences of the events. This helps to achieve the state of art performance in many important tasks such as language modeling, stock market prediction, image captioning, speech recognition, machine translation and object tracking etc., However, training the fully connected RNN and managing the gradient flow are the complicated process. Many studies are carried out to address the mentioned limitation. This article is intent to provide the brief details about recurrent neurons, its variances and trips & tricks to train the fully recurrent neural network. This review work is carried out as a part of our IPO studio softw

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymurugan2018learning

Related papers

• Residual Memory Networks: Feed-forward Approach To Learn Long Temporal Dependencies (2018)7.16
• On A Novel Training Algorithm For Sequence-to-sequence Predictive Recurrent Networks (2021)0.00
• From Nodes To Networks: Evolving Recurrent Neural Networks (2018)0.00
• Memory Visualization For Gated Recurrent Neural Networks In Speech Recognition (2016)11.76
• An Empirical Evaluation Of Generic Convolutional And Recurrent Networks For Sequence Modeling (2018)7.31
• On Training Recurrent Networks With Truncated Backpropagation Through Time In Speech Recognition (2018)8.35
• Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gate (2023)8.35
• Incremental Training Of A Recurrent Neural Network Exploiting A Multi-scale Dynamic Memory (2020)3.58