PP: A dual-stage attention-based recurrent neural network for time series prediction
Problem: time series prediction
The nonlinear autoregressive exogenous model: The Nonlinear autoregressive exogenous (NARX) model, which predicts the current value of a time series based upon its previous values as well as the current and past values of multiple driving (exogenous) series.
However, few NARX models can capture the long-term temporal dependencies appropriately and select the relevant driving series to make a prediction.
2 issues:
1. capture the long-term temporal dependencies
2. select the relevant driving series to make a prediction
We propose a dual-stage attention-based RNN to address these 2 issues.
1. first stage: input attention mechanism to extract relevant driving series.
2. second stage: temporal attention mechanism.
attention-based encoder-decoder networks for time series prediction/ LSTM/ GRU
One problem with encoder-decoder networks is that their performance will deteriorate rapidly as the length of input sequence increases.
Contribution: the two-stage attention mechanism. input attention for driving series and temporal attention for all time stamps.
input attention can select the relevant driving series.
temporal attention capture temporal information.
Supplementary knowledge:
1. what is driving series?
最新文章
- hdu 4597 + uva 10891(一类区间dp)
- SQL SERVER2012中使用游标来备份数据库
- 在MyEclipse下创建Java Web项目 入门(图文并茂)经典教程
- share point 读取 List数据
- 利用getchar()消除多余字符数据(主要是“回车”)
- 此版本的 SQL Server 不支持用户实例登录标志。该连接将关闭“的解决
- 使MySQL 支持繁体字
- 基于C#—WPF的扫雷游戏
- jQuery 事件 - bind() 方法
- [Machine-Learning] 一个线性回归的简单例子
- MySQL数据类型转换函数CAST与CONVERT的用法
- PL/SQL Developer 导入导出操作
- mysql容灾备份脚本
- 学习笔记_J2EE_SpringMVC_01_入门
- [Swift]LeetCode103. 二叉树的锯齿形层次遍历 | Binary Tree Zigzag Level Order Traversal
- Python中关于列表排序并保留id/enumerate()使用方法
- sshd服务
- [luogu3258][JLOI2014]松鼠的新家
- UBUNTU18.4环境下使用更好用的搜索引擎(无奈,只能起这样的标题)
- 微信企业号OAuth2验证接口实例(使用SpringMVC)
热门文章
- STM32固件库和自定义工程模板
- iMacros 入门教程-基础函数介绍(3)
- opencv —— resize、pyrUp 和 pyrDown 图像金字塔(高斯金字塔、拉普拉斯金字塔)与尺寸缩放(向上采样、向下采样)
- 安装 mysqlclient 报 mysql_config not found
- 重写了下Ajax请求Webservice,顺便复习一下Javascript的闭包概念
- Bazinga HDU - 5510【技巧暴力+字符串】
- 吴裕雄--天生自然 PYTHON数据分析:所有美国股票和etf的历史日价格和成交量分析
- 打印机打印pdf文件特别慢怎么解决
- Visionpro学习笔记(壹)
- JN_0018:运行窗口不显示