LSTM的结构中每个时刻的隐层包含了多个memory blocks(一般我们采用一个block),每个block包含了包含一个Cell(有多个memory cell组成)和三个gate,一个基础的结构示例如下图: 

一个memory cell只能产出一个标量值,一个block能产出一个向量。

The nomenclature is a bit confusing, but goes back to the original LSTM paper: an LSTM "cell" is strictly speaking mostly the CEC, i.e., the "inner" unit that stores a value through time. A "block" is CEC + gates. In theory, you could have more than one cell in a block. In that case, all cells within the block would use the same gates. So they would store/output information together. This way you could e.g. store two "bits" of information with the same gates. However this idea never really caught on -- all modern LSTMs have one cell per block, and the distinction between cell & blocks eroded over time (which luckily simplifies notation, which was often a bit cumbersome in old Hochreiter, Gers and Graves papers that used the idea of blocks).

so, cell应该是指LSTM内部的四个神经网络层(全连接层)中的神经元,而block显然是包含了这些神经网络层和门的看起来是方块的整体。

最新文章

  1. Ubuntu下配置python完成爬虫任务(笔记一)
  2. java前后台之间传值的几种方式
  3. CGContext 的一些工具方法
  4. System.OutOfMemoryException: 内存不足。(转)
  5. java二维数组简单初步理解
  6. ACM一道关于素数查找的题
  7. 2016-05-I
  8. DSOframer 无法正常加载的解决方案
  9. sqlmap的详细使用
  10. Linux 下搭建jsp服务器(配置jsp开发环境)
  11. postman参数为Json数据结构
  12. std::shared_ptr 和普通指针的转换
  13. 查看tomcat运行状态
  14. Java Web(二) Servlet详解
  15. JSdom操作内容,样式,属性
  16. ES2015 import & export
  17. 【PHP】Ajax跨域解决方案 、jsonp、cors
  18. 类型化dataset分页
  19. 安装OpenOffice
  20. 使用路径arc-奥运五环

热门文章

  1. IO(Properties、序列化流、打印流、CommonsIO)
  2. 【迷你微信】基于MINA、Hibernate、Spring、Protobuf的即时聊天系统:4.技术简介之Spring
  3. ubuntu下安装ffmpeg扩展
  4. Linux 系统挂载阿里云数据盘
  5. 本号讯 | 微软和百度携手推进全球自动驾驶技术; 微软发布新一代可垂直可水平滚动的Arc鼠标
  6. C# 使用解析json 嵌套方法
  7. 51nod 1276 岛屿的数量
  8. 【转】实用API大全
  9. npm WARN saveError ENOENT: no such file or directory, open 'C:\Users\James\package.json'
  10. CornerStone使用跳坑总结