http://docs.scipy.org/doc/numpy/reference/generated/numpy.random.normal.html #np.random.normal,产生制定分布的数集#http://docs.scipy.org/doc/numpy/reference/generated/numpy.random.normal.html# mean and standard deviation# 均值的物理意义mu,Mean (“centre”) of the distr
#网址 http://docs.scipy.org/doc/numpy/reference/generated/numpy.matlib.randn.html#numpy.matlib.randn numpy.matlib.randn numpy.matlib.randn(*args)[source] Return a random matrix with data from the “standard normal” distribution. randn generates a matrix
一.nn.Embedding.weight初始化分布 nn.Embedding.weight随机初始化方式是标准正态分布 ,即均值$\mu=0$,方差$\sigma=1$的正态分布. 论据1——查看源代码 ## class Embedding具体实现(在此只展示部分代码) import torch from torch.nn.parameter import Parameter from .module import Module from .. import functional as F