Inconsistent initialization of memory bank in the code

[Pixie8888]

Hi,
Thanks for the great work. I have question regarding the initializaton of memory bank. In the paper, it is said to initialize them as unit vector. However, in the code, you use: torch.rand(outputSize, inputSize).mul_(2*stdv).add_(-stdv). How can this relate to unit vector?