Issue
Since PyTorch Lightning does most things under the hood, how can I know which weight initialization methods it use for training the model? And how can I modify the initialization method?
Solution
PyTorch Lightning doesn't interfere with weight initialization. It should be same as default PyTorch weights initialization. This is how Linear layers are initialized.
Answered By - Aniket Maurya
0 comments:
Post a Comment
Note: Only a member of this blog may post a comment.