Subhaditya's KB

Home

❯

KB

❯

AI

❯

Machine Learning

❯

Training

❯

Normalization

❯

Xavier Initialization

Xavier Initialization

Sep 18, 20241 min read

  • regularization

Xavier Initialization

  • a=(din​+dout​)6​​
  • Random values drawn uniformly from [−a,a]
  • For Batch Normalization Layers, γ=1 and β=0
  • For Tanh based activating neural nets

Graph View

Backlinks

  • Chapter 10 - CNNs
  • DeepNet
  • _Index_of_Normalization
  • Initialization
  • regularize

Created with Quartz v4.3.1 © 2025

  • GitHub