Visualizing the Loss Landscape of Neural Nets
- @liVisualizingLossLandscape2018
- Generalization error relates to convexity in the loss landscape
- [Random Directions](Random Directions.md)
- [Sharpness and Flatness](Sharpness and Flatness.md)
- [Training Trajectories](Training Trajectories.md)
Solutions
- [Layer Normalization](Layer Normalization.md)
- [Filter Wise Normalization](Filter Wise Normalization.md)
- [Trajectory Plotting with PCA](Trajectory Plotting with PCA.md)
