Subhaditya's KB

Home

❯

KB

❯

AI

❯

Machine Learning

❯

Models

❯

Skip Connection

Skip Connection

Sep 18, 20241 min read

  • temp
  • architecture

Skip Connection

  • xi​=F(xi−1​)+xi−1​
  • Effect Of Depth
  • Previous layer gradient carried to next module untouched → loss surface is smoother
  • Transferarchitecture to prevent Vanishingexploding gradients
  • Learns the difference (residual) F(x)=H(x)−x

Graph View

Backlinks

  • Chapter 11 - Residual Networks
  • Dense Skip Connections
  • Res Net
  • Unet
  • _Index_of_Models

Created with Quartz v4.3.1 © 2025

  • GitHub