Article:Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun
Identity Mappings in Deep Residual Networks
The authors analyse the propagation mechanics behind residual networks, demonstrating that forward and backward signals pass directly between blocks when identity mappings serve as skip connections and after-addition activations. This leads to an improved residual unit design that eases training and boosts generalization across deep architectures.
From Video: Weekly AI Updates: Local Models, GPT-6 Astra, and Agent Architectures