Why cnn for Image? Subsampling the pixels will not change the object bird bird subsampling We can subsample the pixels to make image smaller Less parameters for the network to process the image Sourceoftheslidehttp://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/cnn.pdf
6 Why CNN for Image? ▪ Subsampling the pixels will not change the object subsampling bird bird We can subsample the pixels to make image smaller Less parameters for the network to process the image Source of the slide: http://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/CNN.pdf
The whole cnn cat do Convolution Max Pooling Can repeat Fully Connected many times Feedforward network Convolution OOOOOOOU Max Pooling Flatten Sourceoftheslidehttp://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/cnn.pdf
7 The whole CNN Fully Connected Feedforward network cat dog …… Convolution Max Pooling Convolution Max Pooling Flatten Can repeat many times Source of the slide: http://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/CNN.pdf
The whole cnn Property 1 Some patterns are much smaller Convolution than the whole image Property 2 The same patterns appear in Max Pooling different regions Can repeat many times Property 3 Convolution Subsampling the pixels will not change the object Max Pooling Flatten 8 Sourceoftheslidehttp://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/cnn.pdf
8 The whole CNN Convolution Max Pooling Convolution Max Pooling Flatten Can repeat many times ➢ Some patterns are much smaller than the whole image ➢ The same patterns appear in different regions. ➢ Subsampling the pixels will not change the object Property 1 Property 2 Property 3 Source of the slide: http://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/CNN.pdf
The whole cnn cat d Convolution Max Pooling Can repea Fully Connected many times Feedforward network Convolution Max Pooling Flatten 9 Sourceoftheslidehttp://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/cnn.pdf
9 The whole CNN Fully Connected Feedforward network cat dog …… Convolution Max Pooling Convolution Max Pooling Flatten Can repeat many times Source of the slide: http://219.216.82.193/cache/8/03/speech.ee.ntu.edu.tw/43149163c97eb6be7590e3d8de445a67/CNN.pdf
Outline Convolutional neural Network Convolution Max Pooling CNN Forward Propagation CNN Backward Propagation CNN Architectures ■ LeNet-5、 AlexNet VGGNet GooqLeNet ■ ResNet 10
10 Outline ▪ Convolutional Neural Network ▪ Convolution ▪ Max Pooling ▪ CNN Forward Propagation ▪ CNN Backward Propagation ▪ CNN Architectures ▪ LeNet-5 、 AlexNet ▪ VGGNet ▪ GoogLeNet ▪ ResNet