Outline l:What does CNN Learn? ll:How does CNN go deep? lll:Variants of CNN
Outline III: Variants of CNN II: How does CNN go deep? I: What does CNN Learn?
The whole cat dog … Convolution Max Pooling Can repeat Fully Connected many times Feedforward network Convolution Max Pooling Flatten
The whole CNN Fully Connected Feedforward network cat dog …… Convolution Max Pooling Convolution Max Pooling Flatten Can repeat many times
The whole Property 1 >Some patterns are much Convolution smaller than the whole image Property 2 The same patterns appear in Max Pooling Can repeat different regions. many times Property 3 Convolution > Subsampling the pixels will not change the object Max Pooling Flatten
The whole CNN Convolution Max Pooling Convolution Max Pooling Flatten Can repeat many times Ø Some patterns are much smaller than the whole image ØThe same patterns appear in different regions. ØSubsampling the pixels will not change the object Property 1 Property 2 Property 3
Three Steps for Deep Learning Steo 1 Step 3. define a Step 2: pick the Convolutional goodness best Neural Network of function function Deep Learning is so simple ..... 1 2 3 CDC.TENCENT.COM
Step 1: define a set of function Step 2: goodness of function Step 3: pick the best function Three Steps for Deep Learning Deep Learning is so simple …… Convolutional Neural Network
Why CNN for ImageB..ECCv2014 。00。。0 000.00 :: ： Represented as pixels The most basic Use 1st layer as module Use 2nd layer as classifiers to build classifiers module… Can the network be simplified by considering the properties of images?
Why CNN for Image? Can the network be simplified by considering the properties of images? 1 x 2 x … … Nx … … … … … … …… …… …… The most basic classifiers Use 1st layer as module to build classifiers Use 2nd layer as module …… [Zeiler, M. D., ECCV 2014] Represented as pixels