What does CNN learn? The output of the k-th filter is a X 11 x 11 matrix. input Degree of the activation 1111 of the k-th filter: ak=∑，，略 253x3 Convolution i=1j=1 filters x*argmax ak (gradient ascent) 11 Max Pooling 3 1 00.000 1 503x3 aij Convolution filters -3 1 -3 11 50X11×11 : : Max Pooling 3 -2 -1
Convolution Max Pooling Convolution Max Pooling input 25 3x3 filters 50 3x3 filters What does CNN learn? 50 x 11 x 11 The output of the k-th filter is a 11 x 11 matrix. Degree of the activation of the k-th filter: � � = �=1 11 �=1 11 ��� � 3 -1 -1 -3 1 -3 3 -2 -1 …… …… … … … … …… … … ��� � 11 11 x � ∗ = 𝑎�max � � � (gradient ascent)
What does CNN learn? The output of the k-th filter is a 11 x 11 matrix. input Degree of the activation 1111 of the k-th filter: k-∑，略 253x3 Convolution i=1j=1 filters x*=argmax a (gradient ascent) Max Pooling 503x3 Convolution filters 50X11×11 Max Pooling For each filter
Convolution Max Pooling Convolution Max Pooling input 25 3x3 filters 50 3x3 filters What does CNN learn? 50 x 11 x 11 The output of the k-th filter is a 11 x 11 matrix. Degree of the activation of the k-th filter: � � = �=1 11 �=1 11 ��� � � ∗ = 𝑎�max � � � (gradient ascent) For each filter
What does CNN learn? input x*argmaxyl Can we see Convolution X digits? Max Pooling 0 Convolution Max Pooling 3 flatten pCototooooe eep Neural Networks are Easilg Foole https://www.youtube.com/watch?v=M2lebCN9Ht4 y:49
Convolution Max Pooling input Convolution Max Pooling flatten �� What does CNN learn? � ∗ = 𝑎�max � � � Can we see digits? 0 1 2 3 4 5 6 7 8 Deep Neural Networks are Easily Fooled https://www.youtube.com/watch?v=M2IebCN9Ht4
What does CNN learn pixel values x*argmax yl 0 2 1 2 3 5 3 4 5 6 8 6 8
What does CNN learn? 0 1 2 3 4 5 6 7 8 0 1 2 3 4 5 6 7 8 � ∗ = 𝑎�max � � � � ∗ = 𝑎�max � � � − �,� ��� Over all pixel values
CNN Deep Modify image Given a photo,machine adds what it se S.… 23 CNN exaggerates what it sees http://deepdreamgenerator.com/
Deep Dream • Given a photo, machine adds what it see s …… http://deepdreamgenerator.com/ CNN 3.9 −1.5 2.3 ⋮ Modify image CNN exaggerates what it sees