Recognition: assume weight(W)bias (b are found earlier Output X Output=O Output=0 Output2=0 Output3=1 ow20 Tl=N Each pixel is W Input layer Output layer Hidden layers X(u Output=0 Correct recognition Neural Networks Ch9
Recognition: assume weight (W) bias (b) are found earlier • Neural Networks Ch9. , ver. 9b 11 Output Output0=0 Output1=0 Output2=0 Output3=1 : Outputn=0 Each pixel is X(u,v) Correct recognition
A neural network l=3 l=L X W W l=2 W l=L nput layer Output layer Hidden layers Neural Networks Ch9, ver. 9b
A neural network • Neural Networks Ch9. , ver. 9b 12 1 X l= 2 X l= 3 X l= Wl=1 Wl=2 Wl=L l=L X Input layer Output layer Hidden layers
Exercise 1 Neural Networks Ch9, ver. 9b How many inputs, and output neurons? Ans: How many hidden layers that this network have? Ans: What is this layer of How many weights in total? neurons x called? Ans: Ans: X=1 Inputs l=N=4 neurons W
Exercise 1 • How many inputs, and output neurons? • Ans: • How many hidden layers that this network have? • Ans: • How many weights in total? • Ans: Neural Networks Ch9. , ver. 9b 13 1 X l= 2 X l= 3 X l= Wl=N=4 Inputs neurons Wl=1 What is this layer of neurons X called? Ans:
ANSWER: Exercise 1 Neural I Networks Ch9. ver. 9b How many inputs and output neurons? Ans: 4 input and 2 output neurons How many hidden layers that this network have? Ans: 3 How many weights in total? What is this layer of Ans: First hidden layer has 44, second layer has 3x 4 neurons x called? third hidden layer has 3x3 fourth hidden layer to Ans: output layer has 2X3 weights. total=16+12+9+6=43 X=1 Inputs l=N=4 neurons W
ANSWER: Exercise 1 • How many inputs and output neurons? • Ans: 4 input and 2 output neurons • How many hidden layers that this network have? • Ans: 3 • How many weights in total? • Ans: First hidden layer has 4x4, second layer has 3x4, third hidden layer has 3x3, fourth hidden layer to output layer has 2x3 weights. total=16+12+9+6=43 Neural Networks Ch9. , ver. 9b 14 1 X l= 2 X l= 3 X l= Wl=N=4 Inputs neurons Wl=1 What is this layer of neurons X called? Ans: 4 X l=
Multi-layer structure of a bp neural network Input Output lar ayer a layer has multiple neurons hidden Each neuron has weights tyer and Other one b= bias hidden ayers a transfer function fo Y=outputs,X=set of inputs,W=set of weights, b=set of biases such that for each neuron in layer l has Inputs x∈X,∈W, output y∈Y, Neural Networks ch9., ver. 9b
Multi-layer structure of a BP neural network • Neural Networks Ch9. , ver. 9b 15 Input layer inputs X , W ,output Y , such that for each neuron in layer has Y outputs, X set of inputs, W set of weights, b set of biases l l l x w y l = = = = l l layer : hidden a transfer function () one b , , , ,... and Each neuron has weights A layer has multiple neurons 1 2 3 f bias w w w = layer Output Other hidden layers