Example:Romania ▣Oradea 71 Neamt 口Zerind 87 75 151 ▣lasi Arad 140 Sibiu 92 99 Fagaras 118 ▣ ▣Vaslui 80 女Timisoara Rimnicu Vilcea O 142 111 211 口Lugj 97 Pitesti 70 口 98 Mehadia 146 85 Urziceni ▣Hirsova 101 75 138 86 Bucharest Dobreta☐ 120 ▣ Craiova 90 Eforie Giurgiu Chapter 3 6
Example: Romania Giurgiu Urziceni Hirsova Eforie Neamt Oradea Zerind Arad Timisoara Lugoj Mehadia Dobreta Craiova Sibiu Fagaras Pitesti Vaslui Iasi Rimnicu Vilcea Bucharest 71 75 118 111 70 75 120 151 140 99 80 97 101 211 138 146 85 90 98 142 92 87 86 Chapter 3 6
Problem types Deterministic,fully observable-single-state problem Agent knows exactly which state it will be in;solution is a sequence Non-observable=conformant problem Agent may have no idea where it is;solution(if any)is a sequence Nondeterministic and/or partially observable=contingency problem percepts provide new information about current state solution is a contingent plan or a policy often interleave search,execution Unknown state space exploration problem ("online") Chapter 3 7
Problem types Deterministic, fully observable =⇒ single-state problem Agent knows exactly which state it will be in; solution is a sequence Non-observable =⇒ conformant problem Agent may have no idea where it is; solution (if any) is a sequence Nondeterministic and/or partially observable =⇒ contingency problem percepts provide new information about current state solution is a contingent plan or a policy often interleave search, execution Unknown state space =⇒ exploration problem (“online”) Chapter 3 7
Example:vacuum world Single-state,start in #5.Solution?? -Q 2 哪 哪 3 8 Q 娜 -Q Chapter 3 8
Example: vacuum world Single-state, start in #5. Solution?? 1 2 3 4 5 6 7 8 Chapter 3 8
Example:vacuum world Single-state,start in #5.Solution?? Right,Suck 1 -Q 2 绑 Conformant,start in (1,2,3,4,5,6,7,8 e.g.,Right goes to (2,4,6,8).Solution?? Q Q 粥 5 -Q 部 8 =Q Chapter 3 9
Example: vacuum world Single-state, start in #5. Solution?? [Right, Suck] Conformant, start in {1, 2, 3, 4, 5, 6, 7, 8} e.g., Right goes to {2, 4, 6, 8}. Solution?? 1 2 3 4 5 6 7 8 Chapter 3 9
Example:vacuum world Single-state,start in #5.Solution?? Right,Suck Q 哪 哪 Conformant,start in 1,2,3,4,5,6,7,8 e.g.,Right goes to (2,4,6,8).Solution?? 3 8 Right,Suck,Left,Suck 5 -Q ~Q Contingency,start in #5 娜 Murphy's Law:Suck can dirty a clean carpet -Q Local sensing:dirt,location only. Solution.?? Chapter 3 10
Example: vacuum world Single-state, start in #5. Solution?? [Right, Suck] Conformant, start in {1, 2, 3, 4, 5, 6, 7, 8} e.g., Right goes to {2, 4, 6, 8}. Solution?? [Right, Suck,Left, Suck] Contingency, start in #5 Murphy’s Law: Suck can dirty a clean carpet Local sensing: dirt, location only. Solution?? 1 2 3 4 5 6 7 8 Chapter 3 10