Using the forest to See the trees Context-based object Recognition Bill freeman Joint work with Antonio Torralba and Kevin Murphy Computer Science and artificial Intelligence Laboratory MIT A computer vision goal Recognize many different objects under many viewing conditions in unconstrained settings There has been progress on restricted cases one object and one pose(frontal view faces Isolated objects on uniform backgrounds But the general problem is difficult and unsolve
Using the Forest to See the Trees: Context-based Object Recognition Bill Freeman Computer Science and Artificial Intelligence Laboratory MIT A computer vision goal • many viewing conditions in unconstrained settings. • restricted cases: • But the general problem is difficult and unsolved. Joint work with Antonio Torralba and Kevin Murphy Recognize many different objects under There has been progress on – one object and one pose (frontal view faces) – Isolated objects on uniform backgrounds
How we hope to make progress on this hard problem Various technical improvements Exploit scene context if this is a forest these must be trees Local(bottom-up approach to object detection Classify image patches/features at each location and scale Classifier p car I VL)
• • How we hope to make progress on this hard problem Classify image patches/features at each location and scale features No car Classifier p( car | VL ) VL Local (bottom-up) approach to object detection Various technical improvements Exploit scene context: – “if this is a forest, these must be trees”. Local
Problem 1 Local features can be ambiguous Solution 1 Context can disambiguate local features
Problem 1: Local features can be ambiguous Solution 1: Context can disambiguate local features
Effect of context on object detection car Identical local image features! Images by Antonio Torralba Even high-resolution images can be locally ambiguous
Effect of context on object detection car pedestrian Identical local image features! Even high-resolution images can be locally ambiguous Images by Antonio Torralba
Object in context (Courtesy of Fredo durand and William Freeman. Used with permission
Object in context (Courtesy of Fredo Durand and William Freeman. Used with permission.)