Matching with Unstructured Data Matching product offers: 1000s of stores, millions of products Product offers are terse, unstructured text Many similar but different product offers Same product has different descriptions missing+ wrong values Panasonic Dmc-fx07 7.0 Mp Digital Camera Boxed Lumix 1054tr Panasonic Lumix- Point& Shoot-7 megapixel - Compact Sensor-36 x optical Zo Panasonic DMC-FX07 7.0 MP Digital Camera Boxed Serial #FC6GA10541r Pro Description: Panasonic Lumix DMC-FX07 -Digital camera-compact-70 Panasonic Lumix Dmc-fx07 72mp Digital Camera Gold+ 1 Year Warranty⑦ Panasonic Lumix -SLR-7.2 megapixel AcElectronicwww.ac-electronic.comCategoriesMobilePhoneDigitalCamera Camcorder Digital SLR Camera Camera Lens Bluetooth Product Camera R Add to Shortlist anasonic Lumix DMC-FXo70 MP digital camera⑧丶 e 7. 2-megapixel Lur x DMC-FX07 has a 28mm wide angle 3.6x optical zoom f/ a compact body, achieved thanks to the 4* 12 reviews R Add to Shortlist
Matching with Unstructured Data Matching product offers: 1000s of stores, millions of products – Product offers are terse, unstructured text – Many similar but different product offers – Same product has different descriptions, missing + wrong values 11
Matching with Unstructured Data Matching product offers: 1000s of stores, millions of products Product offers are terse, unstructured text Many similar but different product offers Same product has different descriptions missing+ wrong values Challenging scenarios for record linkage Matching structured specifications with unstructured offers Matching unstructured offers with each other
Matching with Unstructured Data Matching product offers: 1000s of stores, millions of products – Product offers are terse, unstructured text – Many similar but different product offers – Same product has different descriptions, missing + wrong values Challenging scenarios for record linkage – Matching structured specifications with unstructured offers – Matching unstructured offers with each other 12
Structured Unstructured Data [KGa+ll] Motivation matching offers to specifications with high precision Product specifications are structured: set of (name value pairs Product offers are terse, unstructured text Attribute Name Attribute Value Panasonic Dmc-fx07 7.0 Mp Digital Camera Boxed Lumix 10541rD Panasonic Lumiox-Point& Shoot-7 megapoed-Compadt Sensor -36x optical zoom Panasonic DMC-FX07 7.0 MP Digital Camera Boxed Senal RFCeGA10541r Product category digital camera Descnpton: Panasonic Lumix DMC-- Digtal camera-compact-70 brand Panasonic Panasonic Lumix Dmc-fx07 7 2mp Digital Camera Gold+ 1 Year product line Panasonic lumix Warranty( model DMC-FXO7 AC Electronic www ac-electronic com Categones Moble Phone Digital Camera Camcorder Diatal SLR Camera Camera Lens Bluetooth Product Cam R Add to Shortlist resolution 7 megamI Panasonic Lumix DMC-FX07 7.0 MP Digital camera 0 Panasonic LumIoC-Point Shoot-7 megapoxei-Compact Sensor-CCD sIlver The 7. 2-megapoxel Lumix DMC-FXO7 has a 2Bmrm wide angle 3. 8x optical zoom 12.8 Leica DC lens housed in a compact body, achieved thanks to the ★★★★卡12vews A Add to Shorts
Structured + Unstructured Data [KGA+11] Motivation: matching offers to specifications with high precision – Product specifications are structured: set of (name, value) pairs – Product offers are terse, unstructured text 13 Attribute Name Attribute Value category digital camera brand Panasonic product line Panasonic Lumix model DMC-FX07 resolution 7 megapixel color silver
Structured t Unstructured data Motivation matching offers to specifications with high precision Product specifications are structured: set of (name value pairs Product offers are terse, unstructured text Attribute Name Attribute Value Panasonic Lumix DMc-FX07 digital camera category digital camera 7.2 megapixeL, 2.5", 3.6x, LCD monitor brand Panasonic product line Panasonic lumix Panasonic DMc-FX07EB digital model DMC-FXO7 camera silver resolution 7 megamI sIlver Lumix FⅩ07EB-S,7.2MP
Structured + Unstructured Data Motivation: matching offers to specifications with high precision – Product specifications are structured: set of (name, value) pairs – Product offers are terse, unstructured text 14 Panasonic Lumix DMC-FX07 digital camera 7.2 megapixel, 2.5”, 3.6x , LCD monitor Panasonic DMC-FX07EB digital camera silver Lumix FX07EB-S, 7.2MP Attribute Name Attribute Value category digital camera brand Panasonic product line Panasonic Lumix model DMC-FX07 resolution 7 megapixel color silver
Structured t Unstructured data Key idea: optimal parse of (unstructured offer wrt specification Semantic parse of offers tagging Use inverted index built on specification values Tag all n-grams product line 大 ran model Panasonic Lumix DMC-FX07 digital camera 7.2 megapixel, 2.5",3.6X, LCD monitor resolution zoom diagonal, display type height, width
Structured + Unstructured Data Key idea: optimal parse of (unstructured) offer wrt specification Semantic parse of offers: tagging – Use inverted index built on specification values – Tag all n-grams 15 Panasonic Lumix DMC-FX07 digital camera 7.2 megapixel, 2.5”, 3.6x, LCD monitor brand product line model resolution diagonal, height, width zoom display type