LanguageModelHave youeverused LanguageModel?eI'll meetyouatthecafeofficeairport23456890tWeryuq-Op&?开daSh0XZ2mX6123
• Have you ever used Language Model？ Language Model
Language ModelHave you ever used Language Model??I'll meetyou attheairportcafe在大雁塔附近O2在大雁塔附近怎么去兵马通qW在大雁塔附近怎么玩@在大雁塔附近可以买西安特产吗a在大雁塔附近坐几路车到兵马佣反馈123
• Have you ever used Language Model？ Language Model
Language ModelHave you ever used Language Model??I'll meet you at theairnortcafe在大雁塔附近2在大雁塔附近怎么去兵马通qW在大雁塔附近怎么玩@在大雁塔附近可以买西安特产吗a在大雁塔附近坐几路车到兵马诵反馈123Useeveryday!
• Have you ever used Language Model？ Language Model Use everyday！
n-gramModelsthe girl opened herHow to train a Language Model?T1[P(x()|x(t-1), . ()Ideally,t=1交通大学
• How to train a Language Model? • Ideally, n-gram Models the girl opened her _ �=1 � � � (�) � (�−1) , ., � (1)
n-gram Modelsthe girl opened herHow totrain a Language Model?T P(x()| (-1),. ()Ideally,Hugecomputational cost!!!t=1n-gram Language Model: a n-gram is a text having n words unigrams : bigrams :交通大学trigrams :4-grams:Idea: collect frequency of each -gram and use the frequencies to predictthe next word
• How to train a Language Model? • Ideally, Huge computational cost!!! • �-gram Language Model: a �-gram is a text having � words • unigrams： • bigrams： • trigrams： • 4-grams： • . • Idea: collect frequency of each �-gram and use the frequencies to predict the next word n-gram Models �=1 � � � (�) � (�−1) , ., � (1) the girl opened her _