Text-to-Speech 感謝張凱為同學提供實驗結果 Vocoder- (TTS)Synthesis Encoder Post-processing CBHG CBHG RNN RNN RNN Attention RNN RNN RNN Attention is applied to all decoder output Taiwanese Speech Pre-net Pre-net Pre-net Pre-net Synthesis Input embeddings hel l o! <BOS: Source of data:台灣媠聲2.0 Decoder 歡迎來到台大語音處理實驗室 最近肺炎真嚴重·要記得戴口罩、 勤洗手，有病就要看醫生 6
Text-to-Speech (TTS) Synthesis 感謝張凱為同學提供實驗結果 歡迎來到台大語音處理實驗室 Source of data: 台灣媠聲2.0 最近肺炎真嚴重，要記得戴口罩、 勤洗手，有病就要看醫生 Taiwanese Speech Synthesis 6
Seq2seq for Chatbot "Hello!How are you today?" input seq2seq response “HiW [PERSON 1:Hi PERSON 2:Hello How are you today PERSON T:T am good thank you how are you. [PERSON 2:Great,thanks My children and I were just about to watch Game of Thrones. Training [PERSON 1:Nice How old are your children? [PERSON 2:I have four that range in age from 10 to 21.You? data: PERSON 1:I do not have children at the moment. [PERSON 2:That just means you get to keep all the popcorn for yourself. [PERSON 1:And Cheetos at the moment! [PERSON 2:Good choice.Do you watch Game of Thrones? [PERSON 1:No,I do not have much time for TV. [PERSON 2:I usually spend my time painting:but,I love the show
Seq2seq for Chatbot input seq2seq Training data: response “Hi” “Hello! How are you today?” 7
Most Natural Language Processing applications... Question Context Answer What is a major importance ...Southern California is a major major economic of Southern California in relation economic center for the state center to California and the US? of California and the US.... What is the translation Most of the planet is Der GroSteil der from English to German? ocean water. Erde ist Meerwasser Question What is the Harry Potter star Daniel Harry Potter star Answering summary? Radcliffe gains access to a Daniel Radcliffe gets reported 320 million fortune... E320M fortune. (QA) Hypothesis:Product and geography Premise:Conceptually cream are what make cream skimming skimming has two basic Entailment work.Entailment,neutral, dimensions-product and geography. or contradiction? A stirring,funny and finally Is this sentence transporting re-imagining of positive positive or negative? Beauty and the Beast and (sentiment analysis) 1930s horror film. decaNLP QA can be done by seq2seq question,context Seq2seq answer https://arxiv.org/abs/1806.08730 https://arxiv.org/abs/1909.03329
Most Natural Language Processing applications … QA can be done by seq2seq question, context Seq2seq answer https://arxiv.org/abs/1806.08730 https://arxiv.org/abs/1909.03329 Question Answering (QA) (sentiment analysis) 8
Deep Learning for Human Language Processing 深度學習與人類語言處理 One slide for this course Model Model Model Model Model class Model class Source webpage:https://speech.ee.ntu.edu.tw/~hylee/dlhlp/2020-spring.html 9
Deep Learning for Human Language Processing 深度學習與人類語言處理 Source webpage: https://speech.ee.ntu.edu.tw/~hylee/dlhlp/2020-spring.html 9
Seq2seq for Syntactic Parsing Is it a sequence? S Model VP Output NP ADJV Model deep learning is very powerful Input 10
deep learning is very powerful VP S NP ADJV Seq2seq for Syntactic Parsing Model Input Model Output Is it a sequence? 10