Fundamentals of Multimedia Ze-Nian Li and Mark S. Drew School of Computing Science Simon Fraser University PEARSON Prentice. Iall Pearson Education International
ContentsPrefacexivMultimedia Authoring and Data Representations1Introduction to Multimedia31.1What is Multimedia?31.1.1Componentsof Multimedia31.1.2Multimedia Research Topics and Projects41.2Multimedia and Hypermedia41.2.1History of Multimedia51.2.2Hypermedia and Multimedia71.3World Wide Web81.3.1Historyof theWwW81.3.2HyperText Transfer Protocol (HTTP)91.3.3HyperText MarkupLanguage (HTML)101.3.4Extensible Markup Language (XML)111.3.5Synchronized Multimedia Integration Language (SMIL)121.4Overview of Multimedia Software Tools141.4.1Music Sequencing and Notation 141.4.2Digital Audio151.4.3Graphics and Image Editing151.4.4Video Editing151.4.5Animation161.4.6Muitimedia Authoring 171.5Further Exploration171.6Exercises181.719References2Multimedia Authoring and Tools202.1Multimedia Authoring 202.1.1Multimedia AuthoringMetaphors212.1.2Multimedia Production 232.1.3Multimedia Presentation 252.1.4Automatic Authoring 332.2Some Useful Editing and Authoring Tools372.2.1AdobePremiere372.2.2Macromedia Director402.2.3Macromedia Flash462.2.4Dreamweaver 512.3VRML512.3.1Overview512.3.2Animation and Interactions542.3.3VRMLSpecifies 542.4Further Exploration 552.5Exercises562.6References 59
vi603Graphics and Image Data RepresentationsGraphics/lmage Data Types603.11-Bit Images 613.1.13.1.2 8-Bit Gray-Level Images613.1.3ImageData Types 64643.1.424-Bit Color Images8-Bit Color Images 653.1.5673.1.6Color Lookup Tables (LUTs)3.2Popular File Formats713.2.1GIF71JPEG753.2.23.2.3PNG76TIFF773.2.4773.2.5EXIF773.2.6Graphics Animation Files783.2.7PSandPDFWindows WMF783.2.83.2.9Windows BMP783.2.10 MacintoshPAINTandPICT78793.2.11X Windows PPM3.3Further Exploration 79793.4Exercises3.581References82Color in Image and Video44.1Color Science 824.1.182Light and Spectra4.1.2Human Vision844.1.384Spectral Sensitivity of the Eye4.1.4Image Formation854.1.5Camera Systems86Gamma Correction 874.1.6894.1.7Color-Matching Functions914.1.8CIE Chromaticity Diagram4.1.9Color Monitor Specifications94Out-of-Gamut Colors 954.1.10White-Point Correction 964.1.114.1.12XYZtoRGBTransform 974.1.13Transform withGamma Corection974.1.14 L*a*b*(CIELAB)Color Model 984.1.15 More Color-Coordinate Schemes 1004.1.16 MunsellColorNaming System 100Color'Models in Images 1004.24.2.1RGB Color Model for CRT Displays100Subtractive Color:CMY Color Model 1014.2.2TransformationfromRGBtoCMY1014.2.3UndercolorRemoval:CMYK System 1024.2.44.2.5Printer Gamuts 1024.3Color Models in Video1041044.3.1Video Color TransformsYUVColorModel 1044.3.2
vii4.3.3YIQColorModel 1054.3.4YCbCrColor Model1074.4Further Exploration 1074.5Exercises1084.6References1115Fundamental Concepts in Video1125.1Types of Video Signals1125.1.1Component Video1125.1.2Composite Video1135.1.3S-Video1135.2Analog Video 1135.2.1NTSCVideo1165.2.2PALVideo1195.2.3SECAMVideo1195.3Digital Video 1195.3.1Chroma Subsampling 1205.3.2CCIR Standards for Digital Video1205.3.3HighDefinitionTV (HDTV)1225.4FurtherExploration1245.5124Exercises5.6References1256Basies of Digital Audio1266.1Digitization of Sound1266.1.1What Is Sound? 1266.1.2Digitization1276.1.3Nyquist Theorem1286.1.4Signal-to-Noise Ratio (SNR)1316.1.5Signal-to-Quantization-Noise Ratio (SQNR)1316.1.6Linear and Nonlinear Quantization 1336.1.7Audio Filtering1366.1.8Audio Qualityversus Data Rate 1366.1.9Synthetic Sounds1376.2MIDI:Musical Instrument Digital Interface1396.2.1MIDIOverview1396.2.2HardwareAspects of MIDI1426.2.3Structure of MIDIMessages1436.2.4General MIDI1476.2.5MIDI-to-WAV Conversion1476.3Quantization and Transmission ofAudio1476.3.1Coding ofAudio1476.3.2Pulse Code Modulation 1486.3.3Differential Coding of Audio1506.3.4Lossless Predictive Coding1516.3.5DPCM 1546.3.6DM1576.3.7ADPCM1586.4Further Exploration1596.5Exercises1606.6163References
vili165Multimedia Data Compression167Lossless Compression Algorithms77.1Introduction1677.2Basics of Information Theory1687.3Run-Length Coding 1717.4171Variable-Length Coding (VLC)Shannon-Fano Algorithm 1717.4.17.4.2HuffmanCoding1737.4.3176Adaptive Huffman Coding7.5Dictionary-Based Coding 1817.6Arithmetic Coding1871917.7Lossless Image Compression7.7.1191Differential Coding of ImagesLossless JPEG1937.7.27.8Further Exploration 1947.9Exercises1957.10197References1998Lossy Compression Algorithms8.1Introduction 1998.2Distortion Measures 1998.3The Rate-Distortion Theory2008.4Quantization 2008.4.1 Uniform ScalarQuantization 2018.4.2Nonuniform Scalar Quantization 2048.4.3Vector Quantization*2068.5207Transform Coding8.5.1Discrete Cosine Transform (DCT)2078.5.2Karhunen-Loeve Transform*2208.6Wavelet-Based Coding2228.6.1Introduction 222Continuous Wavelet Transform*2278.6.28.6.3Discrete WaveletTransform*2308.7Wavelet Packets 2408.8EmbeddedZerotree of Wavelet Coefficients241The ZerotreeData Structure2428.8.18.8.2Successive Approximation Quantization 2448.8.3EZWExample2448.9SetPartitioning inHierarchical Trees (SPIHT)2478.10FurtherExploration2488.11Exercises2498.12References2522539Image Compression Standards9.1The JPEG Standard2539.1.1Main Steps inJPEGImageCompression12539.1.2JPEGModes2629.1.3AGlance at theJPEGBitstream 2659.2TheJPEG2000Standard 2659.2.1Main Steps of JPEG2000 Image Compression*267