The document discusses multimedia data basics, including:
1) Multimedia systems must deal with generation, manipulation, storage, presentation, and communication of data in various formats like text, graphics, images, audio, and video.
2) Some data like video and audio are continuous media that require synchronization, while static media like images and text are time-independent.
3) Analog signals from sensors must be converted to digital format for computer processing using analog-to-digital converters, and digital signals may be converted back to analog for output using digital-to-analog converters.
The document discusses multimedia data basics, including:
1) Multimedia systems must deal with generation, manipulation, storage, presentation, and communication of data in various formats like text, graphics, images, audio, and video.
2) Some data like video and audio are continuous media that require synchronization, while static media like images and text are time-independent.
3) Analog signals from sensors must be converted to digital format for computer processing using analog-to-digital converters, and digital signals may be converted back to analog for output using digital-to-analog converters.
The document discusses multimedia data basics, including:
1) Multimedia systems must deal with generation, manipulation, storage, presentation, and communication of data in various formats like text, graphics, images, audio, and video.
2) Some data like video and audio are continuous media that require synchronization, while static media like images and text are time-independent.
3) Analog signals from sensors must be converted to digital format for computer processing using analog-to-digital converters, and digital signals may be converted back to analog for output using digital-to-analog converters.
The document discusses multimedia data basics, including:
1) Multimedia systems must deal with generation, manipulation, storage, presentation, and communication of data in various formats like text, graphics, images, audio, and video.
2) Some data like video and audio are continuous media that require synchronization, while static media like images and text are time-independent.
3) Analog signals from sensors must be converted to digital format for computer processing using analog-to-digital converters, and digital signals may be converted back to analog for output using digital-to-analog converters.
Copyright:
Attribution Non-Commercial (BY-NC)
Available Formats
Download as PDF, TXT or read online from Scribd
Download as pdf or txt
You are on page 1/ 21
Multimedia Data Basics
45 Multimedia systems/applications have to deal with the • Generation of data, • Manipulation of data, • Storage of data, • Presentation of data, and • Communication of information/data JJ II Lets consider some broad implications of the above J I Back Close Discrete v Continuous Media
RECALL: Our Definition of Multimedia
46
• All data must be in the form of digital information.
• The data may be in a variety of formats: – text, – graphics, – images, – audio, JJ – video. II J I Back Close Synchronisation
A majority of this data is large and the different media may
need synchronisation: 47
• The data will usually have temporal relationships as an
integral property.
JJ II J I Click here or image above to run movie Back Close Static and Continuous Media
Static or Discrete Media — Some media is time independent: 48
Normal data, text, single images, graphics are examples. Continuous media — Time dependent Media: Video, animation and audio are examples.
JJ II J I Back Close Analog and Digital Signals
• Some basic definitions – Studied HERE 49
• Overviewing of technology — Studied HERE
• More in depth study later.
JJ II J I Back Close Analog and Digital Signal Conversion
The world we sense is full of analog signals:
50 • Electrical sensors convert the medium they sense into electrical signals – E.g. transducers, thermocouples, microphones. – (usually) continuous signals • Analog: continuous signals must be converted or digitised for computer processing. • Digital: discrete digital signals that computer can readily deal JJ with. II J I Back Close Analog-to-Digital Converter (ADC) • Special hardware devices : Analog-to-Digital converters 51
Take analog signals from analog sensor (e.g. microphone) JJ
and digitally sample data II (More details later) J I Back Close Digital-to-Analog Converter (DAC) • Playback – a converse operation to Analog-to-Digital 52
• Takes digital signal, possible after modification by computer
(e.g. volume change, equalisation) JJ II • Outputs an analog signal that may be played by analog output J device (e.g. loudspeaker, CRT display) I Back Close Analog-to-Digital-to-Analog Pipeline (1) • Begins at the conversion from the analog input and ends at the conversion from the output of the processing system to 53 the analog output as shown:
JJ (Strictly Analog-to-Digital-to-Analog is within the dotted box) II J I Back Close Analog-to-Digital-to-Analog Pipeline (2) • Anti-aliasing filters (major part of Analog Conditioning) are needed at the input to remove frequencies above the sampling limit that would result in aliasing. More later The anti-aliasing filter at the output removes the aliases that 54 result from the sampling theorem. • After the anti-aliasing filter, the analog/digital converter (ADC) quantizes the continuous input into discrete levels. • After digital processing, the output of the system is given to a digital/analog converter (DAC) which converts the discrete levels into continuous voltages or currents. • This output must also be filtered with a low pass filter to JJ remove the aliases from the sampling. II Subsequent processing can include further filtering, mixing, J or other operations. I However, these shall not be discussed further in this course. Back Close Multimedia Data: Input and format How to capture and store each Media format?
55 Note that text and graphics (and some images) are mainly generated directly by computer/device (e.g. drawing/painting programs) and do not require digitising:
They are generated directly in some (usually binary) format.
• Printed text and some handwritten text can be scanned via Optical Character Recognition JJ • Handwritten text could also be digitised by electronic pen sensing II • Printed imagery/graphics can be flatbed scanned directly to image J formats. I Back Close Text and Static Data • Source: keyboard, speech input, optical character recognition, data stored on disk. 56
• Stored and input character by character:
JJ – Storage: 1 byte per character (text or format II character), e.g. ASCII. J – For other forms of data (e.g. Spreadsheet files). May I store as text (with formatting) or may use binary encoding. Back Close Text and Static Data (cont.) • Formatted Text: Raw text or formatted text e.g HTML, Rich Text Format (RTF), Word or a program language source (C, Java, etc. 57
• Data Not temporal — BUT may have natural implied sequence
e.g. HTML format sequence, Sequence of C program statements. • Size Not significant w.r.t. other Multimedia data formats. • Compression: convenient to bundle files for archiving and transmission of larger files. E.g. Zip. JJ II J I Back Close Graphics • Format: constructed by the composition of primitive objects such as lines, polygons, circles, curves and arcs. 58 • Input: Graphics are usually generated by a graphics editor program (e.g. Illustrator, Freehand) or automatically by a program (e.g. Postscript).
JJ II J I Back Close Graphics (cont.) • Graphics input devices: keyboard (for text and cursor control), mouse, trackball or graphics tablet. • Graphics are usually selectable and editable or revisable (unlike images). 59
JJ • Graphics standards : OpenGL. II J • Graphics files usually store the primitive assembly I • Do not take up a very high storage overhead. Back Close Images • Still pictures which (uncompressed) are represented as a bitmap (a grid of pixels). 60
JJ II J I Back Close Images (cont.) • Input: scanned for photographs or pictures using a digital scanner or from a digital camera. • Input: May also be generated by programs similar to graphics 61 or animation programs. • Analog sources will require digitising. • Stored at 1 bit per pixel (Black and White), 8 Bits per pixel (Grey Scale, Colour Map) or 24 Bits per pixel (True Colour) • Size: a 512x512 Grey scale image takes up 1/4 Mb, a 512x512 24 bit image takes 3/4 Mb with no compression. JJ • This overhead soon increases with image size — modern II high digital camera 10+ Megapixels ≈ 29Mb uncompressed! J • Compression is commonly applied. I Back Close Images (cont.) • Can usually only edit individual or groups of pixels in an image editing application, e.g. photoshop.
62
JJ II J I Back Close Audio • Audio signals are continuous analog signals. • Input: microphones and then digitised and stored 63
• CD Quality Audio requires 16-bit sampling at 44.1 KHz:
Even higher audiophile rates (e.g. 24-bit, 96 KHz) JJ • 1 Minute of Mono CD quality (uncompressed) audio = 5 Mb. II Stereo CD quality (uncompressed) audio = 10 Mb. J I • Usually compressed (E.g. MP3, AAC, Flac, Ogg Vorbis) Back Close Video • Input: Analog Video is usually captured by a video camera and then digitised, although digital video cameras now 64 essentially perform both tasks. • There are a variety of video (analog and digital) formats (more later) • Raw video can be regarded as being a series of single images. There are typically 25, 30 or 50 frames per second.
JJ Click here or image above to run movie II J I Back Close Video (cont) Video Size:
• A 512x512 size monochrome video images take
65
25*0.25 = 6.25Mb
for a minute to store uncompressed.
• Typical PAL digital video (720 × 576 pixels per colour frame) ≈ 1.2 × 25 = 30Mb for a minute to store uncompressed. • High Definition DVD (1440×1080 = 1.5 Megapixels per frame) ≈ 4.5 × 25 = 112.5Mb for a minute to store uncompressed. JJ (There are higher possible frame rates!) II J • Digital video clearly needs to be compressed. I Back Close
