... No.2, pp.146-166, June 1997. [2] MJ Swain and D. H. Ballard, Color indexing, Int. J. 1.00 ,... more ... No.2, pp.146-166, June 1997. [2] MJ Swain and D. H. Ballard, Color indexing, Int. J. 1.00 , 0 I: D, < z I 4 Comput. ... 0.25 , 24&5 D, <32fi MAKNOUCHI, A Motion-Location Based Indexing cm 0'50 ' 16&-' D m < 24fi (4) [7] Zaher AGHBARI, Kunihiko KANEKO, and Akifumi ...
A real-time content filtering system for live broadcasts in TV terminals enables a TV viewer to o... more A real-time content filtering system for live broadcasts in TV terminals enables a TV viewer to obtain desired video events from multiple channel broadcasts. In order to achieve stable and reliable event filtering for multiple video inputs, real-time filtering requirements such as frame sampling rate per channel, number of input channels, and buffer condition should be considered to meet the limited capacity of the terminal. In this paper, we propose a method of selecting those requirements by modeling a filtering system using a D/M/1 queue. By minimizing the queueing time of input video frames, the proposed model can maximize filtering capacity for multiple video inputs in real-time. To verify the proposed model and analysis, we perform experiments on soccer videos with the proposed model. The experimental results show that the proposed model allows for more efficient choice of requirements within limited resources. Index Terms-D/M/1 queue, real-time processing, video event filtering. Since 1997, he has been with the Information and Communications University (ICU), Korea, where he is currently a Professor of the Multimedia Communication Group and the director of IVY (Image/Video System) Lab. He participated in international standardizations including MPEG-7, MPEG-21, MPEG-A, and SVC, where he contributed several MPEG-7, MPEG-21, MPEG-A, and SVC standardization works. His current research interests include multimedia adaptation/modality conversion, multimedia information retrieval, medical image processing and watermarking. Prof. Yong Man Ro is a senior member of IEEE as well as member of ISMRM and SPIE. He received the Young Investigator Finalist Award of ISMRM in 1992.
For various mobile applications, measuring the grade of the video quality is needed in order to g... more For various mobile applications, measuring the grade of the video quality is needed in order to guarantee the optimal quality of video streaming service. As H.264/AVC scalable video coding (SVC) has been emerged and developed to support full scalability including spatial, temporal, and signal-to-noise ratio (SNR) scalability, each of which shows different visual effect, it is necessary to measure video quality with full scalability. In this paper, we develop a novel video quality metric allowing full scalability through the subjective quality assessment. Experimental results show that the proposed quality metric has high correlation with subjective quality and is useful to determine the video quality of SVC.
IEEE Transactions on Circuits and Systems for Video Technology, 2007
A semantic categorization method for generic home photo is proposed. The main contribution of thi... more A semantic categorization method for generic home photo is proposed. The main contribution of this paper is to exploit a two-layered classification model incorporating camera metadata with low-level features for multilabel detection. The two-layered support vector machine (SVM) classifiers operate to detect local and global photo semantics in a feed-forward way. The first layer aims to predict likelihood of predefined local photo semantics based on camera metadata and regional low-level visual features. In the second layer, one or more global photo semantics is detected based on the likelihood. To construct classifiers producing a posterior probability, we use a parametric model to fit the output of SVM classifiers to posterior probability. A concept merging process based on a set of semantic-confidence maps is also presented to cope with selecting more likelihood photo semantics on spatially overlapping local regions. Experiment was performed with 3086 photos that come from MPEG-7 visual core experiment two official databases. Results showed that the proposed method would much better capture multiple semantic meanings of home photos, compared to other similar technologies.
IEEE Transactions on Systems, Man, and Cybernetics, 2009
In many current face-recognition (FR) applications, such as video surveillance security and conte... more In many current face-recognition (FR) applications, such as video surveillance security and content annotation in a web environment, low-resolution faces are commonly encountered and negatively impact on reliable recognition performance. In particular, the recognition accuracy of current intensity-based FR systems can significantly drop off if the resolution of facial images is smaller than a certain level (e.g., less than 20 × 20 pixels). To cope with low-resolution faces, we demonstrate that facial color cue can significantly improve recognition performance compared with intensity-based features. The contribution of this paper is twofold. First, a new metric called "variation ratio gain" (VRG) is proposed to prove theoretically the significance of color effect on low-resolution faces within well-known subspace FR frameworks; VRG quantitatively characterizes how color features affect the recognition performance with respect to changes in face resolution. Second, we conduct extensive performance evaluation studies to show the effectiveness of color on low-resolution faces. In particular, more than 3000 color facial images of 341 subjects, which are collected from three standard face databases, are used to perform the comparative studies of color effect on face resolutions to be possibly confronted in real-world FR systems. The effectiveness of color on low-resolution faces has successfully been tested on three representative subspace FR methods, including the eigenfaces, the fisherfaces, and the Bayesian. Experimental results show that color features decrease the recognition error rate by at least an order of magnitude over intensity-driven features when low-resolution faces (25 × 25 pixels or less) are applied to three FR methods.
Currently, digital broadcasting tends to personalize the TV watching environment by offering serv... more Currently, digital broadcasting tends to personalize the TV watching environment by offering services that can adapt to viewer preferences. In this paper, an intelligent broadcasting system for enhanced personalized-services, based on the semantics of broadcasting contents, is proposed. To implement the system, the MPEG-7 and TV-Anytime Forum (TVAF), as well as agent technology, are employed. For content-level services, real-time content filtering, personalized video skimming, and content-based retrieval using audio characteristic are implemented. To verify the usefulness of the proposed system, we demonstrate it with a test-bed on which content-level personalized services are implemented 1 .
In this paper, we propose methods to adapt colors on the visual content for people with color vis... more In this paper, we propose methods to adapt colors on the visual content for people with color vision deficiency. The proposed adaptation consists of two parts: adaptations for dichromat and anomalous trichromat. The adaptation for dichromats aims to give them better color information, while the adaptation for anomalous trichromats aims to give them original color. To verify the proposed methods, we used both quantitative and qualitative measurements. Experimental results showed that the proposed adaptation enhanced color information readability of the people with color vision deficiency.
Adapting multimedia content to users&... more Adapting multimedia content to users' preferences and perceptual characteristics is a key direction for enabling personalized multimedia services. In this paper, we address the problem of tailoring visual content within the MPEG-21 Digital Item Adaptation (DIA) framework to meet users' visual perception characteristics. In particular, we present methods for adapting visual content to accommodate color vision deficiency and low-vision capabilities.
Face annotation for personal photos has a number of potential applications in Multimedia Informat... more Face annotation for personal photos has a number of potential applications in Multimedia Information Retrieval (MIR). We propose a novel face annotation method that systematically combines contextual information of photos with traditional Face Recognition (FR) technologies. To overcome the limitations of conventional FR-based annotation approaches, situation and person clustering methods are proposed based on context of personal photos. By relying on the proposed clustering methods, multiple facial images that belong to the same person are applied to subspace FR methods. This allows traditional FR methods to take advantages of feature-or measurement-level fusion strategies for automatic annotation of faces on personal photos. The effectiveness of the proposed method was successfully tested on 1,120 personal photos selected from standard MPEG-7 Visual Core Experiment 3 (VCE-3). Extensive experimental results showed that the proposed method improves annotation accuracy by at least an order of magnitude, compared with conventional FR-based approaches.
In this paper, we propose a visual accessibility technique in an MPEG-21 framework. In particular... more In this paper, we propose a visual accessibility technique in an MPEG-21 framework. In particular, MPEG-21 visual accessibility for the colored-visual resource of a digital item is proposed to give better accessibility of color information to people with color vision deficiency (CVD). We propose an adaptation system for CVD as well as a description of CVD in MPEG-21. To verify the usefulness of the proposed method, computer simulations with CVD and color adaptation were performed. Furthermore, a statistical experiment was performed using volunteers with CVD in order to verify the effectiveness of the proposed visual accessibility technique in MPEG-21. Both the experimental and simulation results show that the proposed adaptations technique can provide better color information, particularly to people with CVD.
As color is more widely used to carry visual information in the multimedia content, ability to pe... more As color is more widely used to carry visual information in the multimedia content, ability to perceive color plays a crucial role in getting visual information. Regardless of color vision variations, one should have visual information equally. This paper proposes the adaptation technique for color vision variations in the MPEG-21 Digital Item Adaptation (DIA). DIA is performed respectively for severe color vision deficiency (dichromats) and for mild color vision deficiency (anomalous trichromats), according to the description of user characteristics about color vision variations. Adapted images are tested by simulation program for color vision variations so as to recognize the appearance of the adapted images in the color deficient vision. Experimental result shows that proposed adaptation technique works well in the MPEG-21 framework.
In this paper, we present distortion modeling for inter-operation dependent video transcoding. To... more In this paper, we present distortion modeling for inter-operation dependent video transcoding. To allocate bits more efficiently, the multidimensional factors including spatial. SNR, and temporal and their trade-offs are exploited in terms of the quality of content. The objective of the joint control for the multidimensional video transcoding is to determine the optimal combination of transcoding operations. Based on the statistical analysis of inter-operation dependent distortion, we propose an improved distortion model. In experiments, the effectiveness of our model is shown.
In this paper, we propose an encryption method to protect the region of interest (ROI) which is s... more In this paper, we propose an encryption method to protect the region of interest (ROI) which is standard element in the scalable video coding (SVC). The proposed video encryption method provides secured SVC contents with the selective encryption scheme. In order to confine the encryption into the ROI, three encoding schemes are also proposed, which include the constrained motion estimation,
Scalable video coding (SVC) is the most promising video format for applications of collaborative ... more Scalable video coding (SVC) is the most promising video format for applications of collaborative communication. MPEG-21 standard has newly emerged to enable the interoperability of multimedia delivery in heterogeneous environments. In this paper we study adaptation of SVC bitstream in the context of MPEG-21 multimedia framework. For interfacing SVC bitstream with MPEG-21 based adaptation system, we propose three SVC specific adaptation operators. Based on our previous work with multidimensional video adaptation, we present an effective approach, using MPEG-21 DIA AdaptationQoS description tool, to model QoS control for SVC adaptation. Then we show how the operator values could be computed from that representation. For the actual adaptation at bitstream level, we propose a procedure to remove the unnecessary NAL units from an SVC bitstream. The result of this study enables QoS management of SVC streaming in an efficient and standardized manner.
Content adaptation is an effective solution to support the quality of service for multimedia serv... more Content adaptation is an effective solution to support the quality of service for multimedia services over heterogeneous networks. This paper deals with the accuracy and the real-time processing, two important issues in making decision on content adaptation. We present the content adaptation as a constrained optimization problem, considering both modality conversion and content scaling. To this problem, we propose an optimal algorithm and a fast approximation based on the Viterbi algorithm of dynamic programming. Through experiments, we show that the proposed algorithms can enable accurate adaptation decisions and can support the real-time requirement.
In this paper, we propose an encryption algorithm to protect scalable video coding (SVC) bitstrea... more In this paper, we propose an encryption algorithm to protect scalable video coding (SVC) bitstream and a method for conditional access control to consume the encrypted SVC bitstream. To design an encryption algorithm, we analyzed the encryption requirements to support scalability function in the scalable video and proposed an effective encryption method developed in the network abstraction layer (NAL). In addition, conditional access control scheme and key management scheme are proposed to consume the SVC bitstream protected with proposed method. Experiments were performed to verify the proposed method and results showed that proposed algorithms could provide an effective access control of scalable video as well as support a video encryption with scalability function.
ABSTRACT Modality conversion is an important part in the content adaptation process of a Universa... more ABSTRACT Modality conversion is an important part in the content adaptation process of a Universal Multimedia Access system. The decision on modality conversion is dependent on terminal/network conditions and on the user preference. We propose a systematic and comprehensive approach to make decision on modality conversion in a UMA system. Our approach includes three integral components, (1) an overlapped content value model, (2) a flexible specification of user preference on modality conversion, and (3) a resource allocation method to distribute resource to multiple contents.
Tae Meon Bae et al. 239 ABSTRACT⎯In this letter, we propose a new functionality to scalable video... more Tae Meon Bae et al. 239 ABSTRACT⎯In this letter, we propose a new functionality to scalable video coding (SVC), that is, the support of multiple region of interests (ROIs) for heterogeneous display resolution. The main objective of SVC is to provide temporal, spatial, and quality scalability of an encoded bitstream. The ROI is an area that is semantically important to a particular user, especially users with heterogeneous display resolutions. Less transmission bandwidth is needed compared to when the entire region is transmitted/decoded and then sub-sampled or cropped. To support multiple ROIs in SVC, we adopt flexible macroblock ordering (FMO), a tool defined in H.264, and based on it, we propose a way to encode and, independently, decode ROIs. The proposed method is implemented on the joint scalable video model (JSVM) and its functionality verified. Keywords⎯ROI, scalable video coding, MPEG.
... No.2, pp.146-166, June 1997. [2] MJ Swain and D. H. Ballard, Color indexing, Int. J. 1.00 ,... more ... No.2, pp.146-166, June 1997. [2] MJ Swain and D. H. Ballard, Color indexing, Int. J. 1.00 , 0 I: D, < z I 4 Comput. ... 0.25 , 24&5 D, <32fi MAKNOUCHI, A Motion-Location Based Indexing cm 0'50 ' 16&-' D m < 24fi (4) [7] Zaher AGHBARI, Kunihiko KANEKO, and Akifumi ...
A real-time content filtering system for live broadcasts in TV terminals enables a TV viewer to o... more A real-time content filtering system for live broadcasts in TV terminals enables a TV viewer to obtain desired video events from multiple channel broadcasts. In order to achieve stable and reliable event filtering for multiple video inputs, real-time filtering requirements such as frame sampling rate per channel, number of input channels, and buffer condition should be considered to meet the limited capacity of the terminal. In this paper, we propose a method of selecting those requirements by modeling a filtering system using a D/M/1 queue. By minimizing the queueing time of input video frames, the proposed model can maximize filtering capacity for multiple video inputs in real-time. To verify the proposed model and analysis, we perform experiments on soccer videos with the proposed model. The experimental results show that the proposed model allows for more efficient choice of requirements within limited resources. Index Terms-D/M/1 queue, real-time processing, video event filtering. Since 1997, he has been with the Information and Communications University (ICU), Korea, where he is currently a Professor of the Multimedia Communication Group and the director of IVY (Image/Video System) Lab. He participated in international standardizations including MPEG-7, MPEG-21, MPEG-A, and SVC, where he contributed several MPEG-7, MPEG-21, MPEG-A, and SVC standardization works. His current research interests include multimedia adaptation/modality conversion, multimedia information retrieval, medical image processing and watermarking. Prof. Yong Man Ro is a senior member of IEEE as well as member of ISMRM and SPIE. He received the Young Investigator Finalist Award of ISMRM in 1992.
For various mobile applications, measuring the grade of the video quality is needed in order to g... more For various mobile applications, measuring the grade of the video quality is needed in order to guarantee the optimal quality of video streaming service. As H.264/AVC scalable video coding (SVC) has been emerged and developed to support full scalability including spatial, temporal, and signal-to-noise ratio (SNR) scalability, each of which shows different visual effect, it is necessary to measure video quality with full scalability. In this paper, we develop a novel video quality metric allowing full scalability through the subjective quality assessment. Experimental results show that the proposed quality metric has high correlation with subjective quality and is useful to determine the video quality of SVC.
IEEE Transactions on Circuits and Systems for Video Technology, 2007
A semantic categorization method for generic home photo is proposed. The main contribution of thi... more A semantic categorization method for generic home photo is proposed. The main contribution of this paper is to exploit a two-layered classification model incorporating camera metadata with low-level features for multilabel detection. The two-layered support vector machine (SVM) classifiers operate to detect local and global photo semantics in a feed-forward way. The first layer aims to predict likelihood of predefined local photo semantics based on camera metadata and regional low-level visual features. In the second layer, one or more global photo semantics is detected based on the likelihood. To construct classifiers producing a posterior probability, we use a parametric model to fit the output of SVM classifiers to posterior probability. A concept merging process based on a set of semantic-confidence maps is also presented to cope with selecting more likelihood photo semantics on spatially overlapping local regions. Experiment was performed with 3086 photos that come from MPEG-7 visual core experiment two official databases. Results showed that the proposed method would much better capture multiple semantic meanings of home photos, compared to other similar technologies.
IEEE Transactions on Systems, Man, and Cybernetics, 2009
In many current face-recognition (FR) applications, such as video surveillance security and conte... more In many current face-recognition (FR) applications, such as video surveillance security and content annotation in a web environment, low-resolution faces are commonly encountered and negatively impact on reliable recognition performance. In particular, the recognition accuracy of current intensity-based FR systems can significantly drop off if the resolution of facial images is smaller than a certain level (e.g., less than 20 × 20 pixels). To cope with low-resolution faces, we demonstrate that facial color cue can significantly improve recognition performance compared with intensity-based features. The contribution of this paper is twofold. First, a new metric called "variation ratio gain" (VRG) is proposed to prove theoretically the significance of color effect on low-resolution faces within well-known subspace FR frameworks; VRG quantitatively characterizes how color features affect the recognition performance with respect to changes in face resolution. Second, we conduct extensive performance evaluation studies to show the effectiveness of color on low-resolution faces. In particular, more than 3000 color facial images of 341 subjects, which are collected from three standard face databases, are used to perform the comparative studies of color effect on face resolutions to be possibly confronted in real-world FR systems. The effectiveness of color on low-resolution faces has successfully been tested on three representative subspace FR methods, including the eigenfaces, the fisherfaces, and the Bayesian. Experimental results show that color features decrease the recognition error rate by at least an order of magnitude over intensity-driven features when low-resolution faces (25 × 25 pixels or less) are applied to three FR methods.
Currently, digital broadcasting tends to personalize the TV watching environment by offering serv... more Currently, digital broadcasting tends to personalize the TV watching environment by offering services that can adapt to viewer preferences. In this paper, an intelligent broadcasting system for enhanced personalized-services, based on the semantics of broadcasting contents, is proposed. To implement the system, the MPEG-7 and TV-Anytime Forum (TVAF), as well as agent technology, are employed. For content-level services, real-time content filtering, personalized video skimming, and content-based retrieval using audio characteristic are implemented. To verify the usefulness of the proposed system, we demonstrate it with a test-bed on which content-level personalized services are implemented 1 .
In this paper, we propose methods to adapt colors on the visual content for people with color vis... more In this paper, we propose methods to adapt colors on the visual content for people with color vision deficiency. The proposed adaptation consists of two parts: adaptations for dichromat and anomalous trichromat. The adaptation for dichromats aims to give them better color information, while the adaptation for anomalous trichromats aims to give them original color. To verify the proposed methods, we used both quantitative and qualitative measurements. Experimental results showed that the proposed adaptation enhanced color information readability of the people with color vision deficiency.
Adapting multimedia content to users&... more Adapting multimedia content to users' preferences and perceptual characteristics is a key direction for enabling personalized multimedia services. In this paper, we address the problem of tailoring visual content within the MPEG-21 Digital Item Adaptation (DIA) framework to meet users' visual perception characteristics. In particular, we present methods for adapting visual content to accommodate color vision deficiency and low-vision capabilities.
Face annotation for personal photos has a number of potential applications in Multimedia Informat... more Face annotation for personal photos has a number of potential applications in Multimedia Information Retrieval (MIR). We propose a novel face annotation method that systematically combines contextual information of photos with traditional Face Recognition (FR) technologies. To overcome the limitations of conventional FR-based annotation approaches, situation and person clustering methods are proposed based on context of personal photos. By relying on the proposed clustering methods, multiple facial images that belong to the same person are applied to subspace FR methods. This allows traditional FR methods to take advantages of feature-or measurement-level fusion strategies for automatic annotation of faces on personal photos. The effectiveness of the proposed method was successfully tested on 1,120 personal photos selected from standard MPEG-7 Visual Core Experiment 3 (VCE-3). Extensive experimental results showed that the proposed method improves annotation accuracy by at least an order of magnitude, compared with conventional FR-based approaches.
In this paper, we propose a visual accessibility technique in an MPEG-21 framework. In particular... more In this paper, we propose a visual accessibility technique in an MPEG-21 framework. In particular, MPEG-21 visual accessibility for the colored-visual resource of a digital item is proposed to give better accessibility of color information to people with color vision deficiency (CVD). We propose an adaptation system for CVD as well as a description of CVD in MPEG-21. To verify the usefulness of the proposed method, computer simulations with CVD and color adaptation were performed. Furthermore, a statistical experiment was performed using volunteers with CVD in order to verify the effectiveness of the proposed visual accessibility technique in MPEG-21. Both the experimental and simulation results show that the proposed adaptations technique can provide better color information, particularly to people with CVD.
As color is more widely used to carry visual information in the multimedia content, ability to pe... more As color is more widely used to carry visual information in the multimedia content, ability to perceive color plays a crucial role in getting visual information. Regardless of color vision variations, one should have visual information equally. This paper proposes the adaptation technique for color vision variations in the MPEG-21 Digital Item Adaptation (DIA). DIA is performed respectively for severe color vision deficiency (dichromats) and for mild color vision deficiency (anomalous trichromats), according to the description of user characteristics about color vision variations. Adapted images are tested by simulation program for color vision variations so as to recognize the appearance of the adapted images in the color deficient vision. Experimental result shows that proposed adaptation technique works well in the MPEG-21 framework.
In this paper, we present distortion modeling for inter-operation dependent video transcoding. To... more In this paper, we present distortion modeling for inter-operation dependent video transcoding. To allocate bits more efficiently, the multidimensional factors including spatial. SNR, and temporal and their trade-offs are exploited in terms of the quality of content. The objective of the joint control for the multidimensional video transcoding is to determine the optimal combination of transcoding operations. Based on the statistical analysis of inter-operation dependent distortion, we propose an improved distortion model. In experiments, the effectiveness of our model is shown.
In this paper, we propose an encryption method to protect the region of interest (ROI) which is s... more In this paper, we propose an encryption method to protect the region of interest (ROI) which is standard element in the scalable video coding (SVC). The proposed video encryption method provides secured SVC contents with the selective encryption scheme. In order to confine the encryption into the ROI, three encoding schemes are also proposed, which include the constrained motion estimation,
Scalable video coding (SVC) is the most promising video format for applications of collaborative ... more Scalable video coding (SVC) is the most promising video format for applications of collaborative communication. MPEG-21 standard has newly emerged to enable the interoperability of multimedia delivery in heterogeneous environments. In this paper we study adaptation of SVC bitstream in the context of MPEG-21 multimedia framework. For interfacing SVC bitstream with MPEG-21 based adaptation system, we propose three SVC specific adaptation operators. Based on our previous work with multidimensional video adaptation, we present an effective approach, using MPEG-21 DIA AdaptationQoS description tool, to model QoS control for SVC adaptation. Then we show how the operator values could be computed from that representation. For the actual adaptation at bitstream level, we propose a procedure to remove the unnecessary NAL units from an SVC bitstream. The result of this study enables QoS management of SVC streaming in an efficient and standardized manner.
Content adaptation is an effective solution to support the quality of service for multimedia serv... more Content adaptation is an effective solution to support the quality of service for multimedia services over heterogeneous networks. This paper deals with the accuracy and the real-time processing, two important issues in making decision on content adaptation. We present the content adaptation as a constrained optimization problem, considering both modality conversion and content scaling. To this problem, we propose an optimal algorithm and a fast approximation based on the Viterbi algorithm of dynamic programming. Through experiments, we show that the proposed algorithms can enable accurate adaptation decisions and can support the real-time requirement.
In this paper, we propose an encryption algorithm to protect scalable video coding (SVC) bitstrea... more In this paper, we propose an encryption algorithm to protect scalable video coding (SVC) bitstream and a method for conditional access control to consume the encrypted SVC bitstream. To design an encryption algorithm, we analyzed the encryption requirements to support scalability function in the scalable video and proposed an effective encryption method developed in the network abstraction layer (NAL). In addition, conditional access control scheme and key management scheme are proposed to consume the SVC bitstream protected with proposed method. Experiments were performed to verify the proposed method and results showed that proposed algorithms could provide an effective access control of scalable video as well as support a video encryption with scalability function.
ABSTRACT Modality conversion is an important part in the content adaptation process of a Universa... more ABSTRACT Modality conversion is an important part in the content adaptation process of a Universal Multimedia Access system. The decision on modality conversion is dependent on terminal/network conditions and on the user preference. We propose a systematic and comprehensive approach to make decision on modality conversion in a UMA system. Our approach includes three integral components, (1) an overlapped content value model, (2) a flexible specification of user preference on modality conversion, and (3) a resource allocation method to distribute resource to multiple contents.
Tae Meon Bae et al. 239 ABSTRACT⎯In this letter, we propose a new functionality to scalable video... more Tae Meon Bae et al. 239 ABSTRACT⎯In this letter, we propose a new functionality to scalable video coding (SVC), that is, the support of multiple region of interests (ROIs) for heterogeneous display resolution. The main objective of SVC is to provide temporal, spatial, and quality scalability of an encoded bitstream. The ROI is an area that is semantically important to a particular user, especially users with heterogeneous display resolutions. Less transmission bandwidth is needed compared to when the entire region is transmitted/decoded and then sub-sampled or cropped. To support multiple ROIs in SVC, we adopt flexible macroblock ordering (FMO), a tool defined in H.264, and based on it, we propose a way to encode and, independently, decode ROIs. The proposed method is implemented on the joint scalable video model (JSVM) and its functionality verified. Keywords⎯ROI, scalable video coding, MPEG.
Uploads
Papers by Yong Man Ro