Shape-Based Image Retrieval Using Spatio-Temporal Relation Computations

Huan-Chao Keh; Timothy K. Shih

doi:10.6180/jase.2001.4.1.02

Shape-Based Image Retrieval Using Spatio-Temporal Relation Computations

Computer Science and Information Engineering

Huan-Chao Keh¹ and Timothy K. Shih This email address is being protected from spambots. You need JavaScript enabled to view it.¹

¹Multimedia Information NEtwork (MINE) Lab Department of Computer Science and Information Engineering Tamkang University Tamsui, Taiwan, R.O.C.

Received: February 8, 2001
Accepted: February 21, 2001
Publication Date: March 1, 2001

Download Citation: ||https://doi.org/10.6180/jase.2001.4.1.02

ABSTRACT

Content-based retrieval of multimedia information is one of the most difficult research topics in multimedia computing and information retrieval. In this paper, we present a visual system which allows content-based retrieval of still image. The recognition algorithms we used are based on spatio-temporal relations. Two approaches and algorithms were developed based on the similarity between polygons. The system is incorporated with a visual interface which allows the user to specify polygons as the shape specification of pictures. The preliminary experience shows that, within an image database containing about 300 bitmapped images, the system is able to retrieve correct information of a high satisfaction.

Keywords: Temporal Interval Relations, Content-Based Retrieval, Multimedia, Spatio-Temporal Model, Polygon Matching, Information Retrieval

REFERENCES

[1] Allen, James F., “Maintaining Knowledge about Temporal Intervals,” Communications of the ACM, Vol. 26, No. 11 (1983).
[2] Chung, Chi-Ming, Shih, Timothy K., Huang, Jiung-Yao, Wang, Ying-Hong, and Kuo, Shape-Based Image Retrieval Using Spatio-Temporal Relation Computations 17 Tsu-Feng, “An Object-Oriented Approach and System for Intelligent Multimedia Presentation Designs,” in proceeding of the International Conference on Multimedia Computing and Systems (ICMCS'95), Washington DC, U.S.A., pp. 278 – 281, May 15 - 18 (1995).
[3] Day, Young Francis, et. al., “Spatio-Temporal Modeling of Viedo Data for On-Line Object-Oriented Query Processing,” in proceedings of the International Conference on Multimedia Computing and Systems, Washington DC, U.S.A., pp. 98 – 105, May 15 - 18 (1995).
[4] Flickner, Myron, et. al., “Query by Image and Video Content: The QBIC System,” IEEE Computer, pp. 23 – 32, September (1995).
[5] Gudivada, Venkat N., and Raghavan, Vijay V., “Content-Based Image Retrieval Systems,” IEEE Computer, pp. 18 – 22, September (1995).
[6] Keramane, Cherif and Duda, Andrzej, “Interval Expressions - a Functional Model for Interactive Dynamic Multimedia Presentations,” in proceedings of the 1996 International Conference on Multimedia Computing and Systems, Hiroshima, Japan, pp. 283 –286, June 17 - 23 (1996).
[7] Li, John Z., TamerOzsu, M., and Szafron, Duane, “Spatial Reasoning Rules in Multimedia Management Systems,” in proceedings of the 1996 Multimedia Modeling international conference (MMM'96), Toulouse, France, pp. 119 – 133, November 12 - 15 (1996).
[8] Little, Thomas D. C. and Ghafoor, Arif, “Spatio-Temporal Composition of Distributed Multimedia Objects for Value-Added Networks,” IEEE Computer, pp. 42 – 50, October (1991).
[9] Little, Thomas D. C. and Ghafoor, Arif, “Interval-Based Conceptual Models for TimeDependent Multimedia Data,” IEEE transactions on knowledge and data engineering, Vol. 5, No. 4, pp. 551 – 563 (1993).
[10]Manjunath, B. S., and Ma, W. Y., “Texture Features for Browsing and Retrieval of Image Data,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 837 – 842, August (1996).
[11]Nabil, Mohammad, Ngu, Anne H. H., and Shepherd, John, “Picture Similarity Retrieval Using 2D Projection Interval Representation,” IEEE Transactions on Knowledge and Data Engineering, Vol. 8, No. 4, pp. 533 – 539, August (1996).
[12]Sakauchi, Masao, Satou, Takashi, and Yaginuma, Yoshitomo, “Multimedia Database Systems for the Contents Mediator,” IEICE Trans. Inf. and Syst., Vol. E79-D, No. 6, pp 641 – 646, June (1996).
[13]Samet, Hanan and Soffer, Aya, “MARCO: MAp Retrieval by COntent,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 783 –798, August (1996).
[14]Shih, Timothy K., Lo, Steven K. C., Fu, Szu-Jan, and Chang, Julian B., “Using Interval Temporal Logic and Inference Rules for the Automatic Generation of Multimedia Presentations,” in Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Hiroshima, Japan, pp. 425 – 428, June 17 - 23 (1996).
[15]Shih, Timothy K., Kuo, Chin-Hwa, Keh, Huan-Chao, Chao, T. Fang-Tsou, and An, Kuan-Shen, “An Object-Oriented Database for Intelligent Multimedia Presentations,” in proceedings of the 1996 IEEE International Conference on Systems, Man and Cybernetics, Beijing, China, October 14 - 17 (1996).
[16]Srihari, Rohini K., “Automatic Indexing and Content-Based Retrieval of Captioned Images,” IEEE Computer, pp. 49 – 56, September (1995).
[17]Theodoridis, Yannis , Vazirgiannis, Michael , and Sellis, Timos, “Spatial Temporal Indexing for Large Multimedia Applications,” in proceedings of the 1996 International Conference on Multimedia Computing and Systems, Hiroshima, Japan, pp. 441 – 448, June 17 - 23 (1996).
[18]Vazirgiannis, Michael, Theodoridis, Yannis, and Sellis, Timos, “Spatio - Temporal Composition in Multimedia Applications,” in proceedings of the International Workshop on Multimedia Software Development, Berlin, Germany, pp. 120 – 127, March 25 – 26 (1996).
[19]Wactlar, Howard D., Kanade, Takeo, Smith, Michael A., and Stevens, Scott M., “Intelligent Access to Digital Video: Informedia Project,” IEEE Computer, pp. 46 – 52, May (1996).
[20]Wahl, Thomas, et. al., “TIEMPO: Temporal Modeling and Authoring of Interactive Multimedia” in proceedings of the international conference on multimedia computing and systems, Washington DC, U.S.A., pp. 274 – 277, May15 – 18 (1995).