Using Dual Cascading Learning Frameworks for Image Indexing

Lim, J.-H. and Jin, J.S.

    To bridge the semantic gap in content-based image retrieval, detecting meaningful visual entities (e.g. faces, sky, foliage, buildings etc) in image content and classifying images into se- mantic categories based on trained pattern classifiers have be- come active research trends. In this paper, we present dual cascading learning frameworks that extract and combine intra- image and inter-class semantics for image indexing and retrieval. In the supervised learning version, support vector detectors are trained on semantic support regions without image segmentation. The reconciled and aggregated detection-based indexes then serve as input for support vector learning of image classfiers to generate class-relative image indexes. During retrieval, similarities based on both indexes are combined to rank images. In the unsupervised learning approach, image classifiers are first trained on local image blocks from a small number of labeled images. Then local semantic patterns are discovered from clustering the image blocks with high classification out- put. Training samples are induced from cluster memberships for support vector learning to form local semantic pattern detectors. During retrieval, similarities based on local class pat- tern indexes and discovered pattern indexes are combined to rank images. Query-by-example experiments on 2400 unconstrained consumer photos with 16 semantic queries show that the combined matching approaches are better than matching with single indexes. Both the supervised semantics design and the semantics discovery approaches also outperformed the linear fusion of color and texture features significantly in average precisions by 55% and 37% respectively.
Cite as: Lim, J.-H. and Jin, J.S. (2004). Using Dual Cascading Learning Frameworks for Image Indexing. In Proc. 2003 Pan-Sydney Area Workshop on Visual Information Processing (VIP2003), Sydney, Australia. CRPIT, 36. Piccardi, M., Hintz, T., He, S., Huang, M. L. and Feng, D. D., Eds. ACS. 53-60.
pdf (from crpit.com) pdf (local if available) BibTeX EndNote GS