Marco La Cascia, Saratendu Sethi and Stan Sclaroff,
Combining Textual and Visual Cues for Content-based Image
Retrieval on the World Wide Web,
In IEEE Workshop on Content-based Access of Image and Video
Libraries (CBAIVL'98),
Santa Barbara, CA, USA, June 21 1998.A system is proposed that combines textual and visual statistics in a single index vector for content-based search of a WWW image database. Textual statistics are captured in vector form using latent semantic indexing (LSI) based on text in the containing HTML document. Visual statistics are captured in vector form using color and orientation histograms. By using an integrated approach, it becomes possible to take advantage of possible statistical couplings between the content of the document (latent semantic content) and the contents of images (visual statistics). The combined approach allows improved performance in conducting content-based search. Search performance experiments are reported for a database containing 100,000 images collected from the WWW.