6533b872fe1ef96bd12d2f89

RESEARCH PRODUCT

A Conceptual Probabilistic Model for the Induction of Image Semantics

Giovanni PilatoGiorgio VassalloFilippo VellaMarco La Cascia

subject

Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniImage ClassificationComputer sciencebusiness.industryFeature extractionimage semantics conceptual spaceConceptual model (computer science)Statistical modelcomputer.software_genreConceptual schemaVisualizationSet (abstract data type)Data setAutomatic image annotationLatent Semantic AnalysisArtificial intelligencebusinesscomputerNatural language processing

description

In this paper we propose a model based on a conceptual space automatically induced from data. The model is inspired to a well-founded robotics cognitive architecture which is organized in three computational areas: sub-conceptual, linguistic and conceptual. Images are objects in the sub-conceptual area, that become "knoxels" into the conceptual area. The application of the framework grants the automatic emerging of image semantics into the linguistic area. The core of the model is a conceptual space induced automatically from a set of annotated images that exploits and mixes different information concerning the set of images. Multiple low level features are extracted to represent images and a set of single visual terms and spatially displaced couples of visual terms is computed. When a new image is mapped as a knoxel in the conceptual space, the most probable conceptual linguistic label automatically arise from the space. The technique has been tested on 2000 images of the Corel data set and results are reported. © 2010 IEEE.

yearjournalcountryeditionlanguage
2010-09-01
10.1109/icsc.2010.54http://hdl.handle.net/10447/53357