In this contribution we propose a novel semantic-based architecture to manage multimedia data. We propose an innovatory approach, introducing an abstraction level to study the relationships among the low level attributes, as color, motion, in a systematic way, before the visual image content estimation. Aim of this analysis is to unify the descriptors information and to gather them into structures that we call over-regions, which represent particular configurations of the objects to be recognized. This step will allow for the higher abstraction level effective object-based or event-based image recognition. The case-based reasoning paradigm is used in our approach for the high level analysis.