Search and retrieval of multimedia content using simple keywords presents several difficulties that have not been addressed within the context of text-based search engines. We study algorithms and techniques for the automatic identification of “semantic entities” or concepts in the content of multimedia data. More specifically, we explore low-level feature extraction, information fusion, knowledge based and machine learning approaches towards bridging the gap between the low-level information stored in multimedia data and the high level descriptions needed for their effective indexing.