Research on the Brain-inspired Cross-media Neural Cognitive Computing Framework

To address modeling problems of brain-inspired intelligence, this thesis is focused on researching in the semantic-oriented framework design for image, audio, language and video. The Multimedia Neural Cognitive Computing (MNCC) model was designed based on the nervous mechanism and cognitive architecture. Furthermore, the semantic-oriented hierarchical Cross-media Neural Cognitive Computing (CNCC) framework was proposed based on MNCC, and formal description and analysis for CNCC was given. It would effectively improve the performance of semantic processing for multimedia information, and has far-reaching significance for exploration and realization brain-inspired computing.