跳到主要导航 跳到搜索 跳到主要内容

AFFECTIVE VIDEO CONTENT ANALYSES BY USING CROSS-MODAL EMBEDDING LEARNING FEATURES

  • Benchao Li
  • , Zhenzhong Chen*
  • , Shan Li
  • , Wei-Shi Zheng
  • *此作品的通讯作者
  • Sun Yat Sen Univ
  • Tencent
  • Minist Educ

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

3 引用 (Scopus)

摘要

Most existing methods on affective video content analyses are dedicated to single media, either visual content or audio content and few attempts for combined analysis of the two media signals are made. In this paper, we employ a cross-modal embedding learning approach to learn the compact feature representations of different modalities that are discriminative for analyzing the emotion attributes of the video. Specifically, we introduce inter-modal similarity constraints and intra-modal similarity constraints to promote the joint embedding learning procedure for obtaining the robust features. In order to capture cues in different grains, global and local features are extracted from both visual and audio signals, thereafter a unified framework consisting with global and local features embedding networks is built for affective video content analyses. Experiments show that our proposed approach significantly outperforms the state-of-the-art methods and demonstrate the effectiveness of our approach.
源语言英语
主期刊名2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME)
出版商IEEE Computer Society
页844-849
页数6
ISBN(电子版)978-1-5386-9552-4
ISBN(印刷版)0769511988, 0780379659, 9781479900152, 9781479947614, 9781479970827, 9781538695524, 9781665468916, 9781665485630, 9781728113319, 9798350390155
DOI
出版状态已出版 - 8 7月 2019

丛书

姓名IEEE International Conference on Multimedia and Expo
ISSN(印刷版)1945-7871

关键词

  • Affective Video Content Analyses
  • Cross-modal Embedding
  • Learning Features

收录

  • CPCI-S
  • EI
  • Scopus

学术指纹

探究 'AFFECTIVE VIDEO CONTENT ANALYSES BY USING CROSS-MODAL EMBEDDING LEARNING FEATURES' 的科研主题。它们共同构成独一无二的学术指纹。

引用此