[1]卜庆凯,胡爱群.一种新的镜头边界检测和静态视频摘要提取方法[J].东南大学学报(自然科学版),2007,37(4):559-564.[doi:10.3969/j.issn.1001-0505.2007.04.003]
 Bu Qingkai,Hu Aiqun.Novel approach of shot boundary detection and static video abstract extraction for video flow[J].Journal of Southeast University (Natural Science Edition),2007,37(4):559-564.[doi:10.3969/j.issn.1001-0505.2007.04.003]
点击复制

一种新的镜头边界检测和静态视频摘要提取方法()
分享到:

《东南大学学报(自然科学版)》[ISSN:1001-0505/CN:32-1178/N]

卷:
37
期数:
2007年第4期
页码:
559-564
栏目:
图像处理
出版日期:
2007-07-20

文章信息/Info

Title:
Novel approach of shot boundary detection and static video abstract extraction for video flow
作者:
卜庆凯 胡爱群
东南大学信息科学与工程学院, 南京 210096
Author(s):
Bu Qingkai Hu Aiqun
School of Information Science and Engineering, Southeast University, Nanjing 210096, China
关键词:
视频摘要 注意力模型 镜头边界检测 代表帧 参考帧
Keywords:
video abstract attention model shot boundary detection representative frame reference frame
分类号:
TN941.1
DOI:
10.3969/j.issn.1001-0505.2007.04.003
摘要:
提出一种新的融合图像分割和注意力模型的静态视频摘要自动生成方法.该方法将视频中的每帧图像分割成块,分别计算连续2帧对应块的匹配距离; 在此基础之上,根据各个块不同的重要性用线性融合的方法求出2帧之间的匹配距离; 然后通过计算匹配距离的期望和标准差自动地求出阈值,进而检测出镜头边缘; 最后根据每个镜头的匹配距离,提取出静态视频摘要.仿真结果表明:与同类方法相比,该方法能够快速高效地检测出各种镜头边界,提取的静态视频摘要能够有效反映视频的内容.
Abstract:
A novel automatic approach of generating static video abstract is proposed by combining image segmentation with attention model. A frame is firstly divided into many blocks, then the matching difference of corresponding blocks between two consecutive frames is computed. The difference of two frames is computed with linear fusion scheme according to the different importance of all blocks. After the computation of expectation and standard deviation, threshold is worked out automatically and shot boundaries are detected. Finally, the matching difference of every shot is worked out, and representative frames are extracted. The simulation results show that the proposed method outperforms other methods in efficiency and effectiveness. The representative frames can represent the content of video sequences.

参考文献/References:

[1] Truong B T,Venkatesh S.Video abstraction:a systematic review and classification[J].ACM Transactions on Multimedia Computing,Communication and Application,2007,3(1):1-37.
[2] Snoek C G M,Worring M.Multimodal video indexing:a review of the state-of-art [J].Multimedia Tools and Applications,2005,25(1):5-35.
[3] 何东健,耿楠,张义宽.数字图像处理 [M].西安:西安电子科技大学出版社,2003:4-106.
[4] Cheng Yong,Yang Xu,Xu De.A method for shot boundary detection with automatic threshold[C] //Proceedings of IEEE TENCON’02.Beijing,China,2002:582-585.
[5] Ma Yufei,Hua Xiansheng,Lu Lie,et al.A generic framework of user attention model and its application in video summarization[J].IEEE Transactions on Multimedia,2005,7(5):907-919.
[6] Lew M S,Sebe N,Djeraba C.Content-based multimedia information retrieval:state of the art and challenges[J]. ACM Transactions on Multimedia Computing,Communication and Applications,2006,2(1):1-19.
[7] Cernekova Zuzana,Pitas Ioannis,Nikou Christophoros.Information theory-based shot cut/fade detection and video summarization[J]. IEEE Transactions on Circuits and Systems for Video Technology,2006,16(1):82-91.
[8] Yuan J H,Wang H Y.A formal study of shot boundary detection [J].IEEE Transactions on Circuits and Systems for Video Technology,2007,17(2):168-186.

备注/Memo

备注/Memo:
基金项目: 江苏省网络与信息安全重点实验室资助项目(BM2003201).
作者简介: 卜庆凯(1978—),男,博士生; 胡爱群(联系人),男,博士,教授,博士生导师,aqhu@seu.edu.cn.
更新日期/Last Update: 2007-07-20