中国民航大学学报 ›› 2021, Vol. 39 ›› Issue (1): 17-22.

• 民用航空 • 上一篇    下一篇

多尺度特征融合的对抗神经网络人群计数算法

韩萍,刘占锋,贾云飞,牛勇钢   

  1. (中国民航大学电子信息与自动化学院,天津300300)
  • 出版日期:2021-02-25 发布日期:2021-02-15
  • 作者简介:韩萍(1966—),女,天津人,教授,博士,研究方向为信号与信息处理.
  • 基金资助:
    中央高校基本科研业务费专项(3122019049)

Crowd counting algorithm based on multi-scale feature fusion via adversarial neural network#br#

HAN Ping, LIU Zhanfeng, JIA Yunfei, NIU Yonggang   

  1. (College of Electronic Information and Automation, CAUC, Tianjin 300300, China)
  • Online:2021-02-25 Published:2021-02-15

摘要: 为了解决人群计数过程中人群特征提取困难和特征融合过程中信息丢失的问题,提出了多尺度特征融合的对抗神经网络人群计数算法。首先,通过多尺度特征提取结构提取不同尺度的浅层次人群特征;其次,将浅层次人群特征与卷积网络的深层次人群特征利用残差结构连接,实现不同尺度、不同深浅的人群特征融合;最后,通过对抗方式使生成器网络和判别器网络进行交替学习,通过不断学习指导模型生成高质量的人群密度图。在ShanghaiTech 和UCF_CC_50 数据集上验证,实验结果表明,与传统神经网络模型相比,在复杂人群环境下,该方法的人群计数准确率和鲁棒性都有较大提高。

关键词: 人群计数, 对抗神经网络, 特征融合, 复杂人群环境

Abstract: The crowd counting algorithm of adversarial neural network based on multi-scale feature fusion is proposed to solve the difficulty in crowd feature extraction and information loss in feature fusion. First, shallow crowd features at different scales are extracted through multi-scale feature extraction structure with different size convolution kernels extracts. Next, shallow crowd features and deep-level crowd features of the convolutional network are connected through residual structure to achieve the fusion of crowd features at different scales and depths.Finally, the alternate learning between generator network and discriminator network is realized through adversarial method in order to generate high-quality crowd density maps. Experimental results on two datasets of ShanghaiTech and UCF_CC_50 show that this model can greatly improve the accuracy and robustness of crowd counting in complex crowd environments compared with traditional neural network models.

Key words: crowd counting, adversarial neural network, feature fusion, complex crowd environment

中图分类号: