• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chai, Liangyu (Chai, Liangyu.) [1] | Liu, Yongtuo (Liu, Yongtuo.) [2] | Liu, Wenxi (Liu, Wenxi.) [3] (Scholars:刘文犀) | Han, Guoqiang (Han, Guoqiang.) [4] | He, Shengfeng (He, Shengfeng.) [5]

Indexed by:

EI Scopus SCIE

Abstract:

In this paper, we introduce a novel yet challenging research problem, interactive crowd video generation, committed to producing diverse and continuous crowd video, and relieving the difficulty of insufficient annotated real-world datasets in crowd analysis. Our goal is to recursively generate realistic future crowd video frames given few context frames, under the user-specified guidance, namely individual positions of the crowd. To this end, we propose a deep network architecture specifically designed for crowd video generation that is composed of two complementary modules, each of which combats the problems of crowd dynamic synthesis and appearance preservation respectively. Particularly, a spatio-temporal transfer module is proposed to infer the crowd position and structure from guidance and temporal information, and a point-aware flow prediction module is presented to preserve appearance consistency by flow-based warping. Then, the outputs of the two modules are integrated by a self-selective fusion unit to produce an identity-preserved and continuous video. Unlike previous works, we generate continuous crowd behaviors beyond identity annotations or matching. Extensive experiments show that our method is effective for crowd video generation. More importantly, we demonstrate the generated video can produce diverse crowd behaviors and be used for augmenting different crowd analysis tasks, i.e., crowd counting, anomaly detection, crowd video prediction. Code is available at https://github.com/Icep2020/CrowdGAN.

Keyword:

Analytical models crowd analysis Crowd video generation data augmentation Predictive models Solid modeling Task analysis Three-dimensional displays Trajectory Uncertainty

Community:

  • [ 1 ] [Chai, Liangyu]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
  • [ 2 ] [Liu, Yongtuo]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
  • [ 3 ] [Han, Guoqiang]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
  • [ 4 ] [He, Shengfeng]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
  • [ 5 ] [Liu, Wenxi]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Fujian, Peoples R China

Reprint 's Address:

Show more details

Version:

Related Keywords:

Source :

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

ISSN: 0162-8828

Year: 2022

Issue: 6

Volume: 44

Page: 2856-2871

2 3 . 6

JCR@2022

2 0 . 8 0 0

JCR@2023

ESI Discipline: ENGINEERING;

ESI HC Threshold:66

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 11

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:247/10049203
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1