• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chai, L. (Chai, L..) [1] | Liu, Y. (Liu, Y..) [2] | Liu, W. (Liu, W..) [3] | Han, G. (Han, G..) [4] | He, S. (He, S..) [5]

Indexed by:

Scopus

Abstract:

In this paper, we introduce a novel yet challenging research problem, interactive crowd video generation, committed to producing diverse and continuous crowd video, and relieving the difficulty of insufficient annotated real-world datasets in crowd analysis. Our goal is to recursively generate realistic future crowd video frames given few context frames, under the user-specified guidance, namely individual positions of the crowd. To this end, we propose a deep network architecture specifically designed for crowd video generation that is composed of two complementary modules, each of which combats the problems of crowd dynamic synthesis and appearance preservation respectively. Particularly, a spatio-temporal transfer module is proposed to infer the crowd position and structure from guidance and temporal information, and a point-aware flow prediction module is presented to preserve appearance consistency by flow-based warping. Then, the outputs of the two modules are integrated by a self-selective fusion unit to produce an identity-preserved and continuous video. Unlike previous works, we generate continuous crowd behaviors beyond identity annotations or matching. Extensive experiments show that our method is effective for crowd video generation. More importantly, we demonstrate the generated video can produce diverse crowd behaviors and be used for augmenting different crowd analysis tasks, i.e., crowd counting, anomaly detection, crowd video prediction. Code is available at https://github.com/Icep2020/CrowdGAN. © 1979-2012 IEEE.

Keyword:

crowd analysis; Crowd video generation; data augmentation

Community:

  • [ 1 ] [Chai, L.]South China University of Technology, School of Computer Science and Engineering, Guangdong, Guangzhou, 510641, China
  • [ 2 ] [Liu, Y.]South China University of Technology, School of Computer Science and Engineering, Guangdong, Guangzhou, 510641, China
  • [ 3 ] [Liu, W.]Fuzhou University, College of Mathematics and Computer Science, Fujian, Fuzhou, 350108, China
  • [ 4 ] [Han, G.]South China University of Technology, School of Computer Science and Engineering, Guangdong, Guangzhou, 510641, China
  • [ 5 ] [He, S.]South China University of Technology, School of Computer Science and Engineering, Guangdong, Guangzhou, 510641, China

Reprint 's Address:

  • [He, S.]South China University of Technology, Guangdong, China

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Pattern Analysis and Machine Intelligence

ISSN: 0162-8828

Year: 2022

Issue: 6

Volume: 44

Page: 2856-2871

2 3 . 6

JCR@2022

2 0 . 8 0 0

JCR@2023

ESI HC Threshold:66

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 12

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 6

Affiliated Colleges:

Online/Total:212/10039501
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1