• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Wei (Huang, Wei.) [1] (Scholars:黄维) | Wang, Dexian (Wang, Dexian.) [2] | Ouyang, Xiaocao (Ouyang, Xiaocao.) [3] | Wan, Jihong (Wan, Jihong.) [4] | Liu, Jia (Liu, Jia.) [5] | Li, Tianrui (Li, Tianrui.) [6]

Indexed by:

EI Scopus SCIE

Abstract:

Multimodal learning mines and analyzes multimodal data in reality to better understand and appreciate the world around people. However, how to exploit this rich multimodal data without violating user privacy is a key issue. Federated learning is a privacy-conscious alternative to centralized machine learning, therefore many researchers have combined federated learning with multimodal learning to break down data barriers for the purpose of jointly leveraging multiple modal data from different clients for modeling. In order to provide a systematic summarize of multimodal federated learning, this paper describes the basic mode of multimodal federated learning, multimodal fusion based on federated learning, multimodal federated learning optimization and multimodal federated learning application, and introduces each type of multimodal federated learning methods in detail. Finally, the future research trends of multimodal federated learning are discussed and analyzed, mainly including the optimization of multimodal federated learning, privacy- preserving techniques for multimodal federated learning, multimodal federated few-shot learning & multimodal federated semi-supervised learning, and data and knowledge-driven multimodal federated learning.

Keyword:

Federated learning Machine learning Multimodal fusion Multimodal learning Privacy protection

Community:

  • [ 1 ] [Huang, Wei]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Peoples R China
  • [ 2 ] [Wang, Dexian]Chengdu Univ Tradit Chinese Med, Sch Intelligent Med, Chengdu 611137, Peoples R China
  • [ 3 ] [Ouyang, Xiaocao]Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
  • [ 4 ] [Li, Tianrui]Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
  • [ 5 ] [Wan, Jihong]Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Guangdong, Peoples R China
  • [ 6 ] [Liu, Jia]Xihua Univ, Sch Comp & Software Engn, Chengdu 610039, Peoples R China

Reprint 's Address:

  • [Liu, Jia]Xihua Univ, Sch Comp & Software Engn, Chengdu 610039, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

INFORMATION FUSION

ISSN: 1566-2535

Year: 2024

Volume: 112

1 4 . 8 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:223/10036178
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1