Multi-Concept Learning for Scene Graph Generation - Xinyu Lyu; Lianli Gao; Junlin Xie; Pengpeng Zeng; Yulu Tian; Jie Shao; Heng Tao Shen (IEEE Trans. Image Process., 2025)

Text-Video Retrieval With Global-LocalSemantic Consistent Learning - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Yihang Duan; Xinyu Lyu; Heng Tao Shen (IEEE Trans. Image Process., 2025)

Visual Commonsense-Aware Representation Network for Video Captioning - Pengpeng Zeng; Haonan Zhang; Lianli Gao; Xiangpeng Li; Jin Qian; Heng Tao Shen (IEEE Trans. Neural Networks Learn. Syst., 2025)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct - Run Luo; Haonan Zhang; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang; Yongbin Li; Minzheng Wang; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; et al. (Findings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 - August 1, 2025, 2025)

OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction - Haonan Zhang; Run Luo; Xiong Liu; Yuchuan Wu; Ting-En Lin; Pengpeng Zeng; Qiang Qu; Feiteng Fang; Min Yang; Lianli Gao; Jingkuan Song; Fei Huang; et al. (Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2025, Vienna, Austria, July 27 - August 1, 2025, 2025)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves - Shihan Wu; Ji Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11-15, 2025, 2025)

CFReID: Continual Few-shot Person Re-Identification - Hao Ni; Lianli Gao; Pengpeng Zeng; Heng Tao Shen; Jingkuan Song (CoRR, 2025)

Towards Generalized and Training-Free Text-Guided Semantic Manipulation - Yu Hong; Xiao Cai; Pengpeng Zeng; Shuai Zhang; Jingkuan Song; Lianli Gao; Heng Tao Shen (CoRR, 2025)

OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction - Haonan Zhang; Run Luo; Xiong Liu; Yuchuan Wu; Ting-En Lin; Pengpeng Zeng; Qiang Qu; Feiteng Fang; Min Yang; Lianli Gao; Jingkuan Song; Fei Huang; et al. (CoRR, 2025)

Dual-Branch Hybrid Learning Network for Unbiased Scene Graph Generation - Chaofan Zheng; Lianli Gao; Xinyu Lyu; Pengpeng Zeng; Abdulmotaleb El-Saddik; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

SPT: Spatial Pyramid Transformer for Image Captioning - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Xinyu Lyu; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

Ump: Unified Modality-Aware Prompt Tuning for Text-Video Retrieval - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

Memory-Based Augmentation Network for Video Captioning - Shuaiqi Jing; Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Multim., 2024)

ProS: Prompting-to-Simulate Generalized Knowledge for Universal Cross-Domain Retrieval - Kaipeng Fang; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Zhi-Qi Cheng; Xiyao Li; Heng Tao Shen (IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024, Seattle, WA, USA, June 16-22, 2024, 2024)

Attribute Vision Transformer for UAV-Human Re-Identification - Hao Ni; Yuke Li; Ping Lai; Pengpeng Zeng; Hangyu Guo; Lianli Gao (IEEE International Conference on Multimedia and Expo, ICME 2024 - Workshops, Niagara Falls, ON, Canada, July 15-19, 2024, 2024)

Pedestrian Attributes Recognition for UAV-Human - Hao Ni; Ping Lai; Yuke Li; Pengpeng Zeng; Haonan Zhang; Jingkuan Song (IEEE International Conference on Multimedia and Expo, ICME 2024 - Workshops, Niagara Falls, ON, Canada, July 15-19, 2024, 2024)

MPT: Multi-grained Prompt Tuning for Text-Video Retrieval - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024 - 1 November 2024, 2024)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct - Run Luo; Haonan Zhang; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang; Minzheng Wang; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; Yunshui Li; et al. (CoRR, 2024)

SeMv-3D: Towards Semantic and Mutil-view Consistency simultaneously for General Text-to-3D Generation with Triplane Priors - Xiao Cai; Pengpeng Zeng; Lianli Gao; Junchen Zhu; Jiaxin Zhang; Sitong Su; Heng Tao Shen; Jingkuan Song (CoRR, 2024)

GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmark - Sitong Su; Xiao Cai; Lianli Gao; Pengpeng Zeng; Qinhong Du; Mengqi Li; Heng Tao Shen; Jingkuan Song (CoRR, 2024)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves - Shihan Wu; Ji Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (CoRR, 2024)

End-to-end Image Captioning via Visual Region Aggregation and Dual-level Collaboration - Jingkuan Song; Pengpeng Zeng; Jiayang Gu; Jinkuan Zhu; Lianli Gao (Int. J. Softw. Informatics, 2023)

Adaptive Fine-Grained Predicates Learning for Scene Graph Generation - Xinyu Lyu; Lianli Gao; Pengpeng Zeng; Heng Tao Shen; Jingkuan Song (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

Learning visual question answering on controlled semantic noisy labels - Haonan Zhang; Pengpeng Zeng; Yuxuan Hu; Jin Qian; Jingkuan Song; Lianli Gao (Pattern Recognit., 2023)

Complementarity-Aware Space Learning for Video-Text Retrieval - Jinkuan Zhu; Pengpeng Zeng; Lianli Gao; Gongfu Li; Dongliang Liao; Jingkuan Song (IEEE Trans. Circuits Syst. Video Technol., 2023)

Depth-Aware Sparse Transformer for Video-Language Learning - Haonan Zhang; Lianli Gao; Pengpeng Zeng; Alan Hanjalic; Heng Tao Shen (Proceedings of the 31st ACM International Conference on Multimedia, MM 2023, Ottawa, ON, Canada, 29 October 2023- 3 November 2023, 2023)

ProS: Prompting-to-simulate Generalized knowledge for Universal Cross-Domain Retrieval - Kaipeng Fang; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Zhi-Qi Cheng; Xiyao Li; Heng Tao Shen (CoRR, 2023)

Text-instance graph: Exploring the relational semantics for text-based visual question answering - Xiangpeng Li; Bo Wu; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Chuang Gan (Pattern Recognit., 2022)

Hierarchical Representation Network With Auxiliary Tasks for Video Captioning and Video Question Answering - Lianli Gao; Yu Lei; Pengpeng Zeng; Jingkuan Song; Meng Wang; Heng Tao Shen (IEEE Trans. Image Process., 2022)

Video Question Answering With Prior Knowledge and Object-Sensitive Learning - Pengpeng Zeng; Haonan Zhang; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Image Process., 2022)

Relation-aware aggregation network with auxiliary guidance for text-based person search - Pengpeng Zeng; Shuaiqi Jing; Jingkuan Song; Kaixuan Fan; Xiangpeng Li; Liansuo We; Yuan Guo (World Wide Web, 2022)

Support-Set Based Multi-Modal Representation Enhancement for Video Captioning - Xiaoya Chen; Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022, 2022)

Learning to Generate Scene Graph from Head to Tail - Chaofan Zheng; Xinyu Lyu; Yuyu Guo; Pengpeng Zeng; Jingkuan Song; Lianli Gao (IEEE International Conference on Multimedia and Expo, ICME 2022, Taipei, Taiwan, July 18-22, 2022, 2022)

S2 Transformer for Image Captioning - Pengpeng Zeng; Haonan Zhang; Jingkuan Song; Lianli Gao (Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23-29 July 2022, 2022)

Progressive Tree-Structured Prototype Network for End-to-End Image Captioning - Pengpeng Zeng; Jinkuan Zhu; Jingkuan Song; Lianli Gao (MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10 - 14, 2022, 2022)

Dynamic Scene Graph Generation via Temporal Prior Inference - Shuang Wang; Lianli Gao; Xinyu Lyu; Yuyu Guo; Pengpeng Zeng; Jingkuan Song (MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10 - 14, 2022, 2022)

A Differentiable Semantic Metric Approximation in Probabilistic Embedding for Cross-Modal Retrieval - Hao Li; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Haonan Zhang; Gongfu Li (Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022, 2022)

Support-set based Multi-modal Representation Enhancement for Video Captioning - Xiaoya Chen; Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (CoRR, 2022)

Structured Two-stream Attention Network for Video Question Answering - Lianli Gao; Pengpeng Zeng; Jingkuan Song; Yuan-Fang Li; Wu Liu; Tao Mei; Heng Tao Shen (CoRR, 2022)

From Pixels to Objects: Cubic Visual Attention for Visual Question Answering - Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (CoRR, 2022)

Learning To Generate Scene Graph from Head to Tail - Chaofan Zheng; Xinyu Lyu; Yuyu Guo; Pengpeng Zeng; Jingkuan Song; Lianli Gao (CoRR, 2022)

Adaptive Fine-Grained Predicates Learning for Scene Graph Generation - Xinyu Lyu; Lianli Gao; Pengpeng Zeng; Heng Tao Shen; Jingkuan Song (CoRR, 2022)

Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation - Chaofan Zheng; Lianli Gao; Xinyu Lyu; Pengpeng Zeng; Abdulmotaleb El-Saddik; Heng Tao Shen (CoRR, 2022)

Progressive Tree-Structured Prototype Network for End-to-End Image Captioning - Pengpeng Zeng; Jinkuan Zhu; Jingkuan Song; Lianli Gao (CoRR, 2022)

Visual Commonsense-aware Representation Network for Video Captioning - Pengpeng Zeng; Haonan Zhang; Lianli Gao; Xiangpeng Li; Jin Qian; Heng Tao Shen (CoRR, 2022)

Generalized pyramid co-attention with learnable aggregation net for video question answering - Lianli Gao; Tangming Chen; Xiangpeng Li; Pengpeng Zeng; Lei Zhao; Yuan-Fang Li (Pattern Recognit., 2021)

Rich Visual Knowledge-Based Augmentation Network for Visual Question Answering - Liyang Zhang; Shuaicheng Liu; Donghao Liu; Pengpeng Zeng; Xiangpeng Li; Jingkuan Song; Lianli Gao (IEEE Trans. Neural Networks Learn. Syst., 2021)

Hierarchical Representation Network With Auxiliary Tasks For Video Captioning - Yu Lei; Zhonghai He; Pengpeng Zeng; Jingkuan Song; Lianli Gao (2021 IEEE International Conference on Multimedia and Expo, ICME 2021, Shenzhen, China, July 5-9, 2021, 2021)

Conceptual and Syntactical Cross-modal Alignment with Cross-level Consistency for Image-Text Matching - Pengpeng Zeng; Lianli Gao; Xinyu Lyu; Shuaiqi Jing; Jingkuan Song (MM '21: ACM Multimedia Conference, Virtual Event, China, October 20 - 24, 2021, 2021)

Structured Two-Stream Attention Network for Video Question Answering - Lianli Gao; Pengpeng Zeng; Jingkuan Song; Yuan-Fang Li; Wu Liu; Tao Mei; Heng Tao Shen (The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019, 2019)

From Pixels to Objects: Cubic Visual Attention for Visual Question Answering - Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, July 13-19, 2018, Stockholm, Sweden, 2018)

Examine before You Answer: Multi-task Learning with Adaptive-attentions for Multiple-choice VQA - Lianli Gao; Pengpeng Zeng; Jingkuan Song; Xianglong Liu; Heng Tao Shen (2018 ACM Multimedia Conference on Multimedia Conference, MM 2018, Seoul, Republic of Korea, October 22-26, 2018, 2018)