基本信息

黄怀波  副研究员 中科院自动化研究所

北京市科技新星创新新星

北京市科协青年人才托举工程

中国科学院青年创新促进会会员

电子邮件: huaibo.huang@cripac.ia.ac.cn
通信地址: 北京市海淀区中关村东路95号
邮政编码: 100190

研究领域

计算机视觉、生成式人工智能、视觉基础模型、图像恢复和增强

招生信息

每年招收硕士研究生一名。

招生专业
081104-模式识别与智能系统
081203-计算机应用技术
招生方向
模式识别,计算机视觉,生成式人工智能

工作经历

2019-06   中国科学院大学   博士
2016-01   北京航空航天大学   硕士
2012-07   西安交通大学   学士

工作简历
2021-04~现在, 中国科学院自动化研究所, 副研究员
2019-07~2021-04,中国科学院自动化研究所, 助理研究员
学术兼职

1. 北京图象图形学学会理事

2. 中国图象图形学学会视觉大数据专委会委员

3. NeurIPS、PRCV等学术会议领域主席

4. TPAMI、IJCV、TIP、NeurIPS、ICML、ICLR、CVPR、ICCV等期刊和会议审稿人

专利与奖励


奖励信息
(1) 北京市科技新星, 省级, 2023
(2) 吴文俊人工智能科学技术奖技术发明奖, 一等奖, 其他, 2023
(3) 中国科学院青年创新促进会, , 院级, 2022
(4) 北京市科协青年人才托举工程, , 其他, 2020
(5) 北京市优秀毕业生, , 省级, 2019
(6) 中国科学院院长优秀奖, 院级, 2019
(7) ICME研讨会最佳学生论文奖, 其他, 2019
专利成果
[1] 赫然, 黄怀波, 周晓强, 王迎雪. 基于随机小波注意力的图像处理方法、装置、设备及介质. CN202310215782.X, 2023-03-08.
[2] 赫然, 黄怀波, 樊齐航, 周晓强. 基于几何先验的鸟瞰图语义分割方法、装置、设备及介质. CN202310041741.3, 2023-01-11.
[3] 赫然, 黄怀波, 樊齐航, 周晓强. 基于几何先验的鸟瞰图语义分割方法、装置、设备及介质. CN: CN115965969A, 2023-04-14.
[4] 赫然, 黄怀波, 艾雨昂, 周晓强. 基于无源领域自适应的图像超分辨率方法及装置. CN202211690099.3, 2022-12-27.
[5] 赫然, 谭铁牛, 黄怀波, 周晓强. 基于递归Transformer的动态图像复原方法. CN: CN115631115A, 2023-01-20.
[6] 赫然, 谭铁牛, 黄怀波, 周晓强. 基于递归Transformer的动态图像复原方法. CN202211569108.3, 2022-12-08.
[7] 赫然, 黄怀波, 周晓强. 图像处理方法、装置、电子设备及存储介质. CN202210895580.X, 2022-07-28.
[8] 赫然, 黄怀波, 周晓强. 图像处理方法、装置、电子设备及存储介质. CN: CN115062673A, 2022-09-16.
[9] 赫然, 黄怀波, 刘晨雨, 李佳, 段俊贤. 一种视听伪造检测方法及装置. CN114596609A, 2022-06-07.
[10] 赫然, 黄怀波, 刘晨雨, 李佳, 段俊贤. 一种基于多线索的双流视频人脸伪造检测方法及系统. CN114596608A, 2022-06-07.
[11] 赫然, 黄怀波, 高格格. 基于因果推断的高泛化人脸替换方法、装置和电子设备. CN113627404A, 2021-11-09.
[12] 赫然, 黄怀波, 李佳. 人脸图像盲修复方法及系统. CN113763268A, 2021-12-07.
[13] 赫然, 黄怀波, 徐雨婷, 贾耕云, 段俊贤. 基于视觉语义信息的人脸伪造检测方法和装置. CN113627233A, 2021-11-09.
[14] 赫然, 黄怀波, 于艾靖, 柴振华. 基于选择性机制注意力机制的雨图去雨方法、系统及设备. CN: CN112862875A, 2021-05-28.
[15] 赫然, 黄怀波, 于艾靖, 柴振华. 基于选择性机制注意力机制的雨图去雨方法、系统及设备. CN: CN112862875B, 2022-02-15.
[16] 赫然, 丁雨禾, 马鑫, 骆曼迪, 郑爱华, 黄怀波, 单彩峰. 漫画风格图像转换模型的训练方法、图像生成方法及装置. CN: CN112232485A, 2021-01-15.
[17] 赫然, 马鑫, 侯峦轩, 黄怀波, 王海滨. 一种基于注意力机制的图像补全方法及装置. CN: CN112184582A, 2021-01-05.
[18] 赫然, 黄怀波, 侯峦轩, 马鑫, 单彩峰. 一种注意力机制人体图像关键点姿态估计方法及系统. CN: CN112149563A, 2020-12-29.
[19] 赫然, 郑欣, 黄怀波. 基于双向Ladder结构的人脸属性分类系统. CN: CN109886072A, 2019-06-14.

出版信息

近几年在人工智能领域国际权威期刊和会议发表论文共计50余篇,其中CCF-A类论文31篇,包含TPAMI 2篇、IJCV 5篇、NeurIPS 5篇、CVPR 8篇、ICCV 3篇;出版Springer专著1部。以第一作者和通讯作者身份发表TPAMI 1篇、IJCV 2篇、NeurIPS 2篇、CVPR 4篇、ICCV 1篇。

全部论文列表参考:谷歌学术

期刊论文

  1. Huaibo Huang, Mandi Luo, Ran He. Memory Uncertainty Learning for Real-World Single Image Deraining. Trans. Pattern Analysis and Machine Intelligence (TPAMI), 2022. (IF: 23.6,CCF-A,人工智能领域顶级期刊)

  2. Huaibo Huang, Aijing Yu, Zhenhua Chai, Ran He, Tieniu Tan. Selective Wavelet Attention Learning for Single Image Deraining. International Journal of Computer Vision (IJCV), 2021. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)

  3. Huaibo Huang, Ran He, Zhenan Sun, Tieniu Tan. Wavelet Domain Generative Adversarial Network for Multi-scale Face Hallucination. International Journal of Computer Vision (IJCV), 127(6-7): 763-784, 2019. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)

  4. Yi Li#, Huaibo Huang#, Jie Cao, Ran He, Tieniu Tan. Disentangled Representation Learning of Makeup Portraits in the Wild. International Journal of Computer Vision (IJCV), 2020, 128: 2166–2184. (Co-first author)(IF: 19.5,CCF-A,计算机视觉领域顶级期刊)

  5. Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He. DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition. Trans. Pattern Analysis and Machine Intelligence (TPAMI), 2021. (IF: 23.6,CCF-A,人工智能领域顶级期刊)

  6. Aijing Yu, Haoxue Wu, Huaibo Huang, Zhen Lei, Ran He. LAMP-HQ: A Large-Scale Multi-Pose High-Quality Database for NIR-VIS Face Recognition. International Journal of Computer Vision (IJCV), 2021. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)

  7. Xin Zheng, Yanqing Guo, Huaibo Huang, Yi Li, Ran He. A Survey to Deep Facial Attribute Analysis. International Journal of Computer Vision (IJCV), 2020. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)

  8. Jianze Wei, Huaibo Huang, Yunlong Wang, Ran He, Zhenan Sun. Towards More Discriminative and Robust Iris Recognition by Learning Uncertain Factors. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)

  9. Jianze Wei, Yunlong Wang, Huaibo Huang, Ran He, Zhenan Sun, Xingyu Gao. Contextual Measures for Iris Recognition. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)

  10. Mandi Luo, Haoxue Wu, Huaibo Huang, Weizan He, Ran He. Memory-Modulated Transformer Network for Heterogeneous Face Recognition. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)

  11. Xiaoqiang Zhou, Chaoyou Fu, Huaibo Huang, Ran He. Dynamic Graph Memory Bank for Video Inpainting. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2024. (IF: 8.4, CCF-B, 视频处理领域权威期刊)

  12. Xiaoqiang Zhou, Huaibo Huang, Zilei Wang, Ran He. RISTRA: Recursive Image Super-resolution Transformer with Relativistic Assessment. IEEE Transactions on Multimedia (TMM), 2024. (IF: 7.3, CCF-B, 多媒体领域权威期刊)

  13. Xin Zheng, Huaibo Huang, Yanqing Guo, Ran He.  BLAN: Bi-directional Ladder Attentive Network for Facial Attribute Prediction. Pattern Recognition (PR), 2020. (IF: 8,CCF-B,模式识别领域权威期刊)

  14. Xin Ma, Xiaoqiang Zhou, Huaibo Huang, Gengyun Jia, Zhenhua Chai, Xiaolin Wei.  Contrastive Attention Network with the Dense Field Estimation for Face Completion. Pattern Recognition (PR), 2021.  (IF: 8,CCF-B,模式识别领域权威期刊)


会议论文

  1. Huaibo Huang, Xiaoqiang Zhou, Jie Cao, Ran He, Tieniu Tan. Vision Transformer with Super Token Sampling. Computer Vision and Pattern Recognition (CVPR), 2023. (CCF-A,计算机视觉领域顶级会议)
  2. Huaibo Huang, Xiaoqiang Zhou, Ran He. Orthogonal Transformer: An Efficient Vision Transformer Backbone with Token Orthogonalization. Neural Information Processing Systems (NeurIPS), 2022. (CCF-A,机器学习领域顶级会议)
  3. Huaibo Huang, Aijing Yu, Ran He. Memory Oriented Transfer Learning for Semi-Supervised Image Deraining. Computer Vision and Pattern Recognition (CVPR), 2021. (CCF-A,计算机视觉领域顶级会议)
  4. Huaibo Huang, Zhihang Li, Ran He, Zhenan Sun, Tieniu Tan. IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis. Neural Information Processing Systems (NeurIPS), 2018: 52-63. (CCF-A,机器学习领域顶级会议)
  5.  Huaibo Huang, Ran He, Zhenan Sun, Tieniu Tan. Wavelet-SRNet: A Wavelet-based CNN for Multi-scale Face Super Resolution. International Conference on Computer Vision (ICCV), 2017: 1698-1706. (CCF-A,计算机视觉领域顶级会议)
  6. Peipei Li#, Huaibo Huang#, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun. Hierarchical Face Aging through Disentangled Latent Characteristics. European Conference on Computer Vision (ECCV), 2020. (Co-first author)(CCF-B, 计算机视觉领域顶级会议)
  7. Yuang Ai, Huaibo Huang*, Xiaoqiang Zhou, Jiexiang Wang, Ran He. Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration. Computer Vision and Pattern Recognition (CVPR), 2024. (Corresponding author) (CCF-A,计算机视觉领域顶级会议)
  8. Yuang Ai, Xiaoqiang Zhou, Huaibo Huang*, Lei Zhang, Ran He. Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformer. Computer Vision and Pattern Recognition (CVPR), 2024.(Corresponding author) (CCF-A,计算机视觉领域顶级会议)
  9. Qihang Fan, Huaibo Huang, Mingrui Chen, Hongmin Liu, Ran He. RMT: Retentive Networks Meet Vision Transformers. Computer Vision and Pattern Recognition (CVPR), 2024. (CCF-A,计算机视觉领域顶级会议)
  10. Tingkai Liu, Yunzhe Tao, Haogeng Liu, Qihang Fan, Ding Zhou, Huaibo Huang, Ran He, Hongxia Yang. DeVAn: Dense Video Annotation for Video-Language Models. Association for Computational Linguistics (ACL), 2024. (CCF-A,自然语言处理领域顶级会议)
  11. Qihang Fan, Huaibo Huang, Xiaoqiang Zhou, Ran He. Lightweight Vision Transformer with Bidirectional Interaction. Neural Information Processing Systems (NeurIPS), 2023.(CCF-A,机器学习领域顶级会议)

  12. Rui Wang, Pei Pei Li, Huaibo Huang, Chunshui Cao, Ran He, Zhaofeng He. Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification. Neural Information Processing Systems (NeurIPS), 2023.(CCF-A,机器学习领域顶级会议)

  13. Xiaoqiang Zhou, Huaibo Huang, Zilei Wang, Jie Hu, Ran He, Tieniu Tan. MSRA-SR: Image Super-resolution Transformer with Multi-scale Shared Representation Acquisition. International Conference on Computer Vision (ICCV), 2023. (CCF-A,计算机视觉领域顶级会议)

  14. Peipei Li, Rui Wang, Huaibo Huang, Ran He, Zhaofeng He. Pluralistic Aging Diffusion Autoencoder. International Conference on Computer Vision (ICCV), 2023. (CCF-A,计算机视觉领域顶级会议)
  15. Gengyun Jia, Huaibo Huang, Chaoyou Fu, Ran He. Rethinking Image Cropping: Exploring Diverse Compositions from Global Views. Computer Vision and Pattern Recognition (CVPR), 2022. (CCF-A,计算机视觉领域顶级会议)
  16.  Xin Xie, Yi Li, Huaibo Huang, Haiyan Fu, Wanwan Wang, Yanqing Guo. Artistic Style Discovery With Independent Components. Computer Vision and Pattern Recognition (CVPR), 2022. (CCF-A,计算机视觉领域顶级会议)
  17.  Gege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li, Ran He. Information Bottleneck Disentanglement for Identity Swapping. Computer Vision and Pattern Recognition (CVPR), 2021. (CCF-A,计算机视觉领域顶级会议)
  18. Zi Wang, Huaibo Huang, Aihua Zheng, Ran He. Heterogeneous Test-time Training for Multi-modal Person Re-identification. AAAI Conference on Artificial Intelligence (AAAI), 2024.(CCF-A,人工智能领域顶级会议)
  19.  Xiang Wu, Huaibo Huang, Vishal Patel, Ran He, Zhenan Sun. Disentangled Variational Representation for Heterogeneous Face Recognition. AAAI Conference on Artificial Intelligence (AAAI), 2019.(CCF-A,人工智能领域顶级会议)
  20. Weikuo Guo, Huaibo Huang, Xiangwei Kong, Ran He. Learning Disentangled Representation for Cross-Modal Retrieval with Deep Mutual Information Estimation. ACM International Conference on Multimedia (ACMMM), 2019.(CCF-A,人工智能领域顶级会议)
  21. Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He. Dual Variational Generation for Low-Shot Heterogeneous Face Recognition. Neural Information Processing Systems (NeurIPS), 2019.(CCF-A,机器学习领域顶级会议)
  22.  Jie Cao, Huaibo Huang, Yi Li, Jingtuo Liu, Ran He, Zhenan Sun. Informative Sample Mining Network for Multi-Domain Image-to-Image Translation. European Conference on Computer Vision (ECCV), 2020. (CCF-B, 计算机视觉领域顶级会议)
  23.  Hao Zhu, Huaibo Huang, Yi Li, Aihua Zheng, Ran He. Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning. International Joint Conference on Artificial Intelligence (IJCAI), 2020. (CCF-A,人工智能领域顶级会议)
  24. Rui Wang, Huaibo Huang, Xufeng Zhang, Jixin Ma, Aihua Zheng. A Novel Distance Learning for Elastic Cross Modal Audio-Visual Matching. Workshops: 2019 IEEE International Conference on Multimedia and Expo (ICMEW), 2019. (Best Student Paper) (CCF-B, 计算机图形学与多媒体领域权威会议)


著作
Yi Li, Huaibo Huang, Ran He, Tieniu Tan. Heterogeneous Facial Analysis and Synthesis. Springer, 2020.

科研活动

( 1 ) 基于解耦表达的高保真人脸图像合成理论和方法研究, 负责人, 国家任务, 2021-01--2023-12
( 2 ) 多媒体混合伪造生成模型的稳定性研究, 负责人, 国家任务, 2020-07--2023-06
( 3 ) 中国科学院青年创新促进会, 负责人, 中国科学院计划, 2022-03--2025-12
( 4 ) 人脸增强、旋转与Sketch转换技术, 负责人, 境内委托项目, 2018-12--2024-06
( 5 ) 面向复杂场景的小样本视频自动生成研究, 负责人, 境内委托项目, 2021-09--2022-08
( 6 ) 基于MindSpore的视觉内容智能合成与鉴别技术研究, 负责人, 境内委托项目, 2022-11--2023-11
( 7 ) 北京市科技新星创新新星计划, 负责人, 地方任务, 2023-10--2026-10