基本信息

 

张晓宇 研究员/博导

中国科学院信息工程研究所

新·第6研究室

 

电子邮件:zhangxiaoyu@iie.ac.cn
通信地址:北京市海淀区树村路19
邮政编码:100093

 

研究方向

人工智能与深度学习、大数据内容安全、计算机视觉与多媒体等。

成果荣誉

  在相关领域TIPTIFSToNTMMTNNLSPRCVIU等国际知名期刊和AAAIMMWWWKDDIJCAICIKMEMNLP等国际知名会议上发表学术论文100余篇;
  申请发明专利20余项(授权15项);
  主持国家自然科学基金4项,主持和参与国家重点研发计划、国家科技支撑计划、国家重大工程等科研项目10余项;
  荣获2019年中国图象图形学学会科学技术奖二等奖、2016年吴文俊人工智能科学技术创新奖二等奖、2018年北京市科学技术协会北京青年优秀科技论文奖三等奖、2017年中国电影电视技术学会影视科技优秀论文奖三等奖、2017CCCV2017 Best Paper Nominate Award2009年微软杯IEEE中国学生论文大赛银奖等学术荣誉。

学术任职

  中国计算机学会(CCF)杰出会员;
  电气和电子工程师协会(IEEE)、国际计算机学会(ACM)、中国图像图形学会(CSIG)、中国人工智能学会(CAAI)高级会员;
  中国图像图形学会(CSIG)视觉大数据专委会、中国自动化学会(CAA)模式识别与机器智能专委会副秘书长。

 

目前,2024级硕/博
招生名额充足,欢迎联系!

研究领域

人工智能,模式识别,深度学习,多媒体分析与理解。

招生信息

   
招生专业
083900-网络空间安全
081203-计算机应用技术
081104-模式识别与智能系统
招生方向
模式识别与人工智能
机器学习与数据挖掘
深度学习应用

教育背景

2005-09--2010-06   中国科学院自动化研究所   工学博士(硕博连读)
2001-09--2005-06   南京理工大学   工学学士
学历
博士
学位
博士

工作经历

   
工作简历
2023-10~现在, 中国科学院信息工程研究所, 研究员
2015-10~2023-10,中国科学院信息工程研究所, 副研究员
2014-05~2015-10,中国科学院信息工程研究所, 助理研究员
2010-07~2014-04,中国科学技术信息研究所, 助理研究员
学术兼职

[1]    电气和电子工程师协会(IEEE):Senior Member2016.02-
[2]    国际计算机学会(ACM):Senior Member2016.12-
[3]    中国计算机学会(CCF):高级会员,2017.01-2022.09杰出会员2022.09-
[4]    中国图像图形学会(CSIG):高级会员2019.05-
[5]    中国人工智能学会(CAAI):高级会员2022.11-
[6]    中国图像图形学会(CSIG)视觉大数据专委会:副秘书长2017.05-
[7]    中国自动化学会(CAA)模式识别与机器智能专委会:副秘书长2017.11-

专利与奖励

   
科技奖励

[1]    WACV 2024国际竞赛: FRCSyn Challenge: Face Recognition Challenge in the Era of Synthetic Data, 第一名,排名5/6指导老师】,2024
[2]    全国大数据与计算智能挑战赛,优胜奖,排名2/5指导老师】,2023
[3]    北京图象图形学学会优秀导师提名奖,排名1/12023
[4]    中国科学院职工技能大赛人工智能领域,优胜奖,排名1/5指导老师】,2023
[5]    CVPR 2021国际竞赛: Woodscape Fisheye Semantic Segmentation for Autonomous Driving Challenge, 第一名,排名5/5指导老师】,2021
——冠军方案:“Full swin-transformer encoder-decoder
[6]    中国图象图形学学会科学技术奖,省部级二等奖,排名1/2第一完成人】,2019
——获奖成果:“基于协同融合的媒体智能感知”
[7]    北京市科学技术协会第十四届北京青年优秀科技论文奖,省部级,三等奖,排名1/1第一作者】,2018
——获奖论文:《Bidirectional active learning: a two-way exploration into unlabeled and labeled dataset
[8]    中国电影电视技术学会影视科技优秀论文奖,省部级,三等奖,排名3/32017
——获奖论文:《基于深度学习的融合媒体智能引擎研究》
[9]    中国电影电视技术学会影视科技优秀论文奖,省部级,三等奖,排名3/32017
——获奖论文:《基于海量异构数据关联和挖掘的媒体融合技术研究》
[10] CCCV2017 Best Paper Nominate Award,排名3/6唯一通讯作者】,2017
——获奖论文:《A novel framework for image description generation
[11] 吴文俊人工智能科学技术创新奖,省部级二等奖,排名1/1第一完成人】,2016
——获奖成果:“智能交互式主动学习关键技术”
[12] 微软杯IEEE中国学生论文大赛,银奖,排名1/1第一作者】,2009
——获奖论文:《Effective annotation and search for video blogs with integration of context and content analysis
[13] 宝钢教育基金,优秀学生奖,2009
[14] 中国科学院研究生院,三好学生标兵,2010

授权发明专利
[1]    一种基于可解释人工智能的实时入侵检测方法及系统. 2022.12.08, CN202211571092.X. 授权
[2]    基于对抗扰动的实时网络连接隐私保护方法和系统. 2022.06.01, CN202210622904.2.授权
[3]    基于优化元学习的轻量恶意软件流量检测方法及装置. 2022.05.18, CN2022105476786.6. 授权
[4]    基于直推图的加密流量识别与分类方法及系统. 2022.04.25, CN202210440703.0. 授权
[5]    基于图匹配的不同网络环境的加密流量分类方法及系统. 2022.04.15, CN202210397693.7. 授权
[6]    一种基于图结构信息交互增强的行为检测方法及电子装置. 2020.07.20, CN202010698168.X. 【授权】
[7]    一种基于自表达相关的数据分类方法和装置. 2018.12.12, CN201811518273.X. 【授权】
[8]    一种基于生成对抗网络的安全隐写方法和装置. 2017.08.08, CN201710670786.1. 【授权】
[9]    一种支持全局复杂检索的跨地域查询方法及系统. 2017.06.07, CN201710422561.4. 【授权】
[10] 一种针对多源异构数据的异源间相似性度量方法. 2016.06.17, CN201610439325.9. 【授权】
[11] 一种新鲜度敏感的大数据概要信息维护及聚合值查询方法. 2015.05.18, CN201510252988.5. 授权】
[12] 一种社交网络结构构建方法. 2015.01.30, CN201510050126.4. 授权】
[13] 一种已标注样本的维护方法及双向学习交互式分类方法. 2015.01.29, CN201510046891.9. 授权】
[14] 一种基于非确定主动学习的多分类器训练方法及分类方法. 2015.01.29, CN201510046879.8. 授权】
[15] 面向大数据环境的概要信息动态构建与查询方法及装置. 2015.02.05, CN201510061345.2. 授权】
[16] 一种提取地标性场景摘要的方法. 2009.12.16, CN200910242751.3. 授权】
[17] 一种交互式图像检索方法. 2007.08.29, CN200710121079.3. 授权】

论文专著

   
代表性期刊论文

CCF-A类:
[1]    Masked face transformer. IEEE Transactions on Information Forensics and Security (TIFS), 2024. 【第5作者CCF-A类期刊
[2]    Prism: real-time privacy protection against temporal network traffic analyzers. IEEE Transactions on Information Forensics and Security (TIFS), 2023. *通信作者,CCF-A类期刊】
[3]    Masked relation learning for deepfake detection. IEEE Transactions on Information Forensics and Security (TIFS), 2023. *通信作者,CCF-A类期刊】
[4]    StochasticFormer: stochastic modeling for weakly supervised temporal action localization. IEEE Transactions on Image Processing (TIP), 2023. *通信作者,CCF-A类期刊
[5]    Face forgery detection by 3d decomposition and composition search. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. 【第5作者CCF-A类期刊
[6]    ProGraph: robust network traffic identification with graph propagation. IEEE/ACM Transactions on Networking (ToN), 2022. *通信作者,CCF-A类期刊
[7]    Action shuffling for weakly supervised temporal localization. IEEE Transactions on Image Processing (TIP), 2022. 第一作者,CCF-A类期刊
[8]    Heterogeneous face recognition via face synthesis with identity-attribute disentanglement. IEEE Transactions on Information Forensics and Security (TIFS), 2022. *通信作者,CCF-A类期刊】
[9]    FA-GAN: face augmentation GAN for deformation-invariant face recognition. IEEE Transactions on Information Forensics and Security (TIFS), 2021. *通信作者,CCF-A类期刊】
[10] Context-aware local abnormality detection in crowded scene. Science China Information Sciences (SCIS), 2015. *通信作者,CCF-A类期刊】
CCF-B类:
[11] OW-TAL: learning unknown human activities for open-world temporal action localization. Pattern Recognition (PR), 2023. *通信作者,CCF-B类期刊
[12] Robust network traffic identification with graph matching. Computer Networks (COMNET), 2022. *通信作者,CCF-B类期刊
[13] DyGCN: efficient dynamic graph embedding with graph convolutional network. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022. 【第4作者CCF-B类期刊】
[14] SAPS: Self-Attentive Pathway Search for weakly-supervised action localization with background-action augmentation. Computer Vision and Image Understanding (CVIU), 2021. *通信作者,CCF-B类期刊】
[15] Weakly-supervised action localization via embedding-modeling iterative optimization. Pattern Recognition (PR), 2021. 第一作者,CCF-B类期刊
[16] Hashing nets for hashing: a quantized deep learning to hash framework for remote sensing image retrieval. IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2020. 【第4作者CCF-B类期刊
[17] AdapNet: adaptability decomposing encoder-decoder network for weakly supervised action recognition and localization. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020. 第一作者,CCF-B类期刊】
[18] Generative adversarial image super-resolution through deep dense skip connections. Computer Graphics Forum (CGF), 2018.*通信作者,CCF-B类期刊】
[19] A self-paced regularization framework for multi-label learning. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2018. 【第4作者CCF-B类期刊】
[20] Bidirectional active learning: a two-way exploration into unlabeled and labeled dataset. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2015.第一作者,CCF-B类期刊】
[21] Effective annotation and search for video blogs with integration of context and content analysis. IEEE Transactions on Multimedia (TMM), 2009.第一作者,CCF-B类期刊】
其它:
[22] TwinNet: twin structured knowledge transfer network for weakly supervised action localization. Machine Intelligence Research (MIR), 2022. 第一作者,SCI期刊
[23] Consistent sub-decision network for low-quality masked face recognition. Signal Processing Letters (SPL), 2022. 【第4作者CCF-C类期刊】
[24] Active semi-supervised learning based on self-expressive correlation with generative adversarial networks. Neurocomputing (NEUCOM), 2019. 第一作者,CCF-C类期刊】
[25] A novel framework for semantic segmentation with generative adversarial network. Journal of Visual Communication and Image Representation (JVCI), 2019. *通信作者,CCF-C类期刊】
[26] Deep convolutional representations and kernel extreme learning machines for image classification. Multimedia Tools and Applications (MTA), 2019.*通信作者,CCF-C类期刊】
[27] ListNet-based object proposals ranking. Neurocomputing (NEUCOM), 2017. *通信作者,CCF-C类期刊】
[28] Simultaneous Optimization for robust correlation estimation in partially observed social network. Neurocomputing (NEUCOM), 2016.第一作者,CCF-C类期刊】
[29] Weighted hierarchical geographic information description model for social relation estimation. Neurocomputing (NEUCOM), 2016. *通信作者,CCF-C类期刊】
[30] Update vs. upgrade: modeling with indeterminate multi-class active learning. Neurocomputing (NEUCOM), 2015.第一作者,CCF-C类期刊】
[31] Interactive Patent classification based on multi-classifier fusion and active learning. Neurocomputing (NEUCOM), 2014.第一作者,CCF-C类期刊】
[32] Personalized retrieval of sports video based on multi-modal analysis and user preference acquisition. Multimedia Tools and Applications (MTA), 2009. 【第3作者CCF-C类期刊】

代表性会议论文

CCF-A类:
[1]    Cross-architecture distillation for face recognition. In Proc. ACM International Conference on Multimedia (MM), 2023. *通信作者,CCF-A类会议
[2]    Rumor detection with diverse counterfactual evidence. In Proc. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2023. *通信作者,CCF-A类会议
[3]    Grouped knowledge distillation for deep face recognition. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2022. *通信作者,CCF-A类会议
[4]    Dynamic graph modeling for weakly-supervised temporal action localization. In Proc. ACM International Conference on Multimedia (MM), 2022. *通信作者,CCF-A类会议】
[5]    Multi-instance multi-label action recognition and localization based on spatio-temporal pre-trimming for untrimmed videos. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2020. 第一作者,CCF-A类会议
[6]    On deep unsupervised active learning. In Proc. International Joint Conference on Artificial Intelligence (IJCAI), 2020. 【第5作者CCF-A类会议
[7]    Dressing as a whole: outfit compatibility learning based on node-wise graph neural networks. In Proc. World Wide Web Conference (WWW), 2019. *通信作者,CCF-A类会议
[8]    Learning transferable self-attentive representations for action recognition in untrimmed videos with weak supervision. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2019. 第一作者,CCF-A类会议
[9]    Residual invertible spatio-temporal network for video super-resolution. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2019. *通信作者,CCF-A类会议
[10] Collaborative multi-view denoising. In Proc. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2016. 【第3作者CCF-A类会议】
[11] MC-HOG correlation tracking with saliency proposal. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2016. 【第4作者CCF-A类会议】
CCF-B类:
[12] MetaTKG: learning evolutionary meta-knowledge for temporal knowledge graph reasoning. In Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022. *通信作者,CCF-B类会议】
[13] Fi-GNN: modeling feature interactions via graph neural networks for CTR prediction. In Proc. ACM International Conference on Information and Knowledge Management (CIKM), 2019. *通信作者,CCF-B类会议
[14] Semi-supervised compatibility learning across categories for clothing matching. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2019. *通信作者,CCF-B类会议
[15] Compressing deep neural networks for efficient visual inference. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2017. *通信作者,CCF-B类会议】
[16] Supporting real-time analytic queries in big and fast data environments. In Proc. International Conference on Database Systems for Advanced Applications (DASFAA), 2017. 【第6作者CCF-B类会议】
[17] Multi-view multi-label active learning for image classification. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2009. 第一作者,CCF-B类会议】
[18] Automatic semantic annotation for video blogs. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2008. 第一作者,CCF-B类会议】
其它:
[19] Denoised dual-level contrastive network for weakly-supervised temporal sentence grounding. In Proc. Computational Visual Media Conference (CVM), 2024. *通信作者,CCF-C类会议
[20] Spoof-guided image decomposition for face anti-spoofing. In Proc. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 2023. 【第3作者CCF-C类会议】
[21] Modeling spoof noise by de-spoofing diffusion and its application in face anti-spoofing. In Proc. IEEE International Joint Conference on Biometrics (IJCB), 2023. 【第3作者CCF-C类会议】
[22] A glimpse of the whole: detecting few-shot android malware encrypted network traffic. In Proc. IEEE International Conferences on High Performance Computing and Communications (HPCC), 2022. *通信作者,CCF-C类会议】
[23] Malware classification based on semi-supervised learning. In Proc. International Conference on Science of Cyber Security (SciSec), 2022. *通信作者,CCF-C类会议】
[24] GBLNet: detecting intrusion traffic with multi-granularity BiLSTM. In Proc. International Conference on Computational Science (ICCS), 2022. *通信作者,IIE-B类会议】
[25] AMDetector: detecting large-scale and novel android malware traffic with meta-learning. In Proc. International Conference on Computational Science (ICCS), 2022. *通信作者,IIE-B类会议】
[26] Cyberbullying detection with side information: a real-world application of COVID-19 news comment in chinese language. In Proc. International Conference on Computational Science (ICCS), 2022. 【第2作者IIE-B类会议】
[27] Malware classification on imbalanced data through self-attention. In Proc. International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), 2020. 【第4作者CCF-C类会议】
[28] Weakly-supervised action recognition and localization via knowledge transfer. In Proc. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 2019. *通信作者,CCF-C类会议】
[29] Synchronized detection and recovery of steganographic messages with adversarial learning. In Proc. International Conference on Computational Science (ICCS), 2019. *共同一作,IIE-B类会议】
[30] A novel partition method for busy urban area based on spatial-temporal information. In Proc. International Conference on Computational Science (ICCS), 2019. 【第5作者IIE-B类会议】
[31] SegGAN: semantic segmentation with generative adversarial network. In Proc. International Conference on Multimedia Big Data (BigMM), 2018. *通信作者,EI会议
[32] Augmented self-paced learning with generative adversarial networks. In Proc. International Conference on Computational Science (ICCS), 2018. 第一作者,IIE-B类会议】
[33] Effective semi-supervised learning based on local correlation. In Proc. International Conference on Computational Science (ICCS), 2018. 第一作者,IIE-B类会议】
[34] Effective learning with joint discriminative and representative feature selection. In Proc. International Conference on Computational Science (ICCS), 2018. *通信作者,IIE-B类会议】
[35] A novel framework for image description generation. In Proc. Chinese Conference on Computer Vision (CCCV), 2017. *通信作者,EI会议,最佳论文提名奖
[36] SSGAN: secure steganography based on generative adversarial networks. In Proc. Pacific-Rim Conference on Multimedia (PCM), 2017. *通信作者,CCF-C类会议
[37] Discriminative learning from selective recommendation and its application in AdaBoost. In Proc. International Conference on Computational Science (ICCS), 2017. 第一作者,IIE-B类会议】
[38] Effective learning with 2-dimensional active selection on feature and instance. In Proc. International Conference on Computational Science (ICCS), 2017. 第一作者,IIE-B类会议】
[39] Retweeting behavior prediction using probabilistic matrix factorization. In Proc. IEEE Symposium on Computers and Communications (ISCC), 2016. *通信作者,CCF-C类会议】
[40] A markov random field approach to automated protocol signature inference. In Proc. EAI International Conference on Security and Privacy in Communication Networks (SecureComm), 2015. 【第5作者CCF-C类会议】
[41] Selective sampling based on dynamic certainty propagation for image retrieval. In Proc. International Multimedia Modeling Conference (MMM), 2008. 第一作者,CCF-C类会议】
[42] Weighted co-SVM for image retrieval with MVB strategy. In Proce. IEEE International Conference on Image Processing (ICIP), 2007. 第一作者,CCF-C类会议】

科研活动

   
主持项目

[1]    项目负责人:国家自然科学基金-面上项目,2024.01-2027.1251万元
[2]    课题负责人:基础科研计划-重大项目,2022.01-2025.12400万元(项目总经费2030万元)
[3]    课题负责人:国家发改委重大工程项目,2022.01-2023.127288.8万元
[4]    项目负责人:国家信息技术安全研究中心采购项目,2021.06-2021.12189万元
[5]    项目负责人:国家自然科学基金-联合基金项目-培育项目(NSFC-新疆联合基金),2021.01-2023.1258万元
[6]    项目负责人:中国科学技术发展战略研究院项目,2020.12-2021.1130万元
[7]    项目负责人:订购项目,2020.07-2020.12708万元
[8]    项目负责人:国家自然科学基金-面上项目,2019.01-2022.1261万元
[9]    项目负责人:模式识别国家重点实验室开放课题,2018.01-2019.124万元,
[10] 项目负责人:工程项目,2017.05-2018.04219万元
[11] 项目负责人:国家242信息安全计划,2016.06-2017.0580万元
[12] 项目负责人:国家自然科学基金-青年科学基金项目,2016.01-2018.1223.7万元
[13] 课题负责人:国家科技支撑计划,2015.04-2017.12172.2万元(项目总经费2361万元)
[14] 项目负责人:国家242信息安全计划,2014.06-2015.0510万元
[15] 项目负责人:中央级公益性科研院所基本科研业务费专项资金-重点工作,2011.07-2012.0658万元
[16] 项目负责人:中央级公益性科研院所基本科研业务费专项资金-重点工作,2010.07-2011.0680万元

指导学生


毕业研究生
[1]    张凯,2014普博(协助指导),信息安全,2018毕业
[2]    石海超,2017学硕/2020转博,网络空间安全,2022毕业
[3]    李泽坤,2018学硕,网络空间安全,2021毕业
[4]    邢剑,2018普博,网络空间安全,2022毕业
[5]    丁煜,2018普博,网络空间安全,2023毕业
[6]    杨梓铭,2020学硕,计算机应用技术,2023毕业
在读研究生

[1]    张亚如,2019学硕/2022转博,计算机应用技术
[2]    李文灏,2019学硕/2022转博,网络空间安全
[3]    夏雨微,2021直博,网络空间安全
[4]    赵唯松,2021直博,计算机应用技术
[5]    张斌,2021学硕,计算机应用技术
[6]    于艾靖,2022普博,计算机应用技术
[7]    童昭,2022普博,计算机应用技术
[8]    邢思雨,2022学硕,计算机应用技术
[9]    张凯薇,2022学硕,网络空间安全
[10] 徐文武,2022学硕,网络空间安全
[11] 戴光祥,2022学硕,网络空间安全
[12] 徐雨婷,2023普博,计算机应用技术
[13] 刘继鹏,2023直博,计算机应用技术
[14] 杨琛,2023专硕,电子信息

荣誉奖励

[1]    石海超:北京市科学技术协会青年人才托举工程,2024
[2]    石海超:北京图象图形学学会优秀博士论文提名奖,2023
[3]    石海超:朱李月华优秀博士生奖学金,2022
[4]    张亚如:国家奖学金,2021
[5]    石海超:国家奖学金,2019
[6]    张凯:中国科学院院长奖学金,2017
[7]    张凯:国家奖学金,2017