My research topics include first-person videos, image captioning, video question answering, federated learning and time series analysis. An up-to-date list is available on Google Scholar.

Selected Publicaitons

  • Chenyou Fan, Junjie Hu, Jianwei Huang. “Few-Shot Multi-Agent Perception with Ranking-Based Feature Learning.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. (TPAMI-23). [paper]

  • Xiangyang Liu, Yi Zhu, Tianqi Pang, Kui Xue, Xiaofan Zhang, Chenyou Fan. “Medical Document Embedding Enhancement with Heterogeneous Mixture-of-Experts.” IEEE International Conference on Bioinformatics and Biomedicine, 2024. (BIBM-2024)

  • Chenyou Fan, Hengyang Lu, Aimin Huang. “A Novel Differentiable Rank Learning Method Towards Stock Movement Quantile Forecasting.” European Conference on Artificial Intelligence (ECAI-2023). [pdf] [ppt]

  • Haiqi Jiang, Ying Ding, Rui Chen, Chenyou Fan. “Carbon Price Forecasting with LLM-based Refinement and Transfer-Learning.” International Conference on Artificial Neural Networks, 2024. (ICANN-2024) [pdf][[poster]][video]

  • Tianqi Pang, Kehui Tan, Yujun Yao, Xiangyang Liu, Chenyou Fan, Xiaofan Zhang. “Carbon Price Forecasting with LLM-based Refinement and Transfer-Learning.”
    International Joint Conference on Neural Networks (IJCNN-2024). [pdf]

  • Chenyou Fan, Haiqi Jiang, Aimin Huang, and Junjie Hu. “Trajectory prediction with contrastive pre-training and social rank fine-tuning.” International Conference on Neural Information Processing, 2023. (ICONIP-23). [pdf]

  • Xiangyang Liu, Tianqi Pang, Chenyou Fan. “Federated Prompting and Chain-of-Thought Reasoning for Improving LLMs Answering.” International Conference on Knowledge Science, Engineering and Management (KSEM-23). [paper]

  • Junjie Hu, Chenyou Fan, Xiyue Guo, Liguang Zhou, Tin Lun Lam. “Self-supervised Single-line LiDAR Depth Completion.” IEEE Robotics and Automation Letters (RA-L). [paper]

  • Tianqi Pang, Kehui Tan, Chenyou Fan. “Carbon Price Forecasting with Quantile Regression and Feature Selection.” International Conference on Data Mining and Knowledge Discovery (DMKD-23). [paper]

  • Heng-yang Lu, Chenyou Fan, others. “Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications.” International Conference on Computational Linguistics (COLING-22).

  • Chenyou Fan, Junjie Hu, Jianwei Huang. “Private Semi-Supervised Federated Learning.” 31st International Joint Conference on Artificial Intelligence (IJCAI’22, 15% acceptance rate). [pdf]

  • Chenyou Fan, Junjie Hu, Jianwei Huang. “Few-Shot Multi-Agent Perception.” 29th ACM International Conference on Multimedia 2021 (ACM MM’21, 27.9% acceptance rate) [pdf] [poster] [code]

  • Tianyi Lin, Chenyou Fan (co-first), Nhat Ho, Marco Cuturi, Michael I. Jordan. “Projection Robust Wasserstein Distance and Riemannian Optimization.” Conference on Neural Information Processing Systems (NeurIPS’20, spotlight, 20% acceptance rate, 3% spotlight rate) [pdf] [code]

  • Chenyou Fan, Ping Liu. “Federated Generative Adversarial Learning.” Chinese Conference on Pattern Recognition and Computer Vision (PRCV’20). [paper]

  • Chenyou Fan, Heng Huang. “Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answering.” IEEE Conference on Computer Vision and Pattern Recognition 2019 (CVPR’19, 25.2% acceptance rate) [paper] [code]

  • Chenyou Fan, Heng Huang. “Multi-Horizon Time Series Forecasting with Temporal Attention Learning.” SIGKDD Conference on Knowledge Discovery and Data Mining 2019 (KDD’19, 20% acceptance rate). [paper]

  • Chenyou Fan, Zehua Zhang, David J. Crandall. “DeepDiary: Lifelogging Image Captioning and Summarization.” 2018. Journal of Visual Communication and Image Representation. [paper]

  • Mingze Xu, Chenyou Fan, Yuchen Wang, Michael S. Ryoo, David J. Crandall. “Joint Person Segmentation and Identification in Synchronized First-and Third-person Videos.” European Conference on Computer Vision 2018 (ECCV’18). [project]

  • Chenyou Fan, Jangwon Lee, Mingze Xu, K.K. Singh, Y.J. Lee, David J. Crandall, Michael S. Ryoo. “Identifying first-person camera wearers in third-person videos.” IEEE Conference on Computer Vision and Pattern Recognition 2017 (CVPR’17, 29.0% acceptance rate). [pdf] [data & project page]

  • AJ Piergiovanni, Chenyou Fan, and Michael S. Ryoo. “Learning Latent Sub-events in Activity Videos Using Temporal Attention Filters.” the 31st AAAI Conference on Artificial Intelligence (AAAI), February 2017. [paper]

Tutorials

  • Chenyou Fan. “Survey of Convolutional Neural Network.” [pdf]

More Research Collaboration Work

  • Junjie Hu, Chenyou Fan, Hualie Jiang, Xiyue Guo, Yuan Gao, Xiangyong Lu, Tin Lun Lam. “Boosting LightWeight Depth Estimation Via Knowledge Distillation.” International Conference on Knowledge Science, Engineering and Management (KSEM-23). [pdf]

  • Junjie Hu, Chenyu Bao, Mete Ozay, Chenyou Fan, Qing Gao, Honghai Liu, Tin Lun Lam. “Deep Depth Completion from Extremely Sparse Data: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 2022-12. [pdf]

  • Chenyou Fan, Jianwei Huang. “Federated Few-Shot Learning with Adversarial Learning.” 19th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt ‘21). [pdf]

  • Hengyang Lu, Chenyou Fan. “Few-shot COVID-19 Rumor Detection for Online Social Media.” PeerJ Computer Science. [pdf]

  • Tianyi Lin, Chenyou Fan, Mengdi Wang, M.I.Jordan. “Improved Sample Complexity for Stochastic Compositional Variance Reduced Gradient.” American Control Conference 2020 (ACC’20). [pdf]

  • Mingze Xu, Chenyou Fan, John Paden, Geoffrey Fox, and David J. Crandall. “Multi-Task Spatiotemporal Neural Networks for Structured Surface Reconstruction.” IEEE Winter Conference on Applications of Computer Vision 2018 (WACV’18). [pdf]

  • Chenyou Fan. “EgoVQA - An Egocentric Video Question Answering Benchmark Dataset.” International Workshop on Egocentric Perception, Interaction and Computing (EPIC@ICCV), Octorber 2019. [pdf]

  • Chenyou Fan, Jangwon Lee and Michael S. Ryoo. “Forecasting Hand and Object Locations in Future Frames.” European Conference Workshop on Anticipating Human Behavior (AHB@ECCV), August 2018. [pdf]

  • Chenyou Fan and David J. Crandall. “Deepdiary: Automatically Captioning Lifelogging Image Streams.” European Conference Workshop on Egocentric Perception, Interaction, and Computing (EPIC@ECCV), October 2016. [pdf]