www.jimmyren.com
General Information
Publications
Some of My Previous Interns
Work Experience
Award and Certificate
|
Jimmy S. Ren 任思捷
Email: [email protected]
General Information
I am currently an Executive Research Director at SenseTime. I lead a cross-functional R&D team where engineers, scientists, product managers, system integrators work together to create high-impact A.I. products. I received my Ph.D. from Department of Information Systems at The City University of Hong Kong where I studied theories and applications of decision making in large scale social systems using machine learning. Prior to that, I spent a few years at Intel and Ericsson (E///) as a software engineer.
My CV
Find me on linkedin
News
-> 07/2024: 1 paper accepted to ACMMM 2024.
-> 02/2024: 1 paper accepted to CVPR 2024.
-> 10/2023: 1 paper accepted to IJCV.
-> 10/2023: 1 paper accepted to TPAMI.
-> 02/2023: 1 paper accepted to CVPR 2023.
Publications [Google Scholar Page]
My research interests are Computational Photography, Computational Imaging, Image/Signal Processing. I am also interested in using machine learning and deep learning methods in these areas.
|
|
Date |
Topic |
 |
[65] "Color4E: Event Demosaicing for Full-color Event Guided Image Deblurring",
Yi Ma, Peiqi Duan, Yuchen Hong, Chu Zhou, Yu Zhang, Jimmy S. Ren, Boxin Shi
ACM Multimedia Conference (ACMMM 2024).
paper |
2024 |
Event Camera |
 |
[64] "Latency Correction for Event-guided Deblurring and Frame Interpolation",
Yixin Yang, Jinxiu Liang, Bohan Yu, Yan Chen, Jimmy S. Ren, Boxin Shi
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024).
paper |
2024 |
Event Camera |
 |
[63] "Deep Richardson-Lucy Deconvolution for Low-Light Image Deblurring",
Liang Chen, Jiawei Zhang, Zhenhua Li, Yunxuan Wei, Faming Fang, Jimmy S. Ren, Jinshan Pan
International Journal of Computer Vision (IJCV).
paper |
2024 |
Comp. Photography |
 |
[62] "Reliable Event Generation With Invertible Conditional Normalizing Flow",
Daxin Gu, Jia Li, Lin Zhu, Yu Zhang, Jimmy S. Ren
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper |
2024 |
Event Camera |
 |
[61] "Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA",
Xun Wu, Yaqi Wu, Jiawei Zhang, Feng Zhang, Jimmy S. Ren
IEEE International Conference on Image Processing (ICIP 2023).
paper |
2023 |
Comp. Photography |
 |
[60] "Range-nullspace Video Frame Interpolation with Focalized Motion Estimation",
Zhiyang Yu, Yu Zhang, Dongqing Zou, Xijun Chen, Jimmy S. Ren, Shunqing Ren
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2023).
paper project code |
2023 |
Deep Learning |
 |
[59] "Self-Supervised Intensity-Event Stereo Matching",
Jinjin Gu, Jinan Zhou, Ringo SaiWo Chu, Yan Chen, Jiawei Zhang, Xuanye Cheng, Song Zhang, Jimmy S. Ren
Electronic Imaging 2023 (JIST-First Issue of the Journal of Imaging Science and Technology) (EI 2023).
paper project code |
2023 |
Event Camera |
 |
[58] "Deep Bayesian Video Frame Interpolation",
Zhiyang Yu, Yu Zhang, Xujie Xiang, Dongqing Zou, Xijun Chen, Jimmy S. Ren
European Conference on Computer Vision (ECCV 2022).
paper code |
2022 |
Deep Learning |
 |
[57] "Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline",
Guocheng Qian, Yuanhao Wang, Jinjin Gu, Chao Dong, Wolfgang Heidrich, Bernard Ghanem, Jimmy S. Ren
International Conference on Computational Photography (ICCP 2022).
paper project |
2022 |
Comp. Photography |
 |
[56] "Image Deblurring Aided by Low-Resolution Events",
Zhouxia Wang, Jimmy S. Ren, Jiawei Zhang, Ping Luo
Electronics 11(4), 631 (Electronics).
paper |
2022 |
Event Camera |
 |
[55] "Learning Spatially Variant Linear Representation Models for Joint Filtering",
Jiangxin Dong, Jinshan Pan, Jimmy S. Ren, Liang Lin, Jinghui Tang, Ming-Hsuan Yang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper |
2021 |
Comp. Photography |
 |
[54] "Bringing Events into Video Deblurring with Non-consecutively Blurry Frames",
Wei Shang, Dongwei Ren, Dongqing Zou, Jimmy S. Ren, Ping Luo, Wangmeng Zuo
International Conference on Computer Vision (ICCV 2021).
paper code
|
2021 |
Event Camera |
 |
[53] "Training Weakly Supervised Video Frame Interpolation with Events",
Zhiyang Yu, Deyuan Liu, Yu Zhang, Dongqing Zou, Xijun Chen, Yebin Liu, Jimmy S. Ren
International Conference on Computer Vision (ICCV 2021).
paper code |
2021 |
Event Camera |
 |
[52] "A New Journey from SDRTV to HDRTV",
Xiangyu Chen, Zhengwen Zhang, Jimmy S. Ren, Lynhoo Tian, Yu Qiao, Chao Dong
International Conference on Computer Vision (ICCV 2021).
paper code |
2021 |
Deep Learning |
 |
[51] "Low-dose CT Denoising Using a Structure-Preserving Kernel Prediction Network",
Lu Xu, Yuwei Zhang, Ying Liu, Daoye Wang, Mu Zhou, Jimmy S. Ren, Jingwei Wei, Zhaoxiang Ye
IEEE International Conference on Image Processing (ICIP 2021).
paper code |
2021 |
Comp. Photography |
 |
[50] "Deep Dynamic Scene Deblurring from Optical Flow",
Jiawei Zhang, Jinshan Pan, Daoye Wang, Shangchen Zhou, Xing Wei, Furong Zhao, Jianbo Liu, Jimmy S. Ren,
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT).
paper |
2021 |
Comp. Photography |
|
[49] "Learning a Non-blind Deblurring Network for Night Blurry Images",
Liang Chen, Jiawei Zhang, Jinshan Pan, Songnan Lin, Faming Fang, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021).
paper |
2021 |
Comp. Photography |
 |
[48] "Blind Deblurring for Saturated Images",
Liang Chen, Jiawei Zhang, Songnan Lin, Faming Fang, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021).
paper |
2021 |
Comp. Photography |
 |
[47] "Deblurring Dynamic Scenes via Spatially Varying Recurrent Neural Networks",
Wenqi Ren, Jiawei Zhang, Jinshan Pan, Sifei Liu, Jimmy S. Ren, Junping Du, Xiaochun Cao, Ming-Hsuan Yang,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper |
2021 |
Comp. Photography |
 |
[46] "Efficient Deep Image Denoising via Class Specific Convolution",
Lu Xu, Jiawei Zhang, Xuanye Cheng, Feng Zhang, Xing Wei, Jimmy S. Ren,
Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21).
paper poster |
2021 |
Comp. Photography |
 |
[45] "Cross-spectral Stereo Matching for Facial Disparity Estimation in The Dark",
Songnan Lin, Jiawei Zhang, Jing Chen, Yongtian Wang, Yicun Liu, Jimmy S. Ren,
Computer Vision and Image Understanding, Volume 200, 103046 (CVIU 2020).
paper |
2020 |
3D & Stereo |
 |
[44] "Learning to See in the Dark with Events",
Song Zhang, Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy S. Ren, Bin Zhou,
European Conference on Computer Vision (ECCV 2020).
paper |
2020 |
Event Camera |
 |
[43] "Learning Event-Driven Video Deblurring and Interpolation",
Songnan Lin, Jiawei Zhang, Zhe Jiang, Dongqing Zou, Jinshan Pan, Yongtian Wang, Jing Chen, Jimmy S. Ren,
European Conference on Computer Vision (ECCV 2020).
paper code |
2020 |
Event Camera |
 |
[42] "PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration",
Jinjin Gu, Haoming Cai, Haoyu Chen, Xiaoxing Ye, Jimmy S. Ren, Chao Dong,
European Conference on Computer Vision (ECCV 2020).
paper dataset |
2020 |
Comp. Photography |
 |
[41] "Learning to Predict Context-adaptive Convolution for Semantic Segmentation",
Jianbo Liu, Junjun He, Yu Qiao, Jimmy S. Ren, Hongsheng Li,
European Conference on Computer Vision (ECCV 2020).
paper |
2020 |
Deep Learning |
 |
[40] "EfficientFCN: Holistically-guided Decoding for Semantic Segmentation",
Jianbo Liu, Junjun He, Jiawei Zhang, Jimmy S. Ren, Hongsheng Li,
European Conference on Computer Vision (ECCV 2020).
paper |
2020 |
Deep Learning |
 |
[39] "Visually Imbalanced Stereo Matching",
Yicun Liu, Jimmy S. Ren, Jiawei Zhang, Jianbo Liu, Mude Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper code |
2020 |
3D & Stereo |
 |
[38] "Learning Event-Based Motion Deblurring",
Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy S. Ren, Jiancheng Lv, Yebin Liu,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper |
2020 |
Event Camera |
 |
[37] "Learning a Reinforced Agent for Flexible Exposure Bracketing Selection",
Zhouxia Wang, Jiawei Zhang, Mude Lin, Jiong Wang, Ping Luo, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper code |
2020 |
Comp. Photography |
 |
[36] "Physics-Based Generative Adversarial Models for Image Restoration and Beyond",
Jinshan Pan, Jiangxin Dong, Yang Liu, Jiawei Zhang, Jimmy S. Ren, Jinhui Tang, Yu-Wing Tai, Ming-Hsuan Yang,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
project paper |
2020 |
Comp. Photography |
 |
[35] "Very Power Efficient Neural Time-of-Flight",
Yan Chen, Jimmy S. Ren, Xuanye Cheng, Keyuan Qian, Luyang Wang, Jinwei Gu,
IEEE Winter Conference on Applications of Computer Vision (WACV 2020).
paper |
2020 |
Comp. Photography |
 |
[34] "Self-Guided Novel View Synthesis via Elastic Displacement Network",
Yicun Liu, Jiawei Zhang, Ye Ma, Jimmy S. Ren,
IEEE Winter Conference on Applications of Computer Vision (WACV 2020).
paper |
2020 |
3D & Stereo |
 |
[33] "Image Formation Model Guided Deep Image Super-Resolution",
Jinshan Pan, Deqing Sun, Yang Liu, Jimmy S. Ren, Ming-Ming Cheng, Jian Yang, Jinhui Tang,
The 34th AAAI Conference on Artificial Intelligence (AAAI-20).
paper |
2020 |
Comp. Photography |
 |
[32] "Learning to Deblur Face Images via Sketch Synthesis",
Songnan Lin, Jiawei Zhang, Jinshan Pan, Yicun Liu, Yongtian Wang, Jing Chen, Jimmy S. Ren,
The 34th AAAI Conference on Artificial Intelligence (AAAI-20).
paper |
2020 |
Comp. Photography |
 |
[31] "Generalizing Monocular 3D Human Pose Estimation in the Wild",
Luyang Wang, Yan Chen, Zhenhua Guo, Keyuan Qian, Mude Lin, Hongsheng Li, Jimmy S. Ren,
International Conf. on Computer Vision - Workshop on Geometry Meets Deep Learning (ICCVW 2019).
paper code data |
2019 |
3D & Stereo |
 |
[30] "Spatio-Temporal Filter Adaptive Network for Video Deblurring",
Shangchen Zhou, Jiawei Zhang, Jinshan Pan, Haozhe Xie, Wangmeng Zuo, Jimmy S. Ren,
International Conference on Computer Vision (ICCV 2019).
paper project |
2019 |
Comp. Photography |
 |
[29] "Dual Student: Breaking the Limits of Teacher in Semi-supervised Learning",
Zhanghan Ke, Daoye Wang, Qiong Yan Jimmy S. Ren, Rynson Lau,
International Conference on Computer Vision (ICCV 2019).
paper code |
2019 |
Deep Learning |
 |
[28] "Learning Deep Priors for Image Dehazing",
Yang Liu, Jinshan Pan, Jimmy S. Ren, Zhixun Su,
International Conference on Computer Vision (ICCV 2019).
paper |
2019 |
Comp. Photography |
|
[27] "Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution",
Guocheng Qian, Jinjin Gu, Jimmy S. Ren, Chao Dong, Furong Zhao, Juan Lin,
arxiv prepints 1905.02538.
paper code dataset |
2019 |
Comp. Photography |
 |
[26] "DAVANet: Stereo Deblurring with View Aggregation",
Shangchen Zhou, Jiawei Zhang, Wangmeng Zuo, Haozhe Xie, Jinshan Pan, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019) - oral.
paper project data |
2019 |
Comp. Photography |
 |
[25] "Structure-Preserving Stereoscopic View Synthesis with Multi-Scale Adversarial Correlation Matching",
Yu Zhang, Dongqing Zou, Jimmy S. Ren, Zhe Jiang, Xiaohao Chen,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019).
paper |
2019 |
3D & Stereo |
 |
[24] "Spatially Variant Linear Representation Models for Joint Filtering",
Jinshan Pan, Jiangxin Dong, Jimmy S. Ren, Liang Lin, Jinhui Tang, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019).
paper |
2019 |
Comp. Photography |
 |
[23] "DSR: Direct Self-rectification for Uncalibrated Dual-lens Cameras",
Ruichao Xiao, Wenxiu Sun, Jiahao Pang, Qiong Yan, Jimmy S. Ren,
International Conference on 3D Vision (3DV 2018).
paper code |
2018 |
3D & Stereo |
 |
[22] "Learning Monocular Depth by Distilling Cross-domain Stereo Networks",
Xiaoyang Guo, Hongsheng Li, Shuai Yi, Jimmy S. Ren, Xiaogang Wang,
European Conference on Computer Vision (ECCV 2018).
paper code video |
2018 |
3D & Stereo |
 |
[21] "Learning Selfie-Friendly Abstraction from Artistic Style Images",
Yicun Liu, Jimmy S. Ren, Jianbo Liu, Jiawei Zhang, Xiaohao Chen,
The 10th Asian Conference on Machine Learning (ACML 2018).
paper code video |
2018 |
Comp. Photography |
 |
[20] "Deep Reasoning with Knowledge Graph for Social Relationship Understanding",
Zhouxia Wang, Tianshui Chen, Jimmy S. Ren, Weihao Yu, Hui Cheng, Liang Lin,
The 27th International Joint Conference on Artificial Intelligence (IJCAI 2018).
paper code |
2018 |
Deep Learning |
 |
[19] "Single View Stereo Matching",
Yue Luo, Jimmy S. Ren, Mude Lin, Jiahao Pang, Wenxiu Sun, Hongsheng Li, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018) - spotlight.
paper project code video |
2018 |
3D & Stereo |
 |
[18] "Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks",
Jiawei Zhang, Jinshan Pan, Jimmy S. Ren, Yibing Song, Linchao Bao, Rynson Lau, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018) - spotlight.
paper code |
2018 |
Comp. Photography |
 |
[17] "3D Human Pose Estimation in the Wild by Adversarial Learning",
Wei Yang, Wanli Ouyang, Xiaolong Wang, Jimmy S. Ren, Hongsheng Li, Xiaogang Wang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper video |
2018 |
3D & Stereo |
 |
[16] "LSTM Pose Machines",
Yue Luo, Jimmy S. Ren, Zhouxia Wang, Wenxiu Sun, Jinshan Pan, Jianbo Liu, Jiahao Pang, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper project code |
2018 |
Deep Learning |
 |
[15] "Zoom and Learn: Generalizing Deep Stereo Matching to Novel Domains",
Jiahao Pang, Wenxiu Sun, Chengxi Yang, Jimmy S. Ren, Ruichao Xiao, Jin Zeng, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper |
2018 |
3D & Stereo |
 |
[14] "Learning Dual Convolutional Neural Networks for Low-Level Vision",
Jinshan Pan, Sifei Liu, Deqing Sun, Jiawei Zhang, Yang Liu, Jimmy S. Ren, Zechao Li, Jinhui Tang, Huchuan Lu, Yu-Wing Tai, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper project code |
2018 |
Comp. Photography |
 |
[13] "Cascade Residual Learning: A Two-stage Convolutional Neural
Network for Stereo Matching",
Jiahao Pang, Wenxiu Sun, Jimmy S. Ren, Chengxi Yang, Qiong Yan,
International Conf. on Computer Vision - Workshop on Geometry Meets Deep Learning (ICCVW 2017)
paper Ranked 1st in KITTI Stereo Evaluation 2015 code |
2017 |
3D & Stereo |
 |
[12] "Robust Tracking Using Region Proposal Networks",
Jimmy S. Ren, Zhiyang Yu, Jianbo Liu, Rui Zhang, Wenxiu Sun, Jiahao Pang, Xiaohao Chen, Qiong Yan,
arxiv 1705.10447 (2017)
paper code |
2017 |
Deep Learning |
 |
[11] "Accurate Single Stage Detector Using Recurrent Rolling Convolution",
Jimmy S. Ren, Xiaohao Chen, Jianbo Liu, Wenxiu Sun, Jiahao Pang, Qiong Yan, Yu-Wing Tai, Li Xu,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).
paper code KITTI ranking |
2017 |
Deep Learning |
 |
[10] "Look, Listen and Learn - A Multimodal LSTM for Speaker Identification",
Jimmy S. Ren, Yongtao Hu, Yu-Wing Tai, Chuan Wang, Li Xu, Wenxiu Sun, Qiong Yan,
The 30th AAAI Conference on Artificial Intelligence (AAAI-16). (oral)
paper code |
2016 |
Deep Learning |
 |
[9] "Shepard Convolutional Neural Networks",
Jimmy S. Ren, Li Xu, Qiong Yan, Wenxiu Sun,
Advances in Neural Information Processing Systems (NeurIPS 2015).
paper code |
2015 |
Comp. Photography |
 |
[8] "Deep Edge-Aware Filters",
Li Xu, Jimmy S. Ren, Qiong Yan, Renjie Liao, Jiaya Jia,
The 32nd International Conference on Machine Learning (ICML 2015).
paper project code poster video |
2015 |
Comp. Photography |
 |
[7] "Deep Multimodal Speaker Naming",
Yongtao Hu, Jimmy S. Ren, Jingwen Dai, Chang Yuan, Li Xu, Wenping Wang,
The 23rd ACM International Conference on Multimedia (MM 2015).
paper project code dataset video |
2015 |
Deep Learning |
 |
[6] "On Vectorization of Deep Convolutional Neural Networks for Vision Tasks",
Jimmy S. Ren and Li Xu,
The 29th AAAI Conference on Artificial Intelligence (AAAI-15).
paper code |
2015 |
Deep Learning |
 |
[5] "Deep Convolutional Neural Network for Image Deconvolution",
Li Xu, Jimmy S. Ren, Ce Liu, Jiaya Jia,
Advances in Neural Information Processing Systems (NeurIPS 2014).
paper poster project |
2014 |
Comp. Photography |
 |
[4] "The Process of Information Propagation along a Traffic Stream through Inter-vehicle Communication",
Wei Wang, Stephen Liao, Xin Li, Jimmy S. Ren,
IEEE Transaction on Intelligent Transportation Systems (IEEE TITS), 15(1), 345-354.
paper |
2014 |
Modelling |
 |
[3] "Exploring The Contribution of Unlabeled Data in Financial Sentiment Analysis",
Jimmy S. Ren, Wei Wang, Jiawei Wang, Stephen Liao,
The 27th AAAI Conference on Artificial Intelligence (AAAI-13).
paper data |
2013 |
Deep Learning |
 |
[2] "An Unsupervised Feature Learning Approach to Improve Automatic Incident Detection",
Jimmy S. Ren, Wei Wang, Jiawei Wang, Stephen Liao,
The 15th IEEE International Conference on Intelligent Transportation Systems (ITSC 2012).
paper
|
2012 |
Deep Learning |
 |
[1] "Optimal Refactoring Policy for Agile Information Systems Maintenance: A Control Theoretic Approach",
Jimmy S. Ren, Wei Wang, Zhimin Hua, Kaiquan Xu, Stephen Liao,
The 32nd International Conference on Information Systems (ICIS 2011).
paper
|
2011 |
Modelling |
Some of My Previous Interns
| Name |
|
Next Position |
| Yue Luo |
2017-2018 |
MSc student in Columbia University |
| Yicun Liu |
2017-2018 |
MSc student in Columbia University |
| Fangjun Zhang |
2017-2018 |
MSc student in New York University |
| Ziqi Chen |
2018 |
MSc student in Carnegie Mellon University |
| Danlei Zhu |
2018 |
PhD student in Carnegie Mellon University |
| Zhengyang Xia |
2018 |
MSc student in Carnegie Mellon University |
| Cheng-Tsung Liu |
2018 |
MSc student in University of Southern California |
| Guocheng Qian |
2018-2019 |
MSc student in King Abdullah Univ. of Sci. and Technology |
| Jinjin Gu |
2018-2019 |
PhD student in University of Sydney |
| Daoye Wang |
2018-2019 |
MSc student in ETH Zurich |
| Lu Xu |
2019-2020 |
MSc student in Carnegie Mellon University |
| Jinan Zhou |
2020-2021 |
MSc student in Carnegie Mellon University |
Work Experience
Senior Research Scientist, SenseTime Hong Kong (2015-now)
Research Engineer, Lenovo Labs Hong Kong (2013-2015)
Software Engineer, Ericsson China R&D (2006-2009)
Intern, Intel Asia Pacific R&D center (2006)
Research assistant, School of Software, Fudan University (2006)
Award and Certificate
SenseTime Research Dean's project list (2020)
First Prize of Lenovo Research Idea Platform (2015)
Best new employee, Lenovo Group Limited (2014)
Best performance of the year, Ericsson China R&D center (2008)
Certified Scrum Master (CSM) (2008)
Best performance (intern), Intel Asia Pacific R&D center (2006)
First class scholarship award of ECNU (2006)
|
