Staff profile

Homepage

Google  Scholar

YouTube

LinkedIn

Twitter

Github

Email

Dr Hubert P. H. Shum is an Associate Professor in Computer Science at Durham University researching on human-centric computer vision and graphics. Before this, he worked as the Director of Research/Associate Professor/Senior Lecturer at Northumbria University, and a Postdoctoral Researcher at RIKEN Japan. He received his PhD degree from the University of Edinburgh, his Master and Bachelor degrees from the City University of Hong Kong. To develop his team, he led research projects as the Principal Investigator awarded by EPSRC, the Ministry of Defence (DASA) and the Royal Society. This facilitated him to supervise more than 20 PhDs, recruit multiple Post-doctoral Researchers, and collaborate with international researchers from the UK, China, France, Japan and India. To engage the academic and industrial networks, he has chaired international conferences such as Pacific Graphics, BMVC, ACM SIGGRAPH/Eurographics SCA and ACM SIGGRAPH MIG. Contributing to the research community, he has served as an Associate Editor for Computer Graphics Forum, a Guest Editor for the International Journal of Computer Vision, and a Program Committee member in 15 conferences such as Eurographics, CVPR, Pacific Graphics. He has authored over 150 research publications in the fields of computer vision, computer graphics, machine learning and biomedical engineering, particularly focusing on the modelling of human-related data.

Research Interests: Computer Vision, Computer Graphics, Machine Learning, Biomedical Engineering

Joining Us

If you aspire to develop yourself and conduct high-quality research, do explore working with the team as a PhD student, a visiting/internship student, or an academic visitor. Dr Shum's team has a supportive culture with members coming from different countries. Past members have developed successful research and have enjoyed their vibrant lifes in the UK. See further information and application procedures.

Some self-funded PhD oppotunities include:

• Biomedical Engineering with Deep Learning based Video Analysis
• Computer Vision with Deep Learning for Human Data Modelling
• Deep Learning based Computer Graphics for Creating Virtual Characters

Recent Research

Research Grants

• Security Technology Research Innovation Grants Programme (Ref: 007CD), "Tracking Drones Across Different Platforms with Machine Vision", Principal Investigator
• Defence and Security Accelerator (Ref: DSTLX-1000140725), "D-FOCUS: Drone-FOrmation Control for countering future Unmanned aerial Systems", Principal Investigator
• GX Project Grants Scheme, "Wound Monitoring with Depth Cameras on Portable Systems", Principal Investigator
• Royal Society International Exchanges (Ref: IES\R2\181024), "Modelling Human Motion for Synthesis and Recognition with Deep Learning on Surface Features", Principal Investigator
• Royal Society International Exchanges (Ref: IE160609), "An Affective Smart Environment for Personalized Learning and Teaching", Principal Investigator
• Erasmus Mundus Action 2 Programme (Ref: 2014-0861/001-001), "Sustainable Green Economies through Learning, Innovation, Networking and Knowledge Exchange (gLink)", Northumbria University Funding Management Officer
• EPSRC (Ref: EP/M002632/1), "Interaction-based Human Motion Analysis", Principal Investigator

Available for media contact about:

• Computer Science: Graphics and animation
• Computer Science: Machine learning, computer vision
• Computer Science: Virtual reality, augmented reality

Conference Paper

• Leng, Zhiying, Chen, Jiaying, Shum, Hubert P.H., Li, Frederick W.B. & Liang, Xiaohui (Accepted), Stable Hand Pose Estimation under Tremor via Graph Neural Network, The IEEE Conference on Virtual Reality and 3D User Interfaces. Lisbon, IEEE.
• Li, Li, Shum, Hubert P. H. & Breckon, Toby P. (2023), Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentation, 2023 IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR). Vancouver, BC, IEEE.
• Qiao, Tanqiu, Men, Qianhui, Li, Frederick W. B., Kubotani, Yoshiki, Morishima, Shigeo & Shum, Hubert P. H. (2022), Geometric Features Informed Multi-person Human-object Interaction Recognition in Videos, Lecture Notes in Computer Science 13664: Computer Vision - ECCV 2022. Tel Aviv, Israel, Springer, 474-491.
• Zhang, Haozheng, Ho, Edmund, S. L., Zhang, Xiatian & Shum, Hubert P. H. (2022), Pose-based Tremor Classification for Parkinson’s Disease Diagnosis from Video, Lecture Notes in Computer Science 13434: MICCAI '22: The 25th International Conference on Medical Image Computing and Computer Assisted Intervention. Singapore, The MICCAI Society / Springer, 489-499.
• Feng, Qi, Shum, Hubert P. H. & Morishima, Shigeo (2022), 360 Depth Estimation in the Wild - The Depth360 Dataset and the SegFuse Network, IEEE Conference on Virtual Reality and 3D User Interfaces. Christchurch, New Zealand, IEEE.
• Chang, Ziyi, Koulieris, George A. & Shum, Hubert P.H. (2022), 3D Reconstruction of Sculptures from Single Images via Unsupervised Domain Adaptation on Implicit Models, ACM Symposium on Virtual Reality Software and Technology 2022. Japan, ACM.
• Zhou, Kanglei, Cheng, Zhiyuan, Shum, Hubert P. H., Li, Frederick W. B. & Liang, Xiaohui (2021), STGAE: Spatial-Temporal Graph Auto-Encoder for Hand Motion Denoising, 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). Bari, Italy, IEEE.

Journal Article

• Men, Qianhui, Ho, Edmond S.L., Shum, Hubert P.H. & Leung, Howard (2023). Focalized Contrastive View-invariant Learning for Self-supervised Skeleton-based Action Recognition. Neurocomputing 537: 198-209.
• Crosato, Luca, Shum, Hubert P. H., Ho, Edmund S. L. & Wei, Chongfeng (2023). Interaction-aware Decision-making for Automated Vehicles using Social Value Orientation. IEEE Transactions on Intelligent Vehicles 8(2): 1339-1349.
• Chen, Shuang, Atapour-Abarghouei, Amir, Ho, Edmond S. L. & Shum, Hubert P. H. (2023). INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network. Software Impacts
• Zhou, Kanglei, Cai, Ruizhi, Ma, Yue, Tan, Qingqing, Wang, Xinning, Li, Jianguo, Shum, Hubert P. H., Li, Frederick W. B., Jin, Song & Liang, Xiaohui (2023). A Video-Based Augmented Reality System for Human-in-the-Loop Muscle Strength Assessment of Juvenile Dermatomyositis. IEEE Transactions on Visualization and Computer Graphics
• Zhou, Kanglei, Ma, Yue, Shum, Hubert P. H. & Liang, Xiaohui (2023). Hierarchical Graph Convolutional Networks for Action Quality Assessment. IEEE Transactions on Circuits and Systems for Video Technology
• McCay, Kevin D., Hu, Pengpeng, Shum, Hubert P. H., Woo, Wai Lok, Marcroft, Claire, Embleton, Nicholas D., Munteanu, Adrian & Ho, Edmond S. L. (2022). A Pose-based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants. IEEE Transactions on Neural Systems and Rehabilitation Engineering 30: 8-19.
• Men, Qianhui, Ho, Edmond S. L. Shum, Hubert P. H. & Leung, Howard (2021). A Quadruple Diffusion Convolutional Recurrent Network for Human Motion Prediction. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 31(9): 3417-3432.
• Kar, Arindam, Pramanik, Sourav, Chakraborty, Arghya, Bhattacharjee, Debotosh, Ho, Edmond S. L. & Shum, Hubert P. H. (2020). LMZMPM: Local Modified Zernike Moment Per-unit Mass for Robust Human Face Recognition. IEEE Transactions on Information Forensics and Security 16: 495-509.
• Shen, Yijun, Yang, Longzhi, Ho, Edmond S. L. & Shum, Hubert P. H. (2020). Interaction-Based Human Activity Comparison. IEEE Transactions on Visualization and Computer Graphics 26(8): 2620.
• Hu, Shanfeng, Shum, Hubert, Aslam, Nauman, Li, Frederick W.B. & Liang, Xiaohui (2020). A Unified Deep Metric Representation for Mesh Saliency Detection and Non-rigid Shape Matching. IEEE Transactions on Multimedia 22(9): 2278-2292.
• Wang, He, Ho, Edmond S. L., Shum, Hubert P. H. & Zhu, Zhanxing (2019). Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling. IEEE Transactions on Visualization and Computer Graphics
• Rueangsirarak, Worasak, Zhang, Jingtian, Aslam, Nauman, Ho, Edmond S. L. & Shum, Hubert P. H. (2018). Automatic Musculoskeletal and Neurological Disorder Diagnosis With Relative Joint Displacement From Human Gait. IEEE Transactions on Neural Systems and Rehabilitation Engineering 26(12): 2387.
• Zhang, Jingtian, Shum, Hubert P. H., Han, Jungong & Shao, Ling (2018). Action Recognition From Arbitrary Views Using Transferable Dictionary Learning. IEEE Transactions on Image Processing 27(10): 4709.
• Zhang, Lining, Shum, Hubert P. H. & Shao, Ling (2017). Manifold Regularized Experimental Design for Active Learning. IEEE Transactions on Image Processing 26(2): 969.
• Zhang, Lining, Shum, Hubert & Shao, Ling (2016). Discriminative Semantic Subspace Analysis for Relevance Feedback. IEEE Transactions on Image Processing 1.
• Liu, Zhiguang, Zhou, Liuyang, Leung, Howard & Shum, Hubert P.H. (2016). Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models. IEEE Transactions on Visualization and Computer Graphics 22(11): 2437.
• Henry, Joseph, Shum, Hubert P. H. & Komura, Taku (2014). Interactive Formation Control in Complex Environments. IEEE Transactions on Visualization and Computer Graphics 20(2): 211.
• Shum, Hubert P. H., Ho, Edmond S. L., Jiang, Yang & Takagi, Shu (2013). Real-Time Posture Reconstruction for Microsoft Kinect. IEEE Transactions on Cybernetics 43(5): 1357.
• Shum, Hubert P.H., Komura, Taku & Yamazaki, Shuntaro (2012). Simulating Multiple Character Interactions with Collaborative and Adversarial Goals. IEEE Transactions on Visualization and Computer Graphics 18(5): 741.
• Shum, Hubert P. H., Komura, Taku, Shiraishi, Masashi & Yamazaki, Shuntaro (2008). Interaction patches for multi-character animation. ACM Transactions on Graphics 27(5): 1.