Skip to main content
Overview

Dr Hubert P. H. Shum

Associate Professor

SMIEEE, FHEA, PhD, PGCert, MSc, BEng (Hons)


Affiliations
AffiliationRoom numberTelephone
Associate Professor in the Department of Computer ScienceMCS 2111+44 (0) 191 33 42724

Biography

Dr Hubert P. H. Shum is an Associate Professor in Computer Science at Durham University. Before this, he worked as the Director of Research/Associate Professor/Senior Lecturer at Northumbria University, and a Postdoctoral Researcher at RIKEN Japan. He received his PhD degree from the University of Edinburgh, his Master and Bachelor degrees from the City University of Hong Kong. To develop his team, he led research projects as the Principal Investigator awarded by EPSRC, the Ministry of Defence (DASA) and the Royal Society. This facilitated him to supervise more than 20 PhDs, recruit multiple Post-doctoral Researchers, and collaborate with international researchers from the UK, China, France, Japan and India. He led his team in hosting important conferences such as BMVC and ACM SIGGRAPH Conference on MIG to engage the academic and industry networks. Contributing to the research community, he has served as an Associate Editor for Computer Graphics Forum, a Guest Editor for the International Journal of Computer Vision, and a Program Committee member in 15 conferences such as CVPR, Eurographics, Pacific Graphics. He has published over 100 research papers in the fields of computer vision, computer graphics, motion analysis and machine learning, particularly focusing on the modelling of human-related data.

Research Interests: Computer Vision, Computer Graphics, Motion Analysis, Machine Learning

 

Joining Us

If you aspire to develop yourself and conduct high-quality research, do explore working with the team as a PhD student, a visiting/internship student, or an academic visitor. Dr Shum's team has a supportive culture with members coming from different countries. Past members have developed successful research and have enjoyed their vibrant lifes in the UK. See further information and application procedures.

Some self-funded PhD oppotunities include:

 

Recent Research Grants

 

Media Contacts

Available for media contact about:

  • Computer Science: Graphics and animation
  • Computer Science: Machine learning, computer vision
  • Computer Science: Virtual reality, augmented reality

Publications

Chapter in book

  • Plantard, Pierre, Shum, Hubert P. H. & Multon, Franck (2019). Motion Analysis of Work Conditions using Commercial Depth Cameras in Real Industrial Conditions. In DHM and Posturography. Academic Press. 673-682.
  • Li, Jie, Qu, Yanpeng, Chao, Fei, Shum, Hubert P. H., Ho, Edmond S. L. & Yang, Longzhi (2019). Machine Learning Algorithms for Network Intrusion Detection. In AI in Cybersecurity. Cham: Springer International Publishing. 151-179.
  • Shen, Yijun, Zhang, Jingtian, Yang, Longzhi & Shum, Hubert P. H. (2016). Depth Sensor based Facial and Body Animation Control. In Handbook of Human Motion. Cham: Springer International Publishing.

Conference Paper

  • Leng, Zhiying,, Chen, Jiaying,, Shum, Hubert, P.H.,, Li, Frederick, W.B., & Liang, Xiaohui, (Accepted), Stable Hand Pose Estimation under Tremor via Graph Neural Network, The IEEE Conference on Virtual Reality and 3D User Interfaces. Lisbon, IEEE.
  • Organisciak, Daniel, Ho, Edmond S. L. & Shum, Hubert P. H. (Forthcoming), Makeup Style Transfer on Low-quality Images with Weighted Multi-scale Attention, 25th International Conference on Pattern Recognition (ICPR 2020). Milan, Italy, IEEE.
  • Men, Qianhui Hoy, Edmond S. L. Shum, Hubert P. H. & Leung, Howard (Forthcoming), A Two-Stream Recurrent Network for Skeleton-based Human Interaction Recognition, 25th International Conference on Pattern Recognition (ICPR 2020). Milan, Italy, IEEE.
  • Isaac-Medina, Brian K. S., Poyser, Matthew, Organisciak, Daniel, Willcocks, Chris G., Breckon, Toby P. & Shum, Hubert P. H. (2021), Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark, ICCVW '21. Virtual, Computer Vision Foundation.
  • Zhou, Kanglei, Cheng, Zhiyuan, Shum, Hubert P. H., Li, Frederick W. B. & Liang, Xiaohui (2021), STGAE: Spatial-Temporal Graph Auto-Encoder for Hand Motion Denoising, IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2021. Bari, Italy, IEEE.
  • Rainbow, Ben A., Men, Qianhui & Shum, Hubert P. H. (2021), Semantics-STGCNN: A Semantics-guided Spatial-Temporal Graph Convolutional Network for Multi-class Trajectory Prediction, IEEE SMC 2021. Melbourne / Virtual, IEEE.
  • Crosato, Luca, Wei, Chongfeng, Ho, Edmond S. L. & Shum, Hubert P. H. (2021), Human-centric Autonomous Driving in an AV-Pedestrian Interactive Environment Using SVO, IEEE ICHMS 2021 - 2nd IEEE International Conference on Human-Machine Systems. Magdeburg / Virtual, IEEE.
  • Feng, Qi, Shum, Hubert P. H. & Morishima, Shigeo (2021), Bi-projection-based Foreground-aware Omnidirectional Depth Prediction, Visual Computing 2021. Online.
  • Zhu, Manli, Men, Qianhui, Ho, Edmond S. L., Leung, Howard & Shum, Hubert P. H. (2021), Interpreting Deep Learning based Cerebral Palsy Prediction with Channel Attention, IEEE International Conference on Biomedical and Health Informatics (BHI'21). IEEE.
  • Nozawa, Naoki, Shum, Hubert P. H., Ho, Edmond S. L. & Morishima, Shigeo (2020), Single Sketch Image based 3D Car Shape Reconstruction with Deep Learning and Lazy Learning, GRAPP '20 Proceedings of the 2020 International Conference on Computer Graphics Theory and Applications. SciTePress, 179-190.
  • Hu, Shanfeng, Shum, Hubert P. H. & Mucherino, Antonio (2019), DSPP: Deep Shape and Pose Priors of Humans, MIG '19 Proceedings of the 2019 International Conference on Motion in Games. New York, NY, USA, ACM, 1:1-1:6.
  • Zhang, Jingtian, Shum, Hubert P. H., McCay, Kevin & Ho, Edmond S. L. (2019), Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN, MIG '19 Proceedings of the 2019 International Conference on Motion in Games. New York, NY, USA, ACM, 44:1-44:2.
  • Shum, Hubert P. H., Ho, Edmond S. L., Cani, Marie-Paule, Popa, Tiberiu, Holden, Daniel & Wang, He (2019), MIG '19: Motion, Interaction and Games, MIG '19 Proceedings of the 2019 International Conference on Motion, Interaction and Games. New York, NY, USA, ACM.
  • Iwamoto, Naoya, Shum, Hubert P. H., Asahina, Wakana & Morishima, Shigeo (2019), Automatic Sign Dance Synthesis from Gesture-based Sign Language, MIG '19 Proceedings of the 2019 International Conference on Motion in Games. New York, NY, USA, ACM, 18:1-18:9.
  • Sakkos, Dimitrios, Shum, Hubert P. H. & Ho, Edmond S. L. (2019), Illumination-based Data Augmentation for Robust Background Subtraction, SKIMA '19 Proceedings of the 2018 International Conference on Software Knowledge Information Management and Applications. IEEE.
  • Hall, Jake, Chan, Jacky C. P., Shum, Hubert P. H. & Ho, Edmond S. L. (2019), An Interactive Motion Analysis Framework for Diagnosing and Rectifying Potential Injuries Caused Through Resistance Training, MIG '19 Proceedings of the 2019 International Conference on Motion in Games. New York, NY, USA, ACM, 39:1-39:2.
  • Nozawa, Naoki, Shum, Hubert P. H., Ho, Edmond S. L. & Morishima, Shigeo (2019), 3D Car Shape Reconstruction from a Single Sketch Image, MIG '19 Proceedings of the 2019 International Conference on Motion in Games. New York, NY, USA, ACM, 37:1-37:2.
  • Feng, Qi, Shum, Hubert P. H. & Morishima, Shigeo (2018), Occlusion for 3D Object Manipulation with Hands in Augmented Reality, MIRU '18 Proceedings of the 2018 Meeting on Image Recognition and Understanding.
  • Flinton, Christopher, Anderson, Philip, Shum, Hubert P. H. & Ho, Edmond S. L. (2018), NETIVAR: NETwork Information Visualization based on Augmented Reality, SKIMA '18 Proceedings of the 2018 International Conference on Software Knowledge Information Management and Applications. IEEE, 1-8.
  • Stef, Andreea, Perera, Kaveen, Shum, Hubert P. H. & Ho, Edmond S. L. (2018), Synthesizing Expressive Facial and Speech Animation by Text-to-IPA Translation with Emotion Control, SKIMA '18 Proceedings of the 2018 International Conference on Software Knowledge Information Management and Applications. IEEE, 1-8.
  • Zuo, Zheming, Organisciak, Daniel, Shum, Hubert P. H. & Yang, Longzhi (2018), Saliency-Informed Spatio-Temporal Vector of Locally Aggregated Descriptors and Fisher Vectors for Visual Action Recognition, IAHFAR '18 Proceedings of the 2018 British Machine Vision Conference Workshop on Image Analysis for Human Facial and Activity Recognition.
  • Rueangsirarak, Worasak, Kaewkaen, Kitchana & Shum, Hubert P. H. (2018), Identifying Abnormal Gait in Older People during Multiple-Tasks Assessment with Audio-Visual Cues, ECTI-CON '18 Proceedings of the 2018 International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology. IEEE, 780-783.
  • Ho, Edmond S. L., McCay, Kevin David, Shum, Hubert P. H., Yang, Longzhi, Sainsbury, David & Hodgkinson, Peter (2018), Patient Assessment Assistant Using Augmented Reality, Proceedings of the 2018 UK-China Newton Fund Researcher Links Workshop Health and Well-being Through VR and AR.
  • Hu, Shanfeng, Bhattacharya, Hindol, Chattopadhyay, Matangini, Aslam, Nauman & Shum, Hubert P. H. (2018), A Dual-Stream Recurrent Neural Network for Student Feedback Prediction using Kinect, SKIMA '18 Proceedings of the 2018 International Conference on Software Knowledge Information Management and Applications. IEEE, 1-8.
  • Feng, Qi, Shum, Hubert P. H. & Morishima, Shigeo (2018), Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality, VRST '18 Proceedings of the 2018 ACM Symposium on Virtual Reality Software and Technology. New York, NY, USA, ACM.
  • Iwamoto, Naoya, Kato, Takuya, Shum, Hubert P. H., Kakitsuka, Ryo, Hara, Kenta & Morishima, Shigeo (2017), DanceDJ: A 3D Dance Animation Authoring System for Live Performance, ACE '17 Proceedings of the 2017 International Conference on Advances in Computer Entertainment Technology. 653-670.
  • Li, Jie, Qu, Yanpeng, Shum, Hubert P. H. & Yang, Longzhi (2017), TSK Inference with Sparse Rule Bases, UKCI '16 Proceedings of the 2016 UK Workshop on Computational Intelligence. Cham, Springer International Publishing, 107-123.
  • Liu, Zhiguang, Leung, Howard, Zhou, Liuyang, Multon, Franck & Shum, Hubert P. H. (2017), High Quality Compatible Triangulations for Planar Shape Animation, D2AT '17 Proceedings of the 2017 ACM SIGGRAPH Asia Workshop on Data-Driven Animation Techniques.
  • Rueangsirarak, Worasak, Mekurai, Chayuti, Shum, Hubert P. H., Uttama, Surapong, Chaisricharoen, Roungsan & Kaewkaen, Kitchana (2017), Biofeedback Assessment for Older People with Balance Impairment using a Low-cost Balance Board, GWS '17 Proceedings of the 2017 Global Wireless Summit. 64-69.
  • Ho, Edmond S. L., Shum, Hubert P. H., Wang, He & Yi, Li (2017), Synthesizing Motion with Relative Emotion Strength, D2AT '17 Proceedings of the 2017 ACM SIGGRAPH Asia Workshop on Data-Driven Animation Techniques.
  • Xu, Shoujiang, Ho, Edmond S. L., Aslam, Nauman & Shum, Hubert P. H. (2017), Unsupervised Abnormal Behaviour Detection with Overhead Crowd Video, SKIMA '17 Proceedings of the 2017 International Conference on Software Knowledge Information Management and Applications. IEEE, 1-6.
  • Hu, Shanfeng, Rueangsirarak, Worasak, Bouchee, Maxime, Aslam, Nauman & Shum, Hubert P. H. (2017), A Motion Classification Approach to Fall Detection, SKIMA '17 Proceedings of the 2017 International Conference on Software Knowledge Information Management and Applications. IEEE, 1-6.
  • Plantard, Pierre, Shum, Hubert P. H. & Multon, Franck (2016), Ergonomics Measurements using Kinect with a Pose Correction Framework, DHM '16 Proceedings of the 2016 International Digital Human Modeling Symposium.
  • Liu, Zhiguang, Leung, Howard & Shum, Hubert P. H. (2016), An Interactive Human Morphing System with Self-occlusion Enhancement, MIG '16 Proceedings of the 2016 International Conference on Motion in Games. New York, NY, USA, ACM, 197-197.
  • Shum, Hubert P. H., Wang, He, Ho, Edmond S. L. & Komura, Taku (2016), SkillVis: A Visualization Tool for Boxing Skill Assessment, MIG '16 Proceedings of the 2016 International Conference on Motion in Games. New York, NY, USA, ACM, 145-153.
  • Yang, Yang, Bian, Huiwen, Shum, Hubert P. H., Aslam, Nauman & Zeng, Lanling (2016), Temporal Clustering of Motion Capture Data with Optimal Partitioning, VRCAI '16 Proceedings of the 2016 International Conference on Virtual-Reality Continuum and its Applications in Industry. New York, NY, USA, ACM, 479-482.
  • Li, Jie, Shum, Hubert P. H., Fu, Xin, Sexton, Graham & Yang, Longzhi (2016), Experience-based Rule Base Generation and Adaptation for Fuzzy Interpolation, FUZZ-IEEE '16 Proceedings of the 2016 IEEE World Congress on Computational Intelligence. IEEE, 102-109.
  • Li, Meng, Leung, Howard & Shum, Hubert P. H. (2016), Human Action Recognition via Skeletal and Depth based Feature Fusion, MIG '16 Proceedings of the 2016 International Conference on Motion in Games. New York, NY, USA, ACM, 123-132.
  • Tan, Yao, Li, Jie, Wonders, Martin, Chao, Fei, Shum, Hubert P. H. & Yang, Longzhi (2016), Towards Sparse Rule Base Generation for Fuzzy Rule Interpolation, FUZZ-IEEE '16 Proceedings of the 2016 IEEE World Congress on Computational Intelligence. IEEE, 110-117.
  • Asahina, Wakana, Iwamoto, Naoya, Shum, Hubert P. H. & Morishima, Shigeo (2016), Automatic Dance Generation System Considering Sign Language Information, SIGGRAPH '16 Proceedings of the 2016 ACM SIGGRAPH. New York, NY, USA, ACM, 23:1-23:2.
  • Neff, Michael, Geraerts, Roland & Shum, Hubert P. H. (2016), Proceedings of the 9th International Conference on Motion in Games, MIG '16 Proceedings of the 2016 International Conference on Motion in Games. New York, NY, USA, ACM.
  • Zhang, Jingtian, Zhang, Lining, Shum, Hubert P. H. & Shao, Ling (2016), Arbitrary View Action Recognition via Transfer Dictionary Learning on Synthetic Training Data, ICRA '16 Proceedings of the 2016 IEEE International Conference on Robotics and Automation. IEEE, 1678-1684.
  • Li, Jie, Yang, Longzhi, Shum, Hubert P. H., Sexton, Graham & Tan, Yao (2015), Intelligent Home Heating Controller Using Fuzzy Rule Interpolation, Proceedings of the 2015 UK Workshop on Computational Intelligence.
  • Liu, Zhiguang, Leung, Howard, Zhou, Liuyang & Shum, Hubert P. H. (2015), High Quality Compatible Triangulations for 2D Shape Morphing, VRST '15 Proceedings of the 2015 ACM Symposium on Virtual Reality Software and Technology. New York, NY, USA, ACM, 85-94.
  • Omar, Mohamed, Hossain, Alamgir, Zhang, Li & Shum, Hubert P. H. (2014), An Intelligent Mobile-Based Automatic Diagnostic System to Identify Retinal Diseases using Mathematical Morphological Operations, SKIMA '14 Proceedings of the 2014 International Conference on Software Knowledge Information Management and Applications. 1-5.
  • Zhou, Liuyang, Liu, Zhiguang, Leung, Howard & Shum, Hubert P. H. (2014), Posture Reconstruction Using Kinect with a Probabilistic Model, VRST '14 Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology. New York, NY, USA, ACM, 117-125.
  • Shum, Hubert P.H. (2013), Serious Games with Human-Object Interactions using RGB-D Camera, MIG '13 Proceedings of the 6th International Conference on Motion in Games. Berlin, Heidelberg, Springer-Verlag.
  • Shum, Hubert P. H., Hoyet, Ludovic, Ho, Edmond S. L., Komura, Taku & Multon, Franck (2013), Preparation Behaviour Synthesis with Reinforcement Learning, CASA '13 Proceedings of the 2013 International Conference on Computer Animation and Social Agents. Chichester, UK, John Wiley and Sons Ltd.
  • Ho, Edmond S. L. & Shum, Hubert P. H. (2013), Motion Adaptation for Humanoid Robots in Constrained Environments, ICRA '13 Proceedings of the 2013 IEEE International Conference on Robotics and Automation. IEEE, 3813-3818.
  • Shum, Hubert P. H. & Ho, Edmond S. L. (2012), Real-time Physical Modelling of Character Movements with Microsoft Kinect, VRST '12 Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology. New York, NY, USA, ACM, 17-24.
  • Mackay, Kevin, Shum, Hubert P. H. & Komura, Taku (2012), Environment Capturing with Microsoft Kinect, SKIMA '12 Proceedings of the 2012 International Conference on Software Knowledge Information Management and Applications.
  • Henry, Joseph, Shum, Hubert P. H. & Komura, Taku (2012), Environment-aware Real-Time Crowd Control, SCA '12 Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Aire-la-Ville, Switzerland, Eurographics Association, 193-200.
  • Shum, Hubert P. H., Komura, Taku, Shiratori, Takaaki & Takagi, Shu (2010), Physically-based Character Control in Low Dimensional Space, MIG '10 6459: Proceedings of the Third International Conference on Motion in Games. Berlin, Heidelberg, Springer-Verlag, 23-34.
  • Komura, Taku, Shum, Hubert P. H. & Ho, Edmond S. L. (2008), Simulating Interactions of Characters, MIG '08 Proceedings of the First International Conference on Motion in Games. Berlin, Heidelberg, Springer-Verlag, 94-103.
  • Tang, Jeff K. T., Leung, Howard, Komura, Taku & Shum, Hubert P. H. (2008), Finding Repetitive Patterns in 3D Human Motion Captured Data, ICUIMC '08 Proceedings of the 2nd international Conference on Ubiquitous Information Management and Communication. New York, NY, USA, ACM, 396-403.
  • Shum, Hubert P. H., Komura, Taku & Yamazaki, Shuntaro (2008), Simulating Interactions of Avatars in High Dimensional State Space, I3D '08 Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games. New York, NY, USA, ACM, 131-138.
  • Shum, Hubert P. H., Komura, Taku & Nagano, Akinori (2007), Automatic Evaluation of Boxing Techniques from Captured Shadow Boxing Data, ISB '07 40: Proceedings of the 2007 Congress of International Society of Biomechanics. 277.
  • Shum, Hubert P. H., Komura, Taku & Yamazaki, Shuntaro (2007), Simulating Competitive Interactions using Singly Captured Motions, VRST '07 Proceedings of the 2007 ACM symposium on Virtual Reality Software and Technology. New York, NY, USA, ACM, 65-72.
  • Shum, Hubert P. H. & Komura, Taku (2006), Generating Realistic Fighting Scenes by Game Tree, SCA '06 Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer animation. Aire-la-Ville, Switzerland, Switzerland, Eurographics Association.
  • Shum, Hubert P. H. & Komura, Taku (2005), Tracking the Translational and Rotational Movement of the Ball Using High-Speed Camera Movies, ICIP '05 3: Proceedings of the 2005 IEEE International Conference on Image Processing. IEEE, 1084-1087.
  • Shum, Hubert P. H. & Komura, Taku (2004), A Spatiotemporal Approach to Extract the 3D Trajectory of the Baseball from a Single View Video Sequence, ICME '04 3: Proceedings of the 2004 IEEE International Conference on Multimedia and Expo. IEEE, 1583-1586.

Doctoral Thesis

  • Shum, Hubert P.H. (2010). Simulating Interactions Among Multiple Characters. Edinburgh, UK, PhD.

Journal Article

Other (Print)

  • Komura, Taku & Shum, Hubert P. H. (2010). Manufacturing Video Graphics.

Supervision students