I am currently a post-doctor in Prof. Bernt Schiele's group, Max-Planck-Institute for Informatics, Germany. I obtained my PhD degree in the School of Electronics Engineering and Computer Science, Peking University, in Jan. 2016. My research interests include pattern recognition, data mining, and time series prediction.  Specific experiences are made in real applications of human action recognition, prediction, anomalous activity detection, and egocentric video analysis.




Sep 2010 - Jan 2016
Peking University

Supervisor: Prof. Hong Liu

Open Lab on Human Robot Interaction (HRI Lab)

School of Electronics Engineering and Computer Science

Major: Electronic Information Science and Technology    

Interests: data mining and modeling, pattern recognition and time series prediction.

Bachelor of Science

Sep 2006 - Jul 2010
Nanjing University of Posts and Telecommunications

Major: Information and Computing Science    GPA: 4.16

Main courses: mathematics courses and basic computer science courses, e.g., probability theory, mathematical analysis, numerical approximation, advanced algebra, and digital signal processing.


Work History

Project Involved


Privacy Implications of Visual Data Dissemination

Mar 2016 - Feb 2019
Methods and Tools for Understanding and Controlling Privacy

Understand what information can be extracted from public data, how can persons are linked, how does this compare to traditional social networks, how can we model and evaluate different possible actions a user can take. My work includes the analysis of egocentric videos people upload to public networks and making efficient models to understanding the aims, hobbies, and possible intentions contained in videos.

Embedded Bionic Vision System for Human-Machine Interaction in Complicated Scenarios

May 2013 - Dec 2016
with Ministry of Science and Technology

Implementing bionic vision in mobile robots to achieve target detection and different recognition tasks, e.g., person re-identification, and spoken/action command recognition. My work includes the design and implement of algorithms for daily activity recognition and  interactive command reception.

Intelligent Surveillance System

Sep 2012 - Aug 2014
for Public Service Technology Platform

Building a demonstration system containing intelligent surveillance and salient event summary storage. My work includes the design and implement of algorithms for human behavior recognition in surveillance environments and storing event abstracts correspondingly.

Abnormal Event Detection and Object Tracking for Monitoring System

Apr 2011 - Mar 2013
with Shenzhen Science and Technology Innovation Committee

Developing algorithms for abnormal human behavior detection and real-time alarm to build an efficient monitoring system through network cameras.  My work includes the design and implement of algorithms for human activity modeling and anomalous event detection in surveillance environments.


  • Chinese(Native)   English(Professional)   Japanese (Elementary)
  • Matlab   C++   C    Python   

Honor & Award

  • Sep 2014  Universiade International Scholarship by Shenzhen Universiade Scholarship Foundation
  • Oct 2013  China Reconstruct Scholarship  by PKU
  • Oct 2011  Social Work Award  by PKU
  • Aug 2011  Volunteer Forerunner Individual  by Universiade Organizing Committee
  • Oct 2011  Social Work Award  by PKU
  • Oct 2010-2015  Doctoral Second-class Scholarship by PKU
  • Oct 2008-2009  Tong Ding Second-class Scholarship by NJUPT 
  • Oct 2007-2009  Pivot of Merit Student  by NJUPT
  • Oct 2007-2009  School First-class Scholarship  by NJUPT
  • Oct 2007  National Scholarship  by National Ministry of Education

Research Experience

Research on local spatial-temporal feature based human action modeling and classification

  • Modeling co-occurrence and directional co-occurrence relationships between local feature pairs to enhance the representation capability of bag-of-words model.
  • Studying local feature encoding method to extract informative descriptors meanwhile controlling the descriptor dimension. Specifically, we make use of clustering residual vectors to construct informative a hierarchical bag-of-words model for human action description.

Research on action sequentiality based ongoing human activity prediction

  • Modeling long-range human activity by Recurrent Self-organizing Map (RSOM), in which currently observed features and their temporal information can be synchronously encoded. Traditional RSOM is greatly improved to have more strength for modeling changing time sequences. The RSOM trajectory is generated for activity representation. Since the special structure of trajectory, a combination of Dynamic Time Warping (DTW) distance and Edit distance, named DTW-E, is designed to measure its structural dissimilarity, then to infer the activity immediately.

Research on online anomalous event detection in surveillance scenes

  • Developing an unsupervised model called online Growing Neural Gas (online GNG) to learn surveillance scenes with changing crowd density and behavior types. Neighbor-related strategies are proposed to adjust dominant learning operations and tune main parameters in a totally adaptive manner.

Mentoring Experience

Being the leader of sub Visual Group in HRI lab       2013 - 2015

  • Members: Qianru Sun, Zilin Liang, Yuke Sun, Qiaoduo Zhang, Lu Tian and Mengyuan Liu

Assisting Prof. Liu to mentor Master Thesis              2014 - 2015                

  • Yuke Sun. Thesis: Person Re-identification System Based on Online Metric Learning. 2015.
  • Qiaoduo Zhang. Thesis: Human Action Classification Based on Sequential Bag-of-Words Model.  2015.
  • Zilin Liang. Thesis: Human Object Tracking Based on Online Machine Learning. 2014.

Digital Image Processing -- Clustering Analysis,  graduate course (six class hours)       2014 - 2015


  1. Qianru Sun, Hong Liu. Action Disambiguation Analysis Using Normalized Google-Like Distance Correlogram. The 11th Asian Conference on Computer Vision (ACCV 2012 oral), pp.425-437, November 5-9, 2012, Daejeon, Korea. (Acceptance Rate 3.6%)
  2. Qianru Sun, Hong Liu. Inferring Ongoing Human Activities Based on Recurrent Self-Organizing Map Trajectory. The 24th British Machine Vision Conference (BMVC 2013), pp. 0011.1-0011.10, September 9-13, 2013, Bristol, U.K.. (Acceptance Rate 30%)
  3. Qianru Sun, Hong Liu. Learning Spatio-Temporal Co-occurrence Correlograms for Efficient Human Action classification. IEEE International Conference on Image Processing (ICIP 2013), pp. 3220-3224, September 15-18, 2013, Melbourne, Australia.
  4. Hong Liu, Mengyuan Liu, and Qianru Sun. Learning Directional Co-occurrence for Human Action Classification. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2014), May 4-9, 2014, Florence, Italy.
  5. Mengyuan Liu, Hong Liu and Qianru Sun. Action Classification by Exploring Directional Co-occurrence of Weighted STIPS. IEEE International Conference on Image Processing (ICIP 2014), Paris, France.
  6. Yuke Sun, Hong Liu, and Qianru Sun. Online Learning on Incremental Distance Metric for Person Re-identification. International Conference on Robotics and Biomimetics (ROBIO 2014), December 5-10, 2014, Bali, Indonesia.
  7. Hong Liu, Qiaoduo Zhang, and Qianru Sun. Human Action Classification Based on Sequential Bag-of-Words Model. International Conference on Robotics and Biomimetics (ROBIO 2014), December 5-10, 2014, Bali, Indonesia.
  8. Qianru Sun, Wenmin Wang, and Hong Liu. A study of human actions representation in video sequences.    CAAI Transactions on Intelligent Systems, 8(3): 189-198, 2013.
  9. Qianru Sun, Hong Liu, Mengyuan Liu, and Tianwei Zhang. Activity Prediction by Mapping Key Grouplets to Recurrent Self-Organizing Map.   Neurocomputing 177: 427 - 440, 2016.
  10. Qianru Sun, Hong Liu, Liqian Ma, Tianwei Zhang. A Novel Hierarchical Bag-of-Words Model for Compact Action Representation.  Neurocomputing 174: 722 - 732, 2016.
  11. Qianru Sun, Hong Liu, and Tatsuya Harada. Online Growing Neural Gas for Anomaly Detection in Changing Surveillance Scenes.   Pattern Recognition. (Under review)
  12. Hong Liu, Zilin Liang, and Qianru Sun. Robust Tracking with Discriminative Ranking Middle-level Patches.   International Journal of Advanced Robotic Systems, 2014, 11:68. doi: 10.5772/ 58430.
  13. Mengyuan Liu, Hong Liu, and Qianru Sun. Salient Pairwise Spatio-temporal Interest Points for Action Classification. CAAI Transactions on Intelligence Technology. (Accepted)
  14. Liqian Ma , Hong Liu, Liang Hu, Can wang, and Qianru Sun. Orientation Driven Bag of Appearances for Person Re-identification. IEEE Transactions on Circuits and Systems for Video Technology. (Under Review).