Satwik Kottur bio photo

Satwik Kottur

Research Scientist
Facebook AI
Menlo Park, CA

Email Facebook LinkedIn Github

Human Activity Recognition

Human Activity Recognition

B.Tech project-I, IIT Bombay, Fall 2013
Guide: Prof. Subhasis Chaudhuri
[Report] [Poster]

The need for security and surveillance is always on the rise. This work is an attempt to address this problem in a social gathering using a single, calibrated camera. To begin with, it is a survey of existing methods—studying the advantages and suitability to the problem at hand. Next, a pipeline of approach is proposed similar to the work of Neha et al. in [2]. Finally, suitable improvements are suggested for the scenario considered.

Proposed Pipeline.


Human Activity is one of the most actively pursued topic owing to its wide range of applications. It has been studied mainly under two approaches—holistic and reductionist. The former considers the crowd as a single entity while the latter models individuals seperately and studies their interaction. [1] and [2] provide the respective examples. This work falls under the latter category.

Results of DPM (left), tracking feature points (right).


Following a pipeline similar to [2], frames from the calibrated camera are used to detect humans. Deformable part models ([5]) is employed for the first stage of detection. Due to high computation time, only intermittent frames are used to identify humans and corresponding parts. These detected parts form the feature points and are tracked by the Lucas-Kanade algorithm for remaining frames. This reduces the overall complexity and makes the execution real-time. The feature points on the image plane (2D) are converted to 3D points in world co-ordinates (classically known as 2.5D) using average height plane assumption. Finally, linear cylic pursuit model (LCP) is employed to predict the short-term trajectories of these points for further analysis. Finer details can be found in the report.

References:

  1. Viswanthan Srikrishnan and Subhasis Chaudhuri. Crowd motion analysis using linear cyclic pursuit.In Pattern Recognition (ICPR), 2010 20th International Conference on, pages 3340–3343. IEEE, 2010.
  2. Neha Bhargava, Subhasis Chaudhuri and Guna Seetharaman. Linear cyclic pursuit based prediction of personal space violation in surveillance video. Applied Imagery Pattern Recognition Workshop, 2013.
  3. Arpita Sinha. Multi-agent consensus using generalized cyclic pursuit strategies. 2009.
  4. Carlo Tomasi and Takeo Kanade. Detection and tracking of point features. International Journal of Computer Vision, 1991.
  5. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1627–1645, 2010. [TOP][BACK]