Extracting Heart Rate Variability: A Summary of Camera Based Photoplethysmograph


  •   Rejwana Islam

  •   Mousumi Sarmin

  •   Farzana Akter Dulia

  •   Moinul Islam Sayed


Heart rate is one of the major indicators of our physiological state. An irregular or rapid heartbeat, fainting, dizziness, chest pain or shortness of breath can be found by it. The traditional heart rate observing methods such as electrocardiogram (ECG) require physical contact in order to show the heart rate reading exactly but this is uncomfortable for regular monitoring. Techniques for measuring physiological parameters remotely from hospital, as well as monitoring patients continuously, have been one of the major concerns of the scholars. Many heart rate measurement methods using smartphone, webcam, commercial camera etc. have been proposed by many researchers. Image or video processing is the fundamental technique for measuring heart rate through smartphone. With the aim of exploring different heart rate monitoring methods and the advantages and disadvantages, the present study consulted secondary sources like published articles.

Keywords: Heart rate, Camera, Smartphone, Webcam, Photoplethysmograph


Kanva, Avneendra K., Chandan J. Sharma, and Sujay Deb. "Determination of SpO 2 and heart-rate using smartphone camera." In Proceedings of The 2014 International Conference on Control, Instrumentation, Energy and Communication (CIEC), pp. 237-241. IEEE, 2014.

Peng, Rong-Chao, Xiao-Lin Zhou, Wan-Hua Lin, and Yuan-Ting Zhang. "Extraction of heart rate variability from smartphone photoplethysmograms." Computational and mathematical methods in medicine 2015 (2015).

Yadav, Umang. "Photoplethysmography based Heart Rate Calculation using Fingertip Video Captured by Smartphone." (2016).

Chen, Jie, Zhuoqing Chang, Qiang Qiu, Xiaobai Li, Guillermo Sapiro, Alex Bronstein, and Matti Pietikäinen. "RealSense= real heart rate: Illumination invariant heart rate estimation from videos." In 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1-6. IEEE, 2016.

Jain, Monika, Sujay Deb, and A. Venkata Subramanyam. "Face video based touchless blood pressure and heart rate estimation." In 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP), pp. 1-5. IEEE, 2016.

Sanyal, Shourjya, and Koushik Kumar Nundy. "Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face." IEEE Journal of translational engineering in health and medicine 6 (2018): 1-11.

Xu, Shuchang, Lingyun Sun, and Gustavo Kunde Rohde. "Robust efficient estimation of heart rate pulse from video." Biomedical optics express 5, no. 4 (2014): 1124-1135.

Bal, Ufuk. "Non-contact estimation of heart rate and oxygen saturation using ambient light." Biomedical optics express 6, no. 1 (2015): 86-97.

Monkaresi, Hamed, Rafael A. Calvo, and Hong Yan. "A machine learning approach to improve contactless heart rate monitoring using a webcam." IEEE journal of biomedical and health informatics 18, no. 4 (2013): 1153-1160.

Muender, Thomas, Matthew K. Miller, Max V. Birk, and Regan L. Mandryk. "Extracting heart rate from videos of online participants." In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 4562-4567. 2016.

Niu, Xuesong, Hu Han, Shiguang Shan, and Xilin Chen. "Continuous heart rate measurement from face: A robust rppg approach with distribution learning." In 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 642-650. IEEE, 2017.

Qi, Huan, Zhenyu Guo, Xun Chen, Zhiqi Shen, and Z. Jane Wang. "Video-based human heart rate measurement using joint blind source separation." Biomedical Signal Processing and Control 31 (2017): 309-320.

Yuvraj D. Patil & Gyankamal J. C. “Heart Rate Measurement System using Facial Video.” International Journal on Emerging Trends in Technology, vol. 4, no. 2, IJETT, 2017.

Rahman, Hamidur, Mobyen Uddin Ahmed, Shahina Begum, and Peter Funk. "Real time heart rate monitoring from facial RGB color video using webcam." In The 29th Annual Workshop of the Swedish Artificial Intelligence Society (SAIS), 2–3 June 2016, Malmö, Sweden, no. 129. Linköping University Electronic Press, 2016.

Addison, Paul S. "Modular continuous wavelet processing of biosignals: extracting heart rate and oxygen saturation from a video signal." Healthcare technology letters 3, no. 2 (2016): 111-115.

Jindal, Vasu. "Integrating mobile and cloud for PPG signal selection to monitor heart rate during intensive physical exercise." In Proceedings of the International Conference on Mobile Software Engineering and Systems, pp. 36-37. 2016.

Li, Xiaobai, Jie Chen, Guoying Zhao, and Matti Pietikainen. "Remote heart rate measurement from face videos under realistic situations." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4264-4271. 2014.

Abe, Erika, Hiroshi Chigira, Koichi Fujiwarai, Toshitaka Yamakawa, and Manabu Kano. "Heart rate monitoring by a pulse sensor embedded game controller." In 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), pp. 1266-1269. IEEE, 2015.

Singh, Mridula, Abhishek Kumar, Kuldeep Yadav, Himanshu Madhu, and Tridib Mukherjee. "Mauka-mauka: measuring and predicting opportunities for webcam-based heart rate sensing in workplace environment." In Proceedings of the 10th EAI International Conference on Body Area Networks, pp. 96-102. 2015.

Lam, Antony, and Yoshinori Kuno. "Robust heart rate measurement from video using select random patches." In Proceedings of the IEEE International Conference on Computer Vision, pp. 3640-3648. 2015.

Patil, Yuvraj D., and Gyankamal J. Chhajed. "Heart Rate Measurement System using Facial Video Processing." IJETT 1, no. 2 (2017).

Rouast, Philipp V., Marc TP Adam, Raymond Chiong, David Cornforth, and Ewa Lux. "Remote heart rate measurement using low-cost RGB face video: a technical literature review." Frontiers of Computer Science 12, no. 5 (2018): 858-872.

Procházka, Aleš, Martin Schätz, Old?ich Vyšata, and Martin Vališ. "Microsoft kinect visual and depth sensors for breathing and heart rate analysis." Sensors 16, no. 7 (2016): 996.

Peng, Rong-Chao, Wen-Rong Yan, Ning-Ling Zhang, Wan-Hua Lin, Xiao-Lin Zhou, and Yuan-Ting Zhang. "Investigation of five algorithms for selection of the optimal region of interest in smartphone photoplethysmography." Journal of Sensors 2016 (2016).

Coppetti, Thomas, Andreas Brauchlin, Simon Müggler, Adrian Attinger-Toller, Christian Templin, Felix Schönrath, Jens Hellermann, Thomas F. Lüscher, Patric Biaggi, and Christophe A. Wyss. "Accuracy of smartphone apps for heart rate measurement." European journal of preventive cardiology 24, no. 12 (2017): 1287-1293.

Alghoul, Karim, Saeed Alharthi, Hussein Al Osman, and Abdulmotaleb El Saddik. "Heart rate variability extraction from videos signals: ICA vs. EVM comparison." IEEE Access 5 (2017): 4711-4719.

Papon, Md Tarikul Islam, Ishtiyaque Ahmad, Nazmus Saquib, and Ashikur Rahman. "Non-invasive heart rate measuring smartphone applications using on-board cameras: A short survey." In 2015 International Conference on Networking Systems and Security (NSysS), pp. 1-6. IEEE, 2015.

Adibuzzaman, Mohammad, Sheikh Iqbal Ahamed, and Richard Love. "A personalized model for monitoring vital signs using camera of the smart phone." In Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 444-449. 2014.

Verkruysse, Wim, Lars O. Svaasand, and J. Stuart Nelson. "Remote plethysmographic imaging using ambient light." Optics express 16, no. 26 (2008): 21434-21445.

Jonathan, E., and Martin Leahy. "Investigating a smartphone imaging unit for photoplethysmography." Physiological measurement 31, no. 11 (2010): N79.

Allen, John. "Photoplethysmography and its application in clinical physiological measurement." Physiological measurement 28, no. 3 (2007): R1.

Sun, Yu, and Nitish Thakor. "Photoplethysmography revisited: from contact to noncontact, from point to imaging." IEEE Transactions on Biomedical Engineering 63, no. 3 (2015): 463-477.

Kirk, Sarah E. "Comparison of the Apple Watch, Fitbit Surge, and Actigraph GT9X Link in Measuring Energy Expenditure, Steps, Distance, and Heart Rate." PhD diss., Cleveland State University, 2016.

Kwon, Sungjun, Hyunseok Kim, and Kwang Suk Park. "Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone." In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2174-2177. IEEE, 2012.

Datcu, Dragos, Marina Cidota, Stephan Lukosch, and Leon Rothkrantz. "Noncontact automatic heart rate analysis in visible spectrum by specific face regions." In Proceedings of the 14th International Conference on Computer Systems and Technologies, pp. 120-127. 2013.

Holton, Benjamin D., Kavan Mannapperuma, Peter J. Lesniewski, and John C. Thomas. "Signal recovery in imaging photoplethysmography." Physiological measurement 34, no. 11 (2013): 1499.


Download data is not yet available.


How to Cite
Islam, R., Sarmin, M., Dulia, F.A. and Sayed, M.I. 2020. Extracting Heart Rate Variability: A Summary of Camera Based Photoplethysmograph. European Journal of Electrical Engineering and Computer Science. 4, 2 (Apr. 2020). DOI:https://doi.org/10.24018/ejece.2020.4.2.208.