Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/thearn/webcam-pulse-detector

A python application that detects and highlights the heart-rate of an individual (using only their own webcam) in real-time.
https://github.com/thearn/webcam-pulse-detector

Last synced: 29 days ago
JSON representation

A python application that detects and highlights the heart-rate of an individual (using only their own webcam) in real-time.

Awesome Lists containing this project

README 

        
![Alt text](http://i.imgur.com/2ngZopS.jpg "Screenshot")



webcam-pulse-detector

-----------------------



### - UPDATE: Now with Python 3.5+ and OpenCV 3.0+ support



### Stand-alone (no dependancy) precompiled application:



 - Download for Windows 7 and 8: [webcam-pulse-detector_win.zip](http://sourceforge.net/projects/webcampulsedetector/files/webcam-pulse-detector_win.zip/download) (42 Mb) 

 - Download for Mac OSX 10.6 (and later): [webcam-pulse-detector_mac.zip](http://sourceforge.net/projects/webcampulsedetector/files/webcam-pulse-detector_mac.zip/download) (21 Mb)

 - Debian/Ubuntu/Mint Linux: Coming very soon. For now, it is recommended that you run from source on the `no_openmdao` branch if you just want to test things out.



The application can be run by simply executing the binary contained in the zip file for your platform.

This code can also be run from source by following the instructions below.



---------------------------------------



A python code that detects the heart-rate of an individual using a common webcam or network IP camera. 

Tested on OSX, Ubuntu, and Windows.



How it works:

-----------------

This application uses [OpenCV](http://opencv.org/) to find the location of the user's face, then isolate the forehead region. Data is collected

from this location over time to estimate the user's heart rate. This is done by measuring average optical

intensity in the forehead location, in the subimage's green channel alone (a better color mixing ratio may exist, but the 

blue channel tends to be very noisy). Physiological data can be estimated this way thanks to the optical absorption 

characteristics of (oxy-) haemoglobin (see http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-16-26-21434). 



With good lighting and minimal noise due to motion, a stable heartbeat should be 

isolated in about 15 seconds. Other physiological waveforms (such as 

[Mayer waves](http://en.wikipedia.org/wiki/Mayer_waves)) should also be visible in the raw data stream.



Once the user's heart rate has been estimated, real-time phase variation associated with this 

frequency is also computed. This allows for the heartbeat to be exaggerated in the post-process frame rendering, 

causing the highlighted forehead location to pulse in sync with the user's own heartbeat.



Support for detection on multiple simultaneous individuals in a single camera's 

image stream is definitely possible, but at the moment only the information from one face 

is extracted for analysis.



The overall dataflow/execution order for the real-time signal processing looks like:



![Alt text](http://i.imgur.com/xS7O8U3.png "Signal processing")



Requirements:

---------------



- [Python v2.7 or v3.5+)](http://python.org/)

- [OpenCV v2+](http://opencv.org/)

- Numpy, Scipy



Quickstart:

------------



- run get_pulse.py to start the application



```

python get_pulse.py

```



- To run on an IP camera, set the `url`, `user`, and `password` strings on line 134 of `get_pulse_ipcam.py`, then run:



```

python get_pulse_ipcam.py

```

This was tested on a Wowwee Rovio.



- If there is an error, try running `test_webcam.py` in the same directory to check if your openCV installation and webcam can be made to work

with this application.



Usage notes:

----------

- When run, a window will open showing a stream from your computer's webcam

- When a forehead location has been isolated, the user should press "S" on their 

keyboard to lock this location, and remain as still as possible (the camera 

stream window must have focus for the click to register). This freezes the acquisition location in place. This lock can

be released by pressing "S" again.

- To view a stream of the measured data as it is gathered, press "D". To hide this display, press "D" again.

- The data display shows three data traces, from top to bottom: 

   1. raw optical intensity

   2. extracted heartbeat signal

   3. Power spectral density, with local maxima indicating the heartrate (in beats per minute). 

- With consistent lighting and minimal head motion, a stable heartbeat should be 

isolated in about 15 to 20 seconds. A count-down is shown in the image frame.

- If a large spike in optical intensity is measured in the data (due to motion 

noise, sudden change in lighting, etc) the data collection process is reset and 

started over. The sensitivity of this feature can be tweaked by changing `data_spike_limit` on line 31 of [get_pulse.py](get_pulse.py).

Other mutable parameters of the analysis can be changed here as well.