We have released the video above which demonstrates the practical applications of our research in emergency care situations. In this case study, nurses or student nurses wearing a Smart-Assistant (in this example Smart-Eye-Ware) are attempting to resuscitate a patient (doll). Besides offering information on demand in their HMD (e.g. instant feedback, regulations or quick-check information, hints), the Smart-Assistant also detects specific activities like performing chest compressions and provides feedback if the activity is not performed to required standards.

This research expands on work presented in the award winning papers: Smart-Watch Life Saver: Smart-Watch Interactive-Feedback System for Improving Bystander CPR and Recognizing Hospital Care Activities with a Pocket Worn Smartphone (award details here).

Abstract: In this work, we show how a smart-phone worn unobtrusively in a nurses coat pocket can be used to document the patient care activities performed during a regular morning routine. The main contribution is to show how, taking into account certain domain specific boundary conditions, a single sensor node worn in such an (from the sensing point of view) unfavorable location can still recognize complex, sometimes subtle activities. We evaluate our approach in a large real life dataset from day to day hospital operation. In total, 4 runs of patient care per day were collected for 14 days at a geriatric ward and annotated in high detail by following the performing nurses for the entire duration. This amounts to over 800 hours of sensor data including acceleration, gyroscope, compass, wifi and sound annotated with groundtruth at less than 1min resolution.

Citation: Gernot Bahle, Agnes Gruenerbl, Enrico Bignotti, Mattia Zeni, Fausto Giunchiglia and Paul Lukowicz (2014): “Recognizing Hospital Care Activities with a Pocket Worn Smartphone”, 6th International Conference on Mobile Computing, Applications and Services (MobiCASE 2014)

Download: http://bit.ly/2jcB3mo