RF-ECG:Heart Rate Variability Assessment Based on COTS RFID Tag Array CHUYU WANG,Nanjing University,CHN LEI XIE*,Nanjing University,CHN WEI WANG,Nanjing University,CHN YINGYING CHEN,Rutgers University,USA YANLING BU,Nanjing University,CHN SANGLU LU,Nanjing University,CHN As an important indicator of autonomic regulation for circulatory function,Heart Rate Variability(HRV)is widely used for general health evaluation.Apart from using dedicated devices(e.g.ECG)in a wired manner,current methods search for a ubiquitous manner by either using wearable devices,which suffer from low accuracy and limited battery life,or applying wireless techniques(e.g..FMCW),which usually utilize dedicated devices(e.g.,USRP)for the measurement.To address these issues,we present RF-ECG based on Commercial-Off-The-Shelf(COTS)RFID,a wireless approach to sense the human heartbeat through an RFID tag array attached on the chest area in the clothes.In particular,as the RFID reader continuously interrogates the tag array,two main effects are captured by the tag array:the reflection effect representing the RF-signal reflected from the heart movement due to heartbeat;the moving effect representing the tag movement caused by chest movement due to respiration.To extract the reflection signal from the noisy RF-signals,we develop a mechanism to capture the RF-signal variation of the tag array caused by the moving effect,aiming to eliminate the signals related to respiration. To estimate the HRV from the reflection signal,we propose a signal reflection model to depict the relationship between the 85 RF-signal variation from the tag array and the reflection effect associated with the heartbeat.A fusing technique is developed to combine multiple reflection signals from the tag array for accurate estimation of HRV.Experiments with 15 volunteers show that RF-ECG can achieve a median error of 3%of Inter-Beat Interval(IBI),which is comparable to existing wired techniques. CCS Concepts:.Networks-Sensor networks;Mobile networks;.Human-centered computing-Mobile devices; Additional Key Words and Phrases:RFID:Heart rate:HRV ACM Reference Format: Chuyu Wang,Lei Xie,Wei Wang.Yingying Chen,Yanling Bu,and Sanglu Lu.2018.RF-ECG:Heart Rate Variability Assessment Based on COTS RFID Tag Array.Proc.ACM Interact.Mob.Wearable Ubiquitous Technol.2,2,Article 85 (June 2018),26 pages. https:/doiorg/10.1145/3214288 "Lei Xie is the corresponding author,Email:Ixie@nju.edu.cn. Authors'addresses:Chuyu Wang,wangcyu217@dislab.nju.edu.cn,Nanjing University,State Key Laboratory for Novel Software Technology, 163 Xianlin Ave,Nanjing,210046,CHN;Lei Xie,Ixie@nju.edu.cn,Nanjing University,State Key Laboratory for Novel Software Technology, 163 Xianlin Ave,Nanjing,210046,CHN;Wei Wang,Nanjing University,State Key Laboratory for Novel Software Technology,163 Xianlin Ave,Nanjing.210046,CHN:Yingying Chen,Rutgers University,WINLAB,North Brunswick,NJ,08902,USA;Yanling Bu,Nanjing University. State Key Laboratory for Novel Software Technology,163 Xianlin Ave,Nanjing,210046,CHN;Sanglu Lu,Nanjing University,State Key Laboratory for Novel Software Technology,163 Xianlin Ave,Nanjing.210046.CHN. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page.Copyrights for components of this work owned by others than ACM must be honored.Abstracting with credit is permitted.To copy otherwise,or republish,to post on servers or to redistribute to lists,requires prior specific permission and/or a fee.Request permissions from permissions@acm.org. 2018 Association for Computing Machinery. 2474-9567/2018/6-ART85$15.00 https:/doi.org/10.1145/3214288 Proc.ACM Interact.Mob.Wearable Ubiquitous Technol,Vol.2,No.2,Article 85.Publication date:June 2018
85 RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array CHUYU WANG, Nanjing University, CHN LEI XIE∗ , Nanjing University, CHN WEI WANG, Nanjing University, CHN YINGYING CHEN, Rutgers University, USA YANLING BU, Nanjing University, CHN SANGLU LU, Nanjing University, CHN As an important indicator of autonomic regulation for circulatory function, Heart Rate Variability (HRV) is widely used for general health evaluation. Apart from using dedicated devices (e.g, ECG) in a wired manner, current methods search for a ubiquitous manner by either using wearable devices, which suffer from low accuracy and limited battery life, or applying wireless techniques (e.g., FMCW), which usually utilize dedicated devices (e.g., USRP) for the measurement. To address these issues, we present RF-ECG based on Commercial-Off-The-Shelf (COTS) RFID, a wireless approach to sense the human heartbeat through an RFID tag array attached on the chest area in the clothes. In particular, as the RFID reader continuously interrogates the tag array, two main effects are captured by the tag array: the reflection effect representing the RF-signal reflected from the heart movement due to heartbeat; the moving effect representing the tag movement caused by chest movement due to respiration. To extract the reflection signal from the noisy RF-signals, we develop a mechanism to capture the RF-signal variation of the tag array caused by the moving effect, aiming to eliminate the signals related to respiration. To estimate the HRV from the reflection signal, we propose a signal reflection model to depict the relationship between the RF-signal variation from the tag array and the reflection effect associated with the heartbeat. A fusing technique is developed to combine multiple reflection signals from the tag array for accurate estimation of HRV. Experiments with 15 volunteers show that RF-ECG can achieve a median error of 3% of Inter-Beat Interval (IBI), which is comparable to existing wired techniques. CCS Concepts: • Networks → Sensor networks; Mobile networks; • Human-centered computing → Mobile devices; Additional Key Words and Phrases: RFID; Heart rate; HRV ACM Reference Format: Chuyu Wang, Lei Xie, Wei Wang, Yingying Chen, Yanling Bu, and Sanglu Lu. 2018. RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 2, Article 85 (June 2018), 26 pages. https://doi.org/10.1145/3214288 ∗Lei Xie is the corresponding author, Email: lxie@nju.edu.cn. Authors’ addresses: Chuyu Wang, wangcyu217@dislab.nju.edu.cn, Nanjing University, State Key Laboratory for Novel Software Technology, 163 Xianlin Ave, Nanjing, 210046, CHN; Lei Xie, lxie@nju.edu.cn, Nanjing University, State Key Laboratory for Novel Software Technology, 163 Xianlin Ave, Nanjing, 210046, CHN; Wei Wang, Nanjing University, State Key Laboratory for Novel Software Technology, 163 Xianlin Ave, Nanjing, 210046, CHN; Yingying Chen, Rutgers University, WINLAB, North Brunswick, NJ, 08902, USA; Yanling Bu, Nanjing University, State Key Laboratory for Novel Software Technology, 163 Xianlin Ave, Nanjing, 210046, CHN; Sanglu Lu, Nanjing University, State Key Laboratory for Novel Software Technology, 163 Xianlin Ave, Nanjing, 210046, CHN. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. © 2018 Association for Computing Machinery. 2474-9567/2018/6-ART85 $15.00 https://doi.org/10.1145/3214288 Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 85. Publication date: June 2018
85:2·C.Wang et al. 1 INTRODUCTION 1.1 Motivation Heart Rate Variability(HRV)represents the variation of the time interval between adjacent heartbeats [7].As an important indicator of autonomic regulation for circulatory function,HRV reflects how the cardiovascular regulatory system responds to demands,stress and illness [35].Fine-grained HRV information is usually important to quantitatively measure physiological and mental changes during treatment.For example,the frequent detection of the premature beats indicates some kinds of heart problems about the person.Currently,reduced HRV has been used as a marker of aging,decreased autonomic activity,diabetic neuropathy,and increased risk of sudden cardiac death.According to the news from WHO [2],more than 17 million people die annually from cardiovascular disease(CVD),an estimated 31%of all deaths worldwide.Efficient HRV assessment can not only provide accurate information about the heart states for the treatment of heart diseases and the adjustment of mental status,but also timely detect the heart problem in the early stage.Therefore,accurate and fine-grained HRV assessment is regarded as one of the most effective methods for the general health evaluation [29]. 1.2 Limitation of Prior Art HRV analysis is normally based on the Inter-Beat Interval(IBI)measurements,which accurately describes the time interval between the adjacent heartbeats.As a traditional approach,the electrocardiogram(ECG)is regarded as the standard way to measure the IBI [6],which can accurately measure the IBI information from the tiny electrical changes on the skin.But the user is usually tethered to the electrodes in a wired manner,which imposes restrictions on the range of daily activities of the user.Moreover,it requires direct skin contact,indicating some people need to remove the chest hair to achieve better signal quality.Some optical absorption methods leverages the photoplethysmograph(PPG)[12,18]to estimate the IBI information.But it usually relies on the reflection of infrared light,leading to the loss of waveform detail and time accuracy.Commercial devices(e.g.,wristbands[5]) try to integrate the sensors(electrodes or visual sensors)into fabrics for wearable applications.However,they are only designed to estimate the average heart rate within a duration,which works as a training aid for exercises. So the fine-grained heart problems,such as premature beats and heart arrhythmia,cannot be effectively detected, which requires the accurate estimation of the IBI information.Moreover,these wearable devices are mostly constrained by their limited battery life,requiring frequent battery recharging.This limits the efficient HRV monitoring for elderly people and infants,who may forget to recharge the wearable devices.To eliminate the dependency on such sensing devices,a number of device-free methods are proposed to perceive the heartbeat via wireless channel(e.g.,Wi-Fi and FMCW)[10,11,42].However,they usually depend on the dedicated devices Sleep monitor SANT Heartbeat Elder monitor RFID tag arr变 Tag array Antenna (a)Illustrations of applications of RF-ECG (b)Illustration of working flow of RF-ECG Fig.1.RF-ECG system scenario. Proc.ACM Interact.Mob.Wearable Ubiquitous Technol..Vol 2.No.2.Article 85.Publication date:lune 2018
85:2 • C. Wang et al. 1 INTRODUCTION 1.1 Motivation Heart Rate Variability (HRV) represents the variation of the time interval between adjacent heartbeats [7]. As an important indicator of autonomic regulation for circulatory function, HRV reflects how the cardiovascular regulatory system responds to demands, stress and illness [35]. Fine-grained HRV information is usually important to quantitatively measure physiological and mental changes during treatment. For example, the frequent detection of the premature beats indicates some kinds of heart problems about the person. Currently, reduced HRV has been used as a marker of aging, decreased autonomic activity, diabetic neuropathy, and increased risk of sudden cardiac death. According to the news from WHO [2], more than 17 million people die annually from cardiovascular disease (CVD), an estimated 31% of all deaths worldwide. Efficient HRV assessment can not only provide accurate information about the heart states for the treatment of heart diseases and the adjustment of mental status, but also timely detect the heart problem in the early stage. Therefore, accurate and fine-grained HRV assessment is regarded as one of the most effective methods for the general health evaluation [29]. 1.2 Limitation of Prior Art HRV analysis is normally based on the Inter-Beat Interval (IBI) measurements, which accurately describes the time interval between the adjacent heartbeats. As a traditional approach, the electrocardiogram (ECG) is regarded as the standard way to measure the IBI [6], which can accurately measure the IBI information from the tiny electrical changes on the skin. But the user is usually tethered to the electrodes in a wired manner, which imposes restrictions on the range of daily activities of the user. Moreover, it requires direct skin contact, indicating some people need to remove the chest hair to achieve better signal quality. Some optical absorption methods leverages the photoplethysmograph (PPG) [12, 18] to estimate the IBI information. But it usually relies on the reflection of infrared light, leading to the loss of waveform detail and time accuracy. Commercial devices (e.g., wristbands [5]) try to integrate the sensors (electrodes or visual sensors) into fabrics for wearable applications. However, they are only designed to estimate the average heart rate within a duration, which works as a training aid for exercises. So the fine-grained heart problems, such as premature beats and heart arrhythmia, cannot be effectively detected, which requires the accurate estimation of the IBI information. Moreover, these wearable devices are mostly constrained by their limited battery life, requiring frequent battery recharging. This limits the efficient HRV monitoring for elderly people and infants, who may forget to recharge the wearable devices. To eliminate the dependency on such sensing devices, a number of device-free methods are proposed to perceive the heartbeat via wireless channel (e.g., Wi-Fi and FMCW) [10, 11, 42]. However, they usually depend on the dedicated devices RFID tag array Elder monitor Sleep monitor (a) Illustrations of applications of RF-ECG Tag array Antenna Heartbeat Reflection effect Moving effect (b) Illustration of working flow of RF-ECG Fig. 1. RF-ECG system scenario. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 85. Publication date: June 2018.
RF-ECG:Heart Rate Variability Assessment Based on COTS RFID Tag Array.85:3 (e.g.,USRP [10]and RFID with conductive fabric electrodes [11]),and thus are expensive compared with the commercial devices.Additionally,some professional skills are required to operate the dedicated devices,which is not suitable for applications in a ubiquitous environment.Moreover,when multiple people are within the sensing range,the device-free property prevents them from effectively distinguishing multiple human subjects and performing HRV monitoring simultaneously.Therefore,a new solution based on Commercial-off-the-Shelf (COTS)devices is desirable to the above limitations in a lightweight and distinguishable approach. 1.3 Our Approach The emerging RFID technology [15,25,27,34,37,38,40]has brought new opportunities for HRV monitoring in a more convenient and accurate approach,as the RFID tag can be regarded as an extremely lightweight sensor and its nature of identification can be used to effectively and easily distinguish different human subjects.In this paper,we propose RF-ECG,an RFID-based approach to perform HRV monitoring on human subjects,which aims to recover the IBI information with a similar accuracy as the traditional ECG based on the COTS RFID devices. Specifically,instead of designing a dedicated platform [11],we attach a set of COTS RFID tags on the chest area in the clothes of the human subject,which forms a tag array for comprehensive sensing.We deploy a COTS RFID reader to continuously interrogate these tags by issuing a continuous wave,and collect their backscattered RF-signals within the effective scanning range(1 ~3m).Similarly to the traditional ECG-based approaches,we focus on the HRV monitoring with a relatively quite environment,where the users are supposed to keep still during the measurement.Figure 1(a)illustrates the deployment of tag array of RF-ECG,where 6 tags form a 2 x 3 tag array.Through the RF-signal from the tag array,RF-ECG is able to facilitate two main applications for HRV monitoring in daily life.Firstly,by deploying the antenna above the bed,RF-ECG is able to monitor the user's heart status during sleeping.which can further enable the treatment of sleep apnea [1]and sleep stage detection [21]. Such mode can be extended to infant monitoring,because infants spend most of the time sleeping in the cribs. Secondly,since elderly people are usually less active and spend lots of time in performing more stationary activities(e.g,watching TVs),we can deploy the antenna in the living room and bedroom for efficient HRV monitoring.Such HRV monitoring can offer rapid and effective diagnostic clues for the general health evaluation. Toward these monitoring applications,Figure 1(b)further presents the diagram of our HRV monitoring approach. As the heart beats behind the human chest,the continuous wave reflected from the heart movement could be captured by the tag array,and then backscattered to the RFID reader via the RF-signals [41],which we call the reflection effect of the tag array.Meanwhile,the RF-signals are also affected by the chest movements due to human respiration,which we call the moving effect of the tag array.Hence,the RF-signals received by the RFID reader consist of heartbeat signal,respiration signal and the ambient noise from the environment.In this paper,we investigate the possibility of extracting such tiny reflection signals corresponding to the heartbeat, while eliminating other signal interferences from the human respiration and the ambient noise in the multi-path environment.In particular,according to the RF-signals received from the tag array,we develop a mechanism to capture the chest movement,aiming to cancel the respiration signal corresponding to the moving effect.Then,by using the wavelet-based signal denoising,we further extract the heartbeat signals corresponding to the reflection effect.Finally,we build a model to depict the reflection effect on RF-signals of different tags from the tag array, and extract the Inter-Beat Interval(IBI)for HRV monitoring. 1.4 Challenges There are three main challenges in performing the HRV assessment via the RFID based approach.The first challenge is to detect and extract weak heartbeat signals from RFID tags among multiple interferences caused by human respiration and ambient noises.In particular,the signal variation captured by the reflection effect from heartbeat is much weaker than the signal variation caused by the moving effect from respiration.To address Proc.ACM Interact.Mob.Wearable Ubiquitous Technol.Vol.2.No.2.Article 85.Publication date:June 2018
RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array • 85:3 (e.g., USRP [10] and RFID with conductive fabric electrodes [11]), and thus are expensive compared with the commercial devices. Additionally, some professional skills are required to operate the dedicated devices, which is not suitable for applications in a ubiquitous environment. Moreover, when multiple people are within the sensing range, the device-free property prevents them from effectively distinguishing multiple human subjects and performing HRV monitoring simultaneously. Therefore, a new solution based on Commercial-off-the-Shelf (COTS) devices is desirable to the above limitations in a lightweight and distinguishable approach. 1.3 Our Approach The emerging RFID technology [15, 25, 27, 34, 37, 38, 40] has brought new opportunities for HRV monitoring in a more convenient and accurate approach, as the RFID tag can be regarded as an extremely lightweight sensor and its nature of identification can be used to effectively and easily distinguish different human subjects. In this paper, we propose RF-ECG, an RFID-based approach to perform HRV monitoring on human subjects, which aims to recover the IBI information with a similar accuracy as the traditional ECG based on the COTS RFID devices. Specifically, instead of designing a dedicated platform [11], we attach a set of COTS RFID tags on the chest area in the clothes of the human subject, which forms a tag array for comprehensive sensing. We deploy a COTS RFID reader to continuously interrogate these tags by issuing a continuous wave, and collect their backscattered RF-signals within the effective scanning range (1 ∼ 3m). Similarly to the traditional ECG-based approaches, we focus on the HRV monitoring with a relatively quite environment, where the users are supposed to keep still during the measurement. Figure 1(a) illustrates the deployment of tag array of RF-ECG, where 6 tags form a 2 × 3 tag array. Through the RF-signal from the tag array, RF-ECG is able to facilitate two main applications for HRV monitoring in daily life. Firstly, by deploying the antenna above the bed, RF-ECG is able to monitor the user’s heart status during sleeping, which can further enable the treatment of sleep apnea [1] and sleep stage detection [21]. Such mode can be extended to infant monitoring, because infants spend most of the time sleeping in the cribs. Secondly, since elderly people are usually less active and spend lots of time in performing more stationary activities (e.g., watching TVs), we can deploy the antenna in the living room and bedroom for efficient HRV monitoring. Such HRV monitoring can offer rapid and effective diagnostic clues for the general health evaluation. Toward these monitoring applications, Figure 1(b) further presents the diagram of our HRV monitoring approach. As the heart beats behind the human chest, the continuous wave reflected from the heart movement could be captured by the tag array, and then backscattered to the RFID reader via the RF-signals [41], which we call the reflection effect of the tag array. Meanwhile, the RF-signals are also affected by the chest movements due to human respiration, which we call the moving effect of the tag array. Hence, the RF-signals received by the RFID reader consist of heartbeat signal, respiration signal and the ambient noise from the environment. In this paper, we investigate the possibility of extracting such tiny reflection signals corresponding to the heartbeat, while eliminating other signal interferences from the human respiration and the ambient noise in the multi-path environment. In particular, according to the RF-signals received from the tag array, we develop a mechanism to capture the chest movement, aiming to cancel the respiration signal corresponding to the moving effect. Then, by using the wavelet-based signal denoising, we further extract the heartbeat signals corresponding to the reflection effect. Finally, we build a model to depict the reflection effect on RF-signals of different tags from the tag array, and extract the Inter-Beat Interval (IBI) for HRV monitoring. 1.4 Challenges There are three main challenges in performing the HRV assessment via the RFID based approach. The first challenge is to detect and extract weak heartbeat signals from RFID tags among multiple interferences caused by human respiration and ambient noises. In particular, the signal variation captured by the reflection effect from heartbeat is much weaker than the signal variation caused by the moving effect from respiration. To address Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 85. Publication date: June 2018
85:4·C.Wang et al. this challenge,we develop a mechanism to depict the RF-signal variation of the tag array caused by the chest movement,helping to eliminate the part of the respiration signals corresponding to the moving effect.We further build a model to depict the reflection effect on RF-signals of different tags from the tag array.By fusing the RF-signals from multiple tags,we are able to strengthen the heartbeat signals while suppressing the signal interferences from the others. The second challenge is to achieve a fine-grained heart beat estimation for the HRV assessment according to the reflection effect.Instead of simply calculating the heart rate,which could be estimated through the Fast Fourier Transform results,the fine-grained HRV assessment requires to estimate the beat-to-beat interval by performing accurate beat segmentation.To address this challenge,after eliminating the respiration signals,we apply the wavelet-based denoising method to further filter out the ambient noise signals outside the frequency band of heart rate.The filtered signals thus can show a clear periodic pattern to facilitate fine-grained IBI segmentation.Finally, we propose a PCA-based scheme to derive a template to depict the inter-beat signals and use it to iteratively perform the IBI segmentation. The third challenge is to understand the sensing mechanism of RFID tag array and leverage the RFID tag array to perform accurate sensing on HRV.Specifically,as multiple tags are deployed on the human body,these tags can be regarded as a non-rigid body array to perceive the moving effect,since the tags may have relative displacement during the process of respiration;they can also be regarded as a rigid body array to perceive the reflection effect,after eliminating the respiration signal from the received RF-signal.To fuse multiple RF-signals from the tag array for accurate sensing,we capture the relationship between the RF-signals from the tag array and the corresponding movement from the heartbeat or respiration,via our reflection effect model and the moving effect mechanism,respectively.Based on the above techniques,we are able to perform data fusion over RF-signals from the RFID tag array for accurate sensing on HRV. 1.5 Contributions This paper makes four contributions:First,to the best of our knowledge,this is the first work that investigates the feasibility of Heart Rate Variability assessment based only on the COTS RFID.We leverage the RFID tag array to perform accurate sensing on HRV assessment in a lightweight and distinguishable approach.Second,we have conducted in-depth investigation on the sensing mechanism of RFID tag array.We develop a reflection effect model and a moving effect mechanism,respectively,to capture the relationship between the RF-signals from the tag array and the corresponding movement from the heart beat or respiration.Third,we design novel algorithms to extract the HRV from the RF-signals mixed with heartbeat signals,respiration signals,and ambient noises.We use wavelet-based signal denoising and signal fusion from tag array to remove the interferences to extract the IBI from the heartbeat signals.Fourth,we implement a system prototype for HRV assessment in the practical environment,and evaluate the performance with extensive experiments.Experiment results show that RF-ECG can achieve a median IBI error of 24ms,i.e,about 3%error of a normal IBI value,which is compatible to existing wired techniques. 2 RELATED WORK Sensor-based heartbeat detection:Photoplethysmogram(PPG)sensors are widely used for heart rate estima- tion by using a pulse oximeter,which illuminates the skin and measures the changes in light absorption [8]. Current wearable devices(e.g.,smartwatches and fitness trackers [3-5])usually use the PPG-based technology to measure the heart rate.However,body motion can easily distort the waveform of PPG,which causes large noise for heart rate sensing.To address this issue,recent research employs the inertial measurement units(IMU)to improve the overall accuracy of PPG [12,18].Besides PPG,Zou et al.develop a heart rate monitoring system using nanofiber-based strain sensors,which could be more compliant and comfortable [43].However,these Proc.ACM Interact.Mob.Wearable Ubiquitous Technol..Vol 2.No.2.Article 85.Publication date:lune 2018
85:4 • C. Wang et al. this challenge, we develop a mechanism to depict the RF-signal variation of the tag array caused by the chest movement, helping to eliminate the part of the respiration signals corresponding to the moving effect. We further build a model to depict the reflection effect on RF-signals of different tags from the tag array. By fusing the RF-signals from multiple tags, we are able to strengthen the heartbeat signals while suppressing the signal interferences from the others. The second challenge is to achieve a fine-grained heart beat estimation for the HRV assessment according to the reflection effect. Instead of simply calculating the heart rate, which could be estimated through the Fast Fourier Transform results, the fine-grained HRV assessment requires to estimate the beat-to-beat interval by performing accurate beat segmentation. To address this challenge, after eliminating the respiration signals, we apply the wavelet-based denoising method to further filter out the ambient noise signals outside the frequency band of heart rate. The filtered signals thus can show a clear periodic pattern to facilitate fine-grained IBI segmentation. Finally, we propose a PCA-based scheme to derive a template to depict the inter-beat signals and use it to iteratively perform the IBI segmentation. The third challenge is to understand the sensing mechanism of RFID tag array and leverage the RFID tag array to perform accurate sensing on HRV. Specifically, as multiple tags are deployed on the human body, these tags can be regarded as a non-rigid body array to perceive the moving effect, since the tags may have relative displacement during the process of respiration; they can also be regarded as a rigid body array to perceive the reflection effect, after eliminating the respiration signal from the received RF-signal. To fuse multiple RF-signals from the tag array for accurate sensing, we capture the relationship between the RF-signals from the tag array and the corresponding movement from the heartbeat or respiration, via our reflection effect model and the moving effect mechanism, respectively. Based on the above techniques, we are able to perform data fusion over RF-signals from the RFID tag array for accurate sensing on HRV. 1.5 Contributions This paper makes four contributions: First, to the best of our knowledge, this is the first work that investigates the feasibility of Heart Rate Variability assessment based only on the COTS RFID. We leverage the RFID tag array to perform accurate sensing on HRV assessment in a lightweight and distinguishable approach. Second, we have conducted in-depth investigation on the sensing mechanism of RFID tag array. We develop a reflection effect model and a moving effect mechanism, respectively, to capture the relationship between the RF-signals from the tag array and the corresponding movement from the heart beat or respiration. Third, we design novel algorithms to extract the HRV from the RF-signals mixed with heartbeat signals, respiration signals, and ambient noises. We use wavelet-based signal denoising and signal fusion from tag array to remove the interferences to extract the IBI from the heartbeat signals. Fourth, we implement a system prototype for HRV assessment in the practical environment, and evaluate the performance with extensive experiments. Experiment results show that RF-ECG can achieve a median IBI error of 24ms, i.e., about 3% error of a normal IBI value, which is compatible to existing wired techniques. 2 RELATED WORK Sensor-based heartbeat detection: Photoplethysmogram (PPG) sensors are widely used for heart rate estimation by using a pulse oximeter, which illuminates the skin and measures the changes in light absorption [8]. Current wearable devices (e.g., smartwatches and fitness trackers [3–5]) usually use the PPG-based technology to measure the heart rate. However, body motion can easily distort the waveform of PPG, which causes large noise for heart rate sensing. To address this issue, recent research employs the inertial measurement units (IMU) to improve the overall accuracy of PPG [12, 18]. Besides PPG, Zou et al. develop a heart rate monitoring system using nanofiber-based strain sensors, which could be more compliant and comfortable [43]. However, these Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 85. Publication date: June 2018
RF-ECG:Heart Rate Variability Assessment Based on COTS RFID Tag Array.85:5 Water RFID tag bag array RFID antenna Enlarged RFID tag array Fig.2.Empirical study setup. dedicated sensors are fairly expensive and battery-hungry,so it is not suitable for large-scale usage and long-term deployment.HB-phone [22]estimates the human heart rate based on the vibration sensors mounted on the bed,which provides the heartbeat monitoring during sleeping.However,it only provides the average heart rate during a time window without the fine-grained IBI information.Recently,researchers try to measure the heart rate by using the smartphone cameras [19,24,31],which require the user to place her fingertip on the camera.Such vision-based approaches heavily rely on the user's pose as well as the illumination condition; moreover,as the signals are collected from the weak pulse,the accuracy is relatively lower than the approaches of obtaining the signals directly from the heartbeat.In contrast,our solution measures the heartbeat using the signal reflected from the heart,which could be more accurate than the pulse-based measurement.In addition,our solution leverages the battery-free RFID tags for heartbeat detection,which is more lightweight,scalable and not limited by the battery life. RF-based heartbeat detection:Recent research has shown that RF-signals are sensitive to the changes of the multi-path environments [9,14,23,39,41],thus both the heartbeat and breathing can be detected according to the variation of the RF-signals without requiring the user to hold or wear any device.Radar-based approaches, such as FMCW [10,42],doppler radar [17,29],are accurate at measuring such tiny environmental changes However,they usually require dedicated hardware and incur high cost for daily heartbeat monitoring.Nguyen et al [30]try to estimate the respiration rate and heart rate based on a radio transceiver and a radar navigator.But it requires specific motion devices for navigation,and it only provides the coarse-grained heart rate estimation. Wi-Fi based approaches focus on estimating the vital signs using commercial off-the-shelf(COTS)Wi-Fi devices. Specifically,they mainly leverage the Channel State Information(CSI)from both the time and frequency domain to estimate the breathing rate and heart rate [26,28,36].However,both the radar and Wi-Fi based techniques cannot label the subject,due to their device free characteristic.Therefore,it is difficult to distinguish and monitor multiple users simultaneously,especially when users share similar breathing or heartbeat patterns.To address this problem,Adib et al.proposed a radar technique to monitor the vital signs of multiple people simultaneously, by separating reflectors into different buckets depending on the distance between these people and the device [10].Hence,it requires the human subjects to be separated with a considerable distance for efficient distinction In contrast to the previous work,in this paper,we propose a novel approach for heartbeat sensing via RFID tag array,which can be regarded as an extremely lightweight sensor.Moreover,its nature of identification can be used to effectively distinguish multiple human subjects,even if these human subjects are very close to each other. 3 UNDERSTANDING HEART RATE VARIABILITY 3.1 Measurement of Periodic Signal via RFID Tag Array In order to systematically study how to use an RFID tag array to passively sense a periodic signal,e.g.,the heartbeat signal,we first use a controlled experiment to investigate the reflection influence of the periodic signal on the tag array,which is reflected from a signal source without attaching an RFID tag.Specifically,we manually Proc.ACM Interact.Mob.Wearable Ubiquitous Technol,Vol.2,No.2,Article 85.Publication date:June 2018
RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array • 85:5 Enlarged RFID tag array RFID antenna RFID tag array Water bag Fig. 2. Empirical study setup. dedicated sensors are fairly expensive and battery-hungry, so it is not suitable for large-scale usage and long-term deployment. HB-phone [22] estimates the human heart rate based on the vibration sensors mounted on the bed, which provides the heartbeat monitoring during sleeping. However, it only provides the average heart rate during a time window without the fine-grained IBI information. Recently, researchers try to measure the heart rate by using the smartphone cameras [19, 24, 31], which require the user to place her fingertip on the camera. Such vision-based approaches heavily rely on the user’s pose as well as the illumination condition; moreover, as the signals are collected from the weak pulse, the accuracy is relatively lower than the approaches of obtaining the signals directly from the heartbeat. In contrast, our solution measures the heartbeat using the signal reflected from the heart, which could be more accurate than the pulse-based measurement. In addition, our solution leverages the battery-free RFID tags for heartbeat detection, which is more lightweight, scalable and not limited by the battery life. RF-based heartbeat detection: Recent research has shown that RF-signals are sensitive to the changes of the multi-path environments [9, 14, 23, 39, 41], thus both the heartbeat and breathing can be detected according to the variation of the RF-signals without requiring the user to hold or wear any device. Radar-based approaches, such as FMCW [10, 42], doppler radar [17, 29], are accurate at measuring such tiny environmental changes. However, they usually require dedicated hardware and incur high cost for daily heartbeat monitoring. Nguyen et al. [30] try to estimate the respiration rate and heart rate based on a radio transceiver and a radar navigator. But it requires specific motion devices for navigation, and it only provides the coarse-grained heart rate estimation. Wi-Fi based approaches focus on estimating the vital signs using commercial off-the-shelf (COTS) Wi-Fi devices. Specifically, they mainly leverage the Channel State Information (CSI) from both the time and frequency domain to estimate the breathing rate and heart rate [26, 28, 36]. However, both the radar and Wi-Fi based techniques cannot label the subject, due to their device free characteristic. Therefore, it is difficult to distinguish and monitor multiple users simultaneously, especially when users share similar breathing or heartbeat patterns. To address this problem, Adib et al. proposed a radar technique to monitor the vital signs of multiple people simultaneously, by separating reflectors into different buckets depending on the distance between these people and the device [10]. Hence, it requires the human subjects to be separated with a considerable distance for efficient distinction. In contrast to the previous work, in this paper, we propose a novel approach for heartbeat sensing via RFID tag array, which can be regarded as an extremely lightweight sensor. Moreover, its nature of identification can be used to effectively distinguish multiple human subjects, even if these human subjects are very close to each other. 3 UNDERSTANDING HEART RATE VARIABILITY 3.1 Measurement of Periodic Signal via RFID Tag Array In order to systematically study how to use an RFID tag array to passively sense a periodic signal, e.g., the heartbeat signal, we first use a controlled experiment to investigate the reflection influence of the periodic signal on the tag array, which is reflected from a signal source without attaching an RFID tag. Specifically, we manually Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 85. Publication date: June 2018