Inquisitive Biometic Feature Analysis and Implementation for Recognition Tasks Using Camouflaged Segmentation with AI and IoT

Mahesh Shankarrao Patil, Harsha J. Sarode, Abhijit Banubakode, Vijayakumar Varadrajan, Deshinta Arrova Dewi

Abstract


Human activity recognition is increasingly recognized as a key task in many applications. However, gathering data from the variety of sensors commonly available on end devices risks compromising user’s privacy when signals are transmitted to more powerful computing units for inference offloading. It is therefore important to design and implement strategies that could prevent privacy breaches without impairing the capability of the system of recognizing activity patterns, and by taking into account the energy constraints of low-power devices. In this work, we propose an energy-aware approach aimed at preserving the privacy of users during inference of human activities. The proposed method is based on a Machine learning Camouflaged segmentation trained to process the signal in order to remove the most sensitive information. We also perform a thorough architecture’s parameter tuning of the designed system to enable its implementation on a low-power platform, which we also characterize in terms of energy expenditure. Experimental results show that this system is capable of effectively transforming the signal in order to prevent the inference of sensitive attributes (i.e. weight, height, age, and gender) and it can be conveniently implemented on a constrained embedded system at different levels of the trade-off between accuracy and energy consumption

Keywords


Machine-learning, Camouflaged segmentation, Low-power IoT devices, Biometric recognition, Process Innovation

References


K. Gopinath, L.P. Sai, A study on the positioning of the brand variants by smartwatch manufacturers: a technometrics approach, Technol. Anal. Strategic Manag. 35 (6) (2023) 689–703.

Grand View Research, Wearable technology market size, share and trends analysis report by product, 2023, URL https://www.grandviewresearch.com/ industry-analysis/wearable-technology-market. (Last Accessed 29 January 2024).

T. Poongodi, R. Krishnamurthi, R. Indrakumari, P. Suresh, B. Balusamy, Wearable devices and IoT, in: A handbook of Internet of Things in biomedical and cyber physical system, Springer, 2020, pp. 245–273.

K. Chen, D. Zhang, L. Yao, B. Guo, Z. Yu, Y. Liu, Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities, ACM Comput. Surv. 54 (4) (2021) 1–40.

Z. Qian, Y. Lin, W. Jing, Z. Ma, H. Liu, R. Yin, Z. Li, Z. Bi, W. Zhang, Development of a real-time wearable fall detection system in the context of internet of things, IEEE Internet Things J. 9 (21) (2022) 21999–22007.

Y. Liu, Y. Mu, K. Chen, Y. Li, J. Guo, Daily activity feature selection in smart homes based on pearson correlation coefficient, Neural Process. Lett. 51 (2020) 1771–1787.

D. Talbot, The Era of Ubiquitous Listening Dawns, Tech. rep, MIT Technology Review, 2013, https://www.technologyreview.com/2013/08/08/177068/theera-of-ubiquitous-listening-dawns/.

R. Aloufi, H. Haddadi, D. Boyle, Paralinguistic privacy protection at the edge, ACM Trans. Privacy Secur. 26 (2) (2023) 1–27.

Y. Iwasawa, K. Nakayama, I. Yairi, Y. Matsuo, Privacy issues regarding the application of DNNs to activity-recognition using wearables and its countermeasures by use of adversarial training, in: IJCAI, 2017, pp. 1930–1936.

A. Jain, V. Kanhangad, Investigating gender recognition in smartphones using accelerometer and gyroscope sensor readings, in: 2016 International Conference on Computational Techniques in Information and Communication Technologies, ICCTICT, IEEE, 2016, pp. 597–602.

L. Zhang, W. Cui, B. Li, Z. Chen, M. Wu, T.S. Gee, Privacy-preserving cross-environment human activity recognition, IEEE Trans. Cybern. (2021).

E. Antwi-Boasiako, S. Zhou, Y. Liao, Q. Liu, Y. Wang, K. Owusu-Agyemang, Privacy preservation in distributed deep learning: A survey on distributed deep learning, privacy preservation techniques used and interesting research directions, J. Inf. Secur. Appl. 61 (2021) 102949.

J. Liu, Z. Zhao, P. Li, G. Min, H. Li, Enhanced embedded AutoEncoders: An attribute-preserving face de-identification framework, IEEE Internet Things J. (2023).

D. Bank, N. Koenigstein, R. Giryes, Autoencoders, 2020, arXiv preprint arXiv:2003.05991.

G. Schram, R. Wang, K. Liang, Using autoencoders on differentially private federated learning GANs, 2022, arXiv preprint arXiv:2206.12270.

M. Malekzadeh, R.G. Clegg, A. Cavallaro, H. Haddadi, Mobile sensor data anonymization, in: Proceedings of the International Conference on Internet of Things Design and Implementation, 2019, pp. 49–58.

M. Malekzadeh, R.G. Clegg, A. Cavallaro, H. Haddadi, Privacy and utility preserving sensor-data transformations, Pervasive Mob. Comput. 63 (2020) 101132.

N. Raval, A. Machanavajjhala, J. Pan, Olympus: Sensor privacy through utility aware obfuscation, Proc. Priv. Enhancing Technol. 2019 (1) (2019) 5–25.

A. Boutet, C. Frindel, S. Gambs, T. Jourdan, R.C. Ngueveu, DYSAN: Dynamically sanitizing motion sensor data against sensitive inferences through adversarial networks, in: Proceedings of the 2021 ACM Asia Conference on Computer and Communications Security, 2021, pp. 672–686.

L. Lyu, X. He, Y.W. Law, M. Palaniswami, Privacy-preserving collaborative deep learning with application to human activity recognition, in: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017, pp. 1219–1228.

D. Zhang, L. Yao, K. Chen, Z. Yang, X. Gao, Y. Liu, Preventing sensitive information leakage from mobile sensor signals via integrative transformation, IEEE Trans. Mob. Comput. 21 (12) (2021) 4517–4528.

A. Garain, R. Dawn, S. Singh, C. Chowdhury, Differentially private human activity recognition for smartphone users, Multimedia Tools Appl. 81 (28) (2022) 40827–40848.

P. Climent-Pérez, F. Florez-Revuelta, Privacy-preserving human action recognition with a many-objective evolutionary algorithm, Sensors 22 (3) (2022) 764.

S. Menasria, M. Lu, A. Dahou, PGAN framework for synthesizing sensor data privately, J. Inf. Secur. Appl. 67 (2022) 103204.

M. Malekzadeh, R.G. Clegg, H. Haddadi, Replacement autoencoder: A privacy-preserving algorithm for sensory data analysis, 2017, arXiv preprint arXiv:1710.06564.

M. Malekzadeh, R.G. Clegg, A. Cavallaro, H. Haddadi, Protecting sensory data against sensitive inferences, in: Proceedings of the 1st Workshop on Privacy By Design in Distributed Systems, 2018, pp. 1–6.

P. Delgado-Santos, R. Tolosana, R. Guest, R. Vera-Rodriguez, F. Deravi, A. Morales, GaitPrivacyON: Privacy-preserving mobile gait biometrics using unsupervised learning, Pattern Recognit. Lett. 161 (2022) 30–37.

S. Abbasi, M. Famouri, M.J. Shafiee, A. Wong, OutlierNets: highly compact deep autoencoder network architectures for on-device acoustic anomaly detection, Sensors 21 (14) (2021) 4805.

H. Ren, D. Anicic, T.A. Runkler, Tinyol: Tinyml with online-learning on microcontrollers, in: 2021 International Joint Conference on Neural Networks, IJCNN, IEEE, 2021, pp. 1–8.

A. Alsalemi, Y. Himeur, F. Bensaali, A. Amira, An innovative edge-based internet of energy solution for promoting energy saving in buildings, Sustainable Cities Soc. 78 (2022) 103571.

D.-V. Bratu, R.Ş.T. Ilinoiu, A. Cristea, M.-A. Zolya, S.-A. Moraru, Anomaly detection using edge computing AI on low powered devices, in: IFIP International Conference on Artificial Intelligence Applications and Innovations, Springer, 2022, pp. 96–107.

A. Sathiamoorthy, S. Mithusan, R. Rathnayaka, S. Kajenthiran, M.M. Hansika, D. Pandithage, StreamSafe: Improving QoS and security in IoT networks, Int. Res. J. Innovat. Eng. Technol. 7 (11) (2023) 170.

S.S. Hammad, D. Iskandaryan, S. Trilles, An unsupervised tinyml approach applied to the detection of urban noise anomalies under the smart cities environment, Internet Things 23 (2023) 100848.

H.V. Düdükçü, M. Taşkiran, ECG data anomalies detection with stacked autoencoder on low power and low memory microcontrollers, Curr. Res. Eng. (2023).

E. Oliver, R. Yue, A. Dutta, A secure vitals monitoring point-of-care device, in: 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society, EMBC, IEEE, 2023, pp. 1–4.

W. Lin, M. Xu, J. He, W. Zhang, Privacy, security and resilience in mobile healthcare applications, Enterpr. Inf. Syst. 17 (3) (2023) 1939896.

Q. Lin, Developing Wearable Applications with Innovative Sensing Modalities for Human Activity Recognition and Key Generation (Ph.D. thesis), UNSW Sydney, 2020.

M.A. Jan, F. Khan, R. Khan, S. Mastorakis, V.G. Menon, M. Alazab, P. Watters, Lightweight mutual authentication and privacy-preservation scheme for intelligent wearable devices in industrial-CPS, IEEE Trans. Ind. Inf. 17 (8) (2020) 5829–5839.

E. Lattanzi, M. Donati, V. Freschi, Exploring artificial neural networks efficiency in tiny wearable devices for human activity recognition, Sensors 22 (7) (2022) 2637.

C. Contoli, E. Lattanzi, A study on the application of TensorFlow compression techniques to human activity recognition, IEEE Access 11 (2023) 48046–48058, http://dx.doi.org/10.1109/ACCESS.2023.3276438.

Tensorflow official website, 2023, http://www.tensorflow.org/?hl=en. (Accessed: 10 July 2023).

Espressif, ESP32-C3-WROOM-02 datasheet, 2022, URL https://www.espressif.com/en/support/documents/technical-documents. (last accessed 22 June 2023).

N. Ketkar, Introduction to keras, in: Deep Learning with Python, Springer, 2017, pp. 97–111.

L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, A. Talwalkar, Hyperband: A novel bandit-based approach to hyperparameter optimization, J. Mach. Learn. Res. 18 (1) (2017) 6765–6816.

M. Malekzadeh, R.G. Clegg, A. Cavallaro, H. Haddadi, Mobile sensor data anonymization, in: Proceedings of the International Conference on Internet of Things Design and Implementation, IoTDI ’19, ACM, New York, NY, USA, 2019, pp. 49–58,

G. Vavoulas, C. Chatzaki, T. Malliotakis, M. Pediaditis, M. Tsiknakis, The mobiact dataset: Recognition of activities of daily living using smartphones, in: International Conference on Information and Communication Technologies for Ageing Well and E-Health, Vol. 2, SciTePress, 2016, pp. 143–151.

O. Banos, J.-M. Galvez, M. Damas, H. Pomares, I. Rojas, Window size impact in human activity recognition, Sensors 14 (4) (2014) 6474–6499.

J. Cheng, O. Amft, P. Lukowicz, Active capacitive sensing: Exploring a new wearable sensing modality for activity recognition, Int. Conf. Pervasive Comput. (2010) 319–336. [50] M.M. Hassan, M.Z. Uddin, A. Mohamed, A. Almogren, A robust human activity recognition system using smartphone sensors and deep learning, Future Gener. Comput. Syst. 81 (2018) 307–313.

C. Hou, A study on IMU-based human activity recognition using deep learning and traditional machine learning, in: 2020 5th International Conference on Computer and Communication Systems, ICCCS, IEEE, 2020, pp. 225–234.

M. Sokolova, G. Lapalme, A systematic analysis of performance measures for classification tasks, Inf. Process. Manag. 45 (4) (2009) 427–437.

InvenSense Inc., MPU-6050 product specification, 2023, URL https://invensense.tdk.com/products/motion-tracking/6-axis/mpu-6050/. (Last Accessed 22 June 2023).

Rohde&Schwarz, NGMO2 datasheet, 2020, URL https://www.rohde-schwarz.com/it/brochure-scheda-tecnica/ngmo2/. (Last Accessed 22 June 2023).

National.Instruments, PC-6251 datasheet, 2020, URL http://www.ni.com/pdf/manuals/375213c.pdf. (Last Accessed 22 June 2023).

National.Instruments, Installation guide BNC-2120, 2020, URL http://www.ni.com/pdf/manuals/372123d.pdf. (Last Accessed 22 June 2023).

B. Hjorth, EEG analysis based on time domain properties, Electroencephalogr. Clin. Neurophysiol. 29 (3) (1970) 306–310.

T.-H. Kim, H. White, On more robust estimation of skewness and kurtosis, Finance Res. Lett. 1 (1) (2004) 56–73.

Trivedi, Payal, et al. "Plant leaf disease detection and classification using segmentation encoder techniques." The Open Agriculture Journal 18.1 (2024).




DOI: http://doi.org/10.11591/ijres.v14.i2.pp%25p

Refbacks

  • There are currently no refbacks.


StatCounter - Free Web Tracker and Counter

View the IJRES Visitor Statistics

International Journal of Reconfigurable and Embedded Systems (IJRES)
ISSN: 2722-2608, e-ISSN 2722-2608
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

 

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.