In:
Journal of Neural Engineering, IOP Publishing, Vol. 19, No. 4 ( 2022-08-01), p. 046051-
Abstract:
Objective. Recent technological advances show the feasibility of fusing surface electromyography (sEMG) signals and movement data to predict lower limb ambulation intentions. However, since the invasive fusion of different signals is a major impediment to improving predictive performance, searching for a non-invasive (NI) fusion mechanism for lower limb ambulation pattern recognition based on different modal features is crucial. Approach . We propose an end-to-end sequence prediction model with NI dual attention temporal convolutional networks (NIDA-TCNs) as a core to elegantly address the essential deficiencies of traditional decision models with heterogeneous signal fusion. Notably, the NIDA-TCN is a weighted fusion of sEMG and inertial measurement units with time-dependent effective hidden information in the temporal and channel dimensions using TCN and self-attentive mechanisms. The new model can better discriminate between walking, jumping, downstairs, and upstairs four lower limb activities of daily living. Main results . The results of this study show that the NIDA-TCN models produce predictions that significantly outperform both frame-wise and TCN models in terms of accuracy, sensitivity, precision, F1 score, and stability. Particularly, the NIDA-TCN with sequence decision fusion (NIDA-TCN-SDF) models, have maximum accuracy and stability increments of 3.37% and 4.95% relative to the frame-wise model, respectively, without manual feature-encoding and complex model parameters. Significance . It is concluded that the results demonstrate the validity and feasibility of the NIDA-TCN-SDF models to ensure the prediction of daily lower limb ambulation activities, paving the way to the development of fused heterogeneous signal decoding with better prediction performance.
Type of Medium:
Online Resource
ISSN:
1741-2560
,
1741-2552
DOI:
10.1088/1741-2552/ac89b4
Language:
Unknown
Publisher:
IOP Publishing
Publication Date:
2022
detail.hit.zdb_id:
2135187-9
SSG:
12
Permalink