One of the key problems of brain-computer interfaces (BCI) is low signal-to-noise ratio (SNR) of electroencephalogram (EEG) signals. It affects recognition performance. To remove the artifact and noise, block under-determined blind source separation method based on the small number of channels is proposed in this paper. The non-stationary EEG signals are turned into block stationary signals by piecewise. The mixing matrix is estimated by the second-order under-determined blind mixing matrix identification. Then, the beamformer based on minimum mean square error separates the original sources of signals. Eventually, the reconstructed EEG for mixed signals removes the unwanted components of source signals to achieve suppressing artifact. The experiment results on the real motor imagery BCI indicated that the block under-determined blind source separation method could reconstruct signals and remove artifact effectively. The accuracy of motor imagery task of BCI has been greatly improved.
Common spatial pattern (CSP) is a very popular method for spatial filtering to extract the features from electroencephalogram (EEG) signals, but it may cause serious over-fitting issue. In this paper, after the extraction and recognition of feature, we present a new way in which the recognition results are fused to overcome the over-fitting and improve recognition accuracy. And then a new framework for EEG recognition is proposed by using CSP to extract features from EEG signals, using linear discriminant analysis (LDA) classifiers to identify the user's mental state from such features, and using Choquet fuzzy integral to fuse classifiers results. Brain-computer interface (BCI) competition 2005 data setsⅣa was used to validate the framework. The results demonstrated that it effectively improved recognition and to some extent overcome the over-fitting problem of CSP. It showed the effectiveness of this framework for dealing with EEG.
This paper presents a feature extraction method based on multivariate empirical mode decomposition (MEMD) combining with the power spectrum feature, and the method aims at the non-stationary electroencephalogram (EEG) or magnetoencephalogram (MEG) signal in brain-computer interface (BCI) system. Firstly, we utilized MEMD algorithm to decompose multichannel brain signals into a series of multiple intrinsic mode function (IMF), which was proximate stationary and with multi-scale. Then we extracted and reduced the power characteristic from each IMF to a lower dimensions using principal component analysis (PCA). Finally, we classified the motor imagery tasks by linear discriminant analysis classifier. The experimental verification showed that the correct recognition rates of the two-class and four-class tasks of the BCI competitionⅢand competitionⅣreached 92.0% and 46.2%, respectively, which were superior to the winner of the BCI competition. The experimental proved that the proposed method was reasonably effective and stable and it would provide a new way for feature extraction.
With the breakthroughs of digitization, artificial intelligence and other technologies and the gradual expansion of application fields, more and more studies have been conducted on the application of digital intelligence technologies such as exoskeleton robots, brain-computer interface, and spinal cord neuromodulation to improve or compensate physical function after spinal cord injury (SCI) and improve self-care ability and quality of life of patients with SCI. The development of digital intelligent rehabilitation technology provides a new application platform for the functional reconstruction after SCI, and the digital and intelligentized rehabilitation technology has broad application prospects in the clinical rehabilitation treatment after SCI. This article elaborates on the current status of exoskeleton robots, brain-computer interface technology, and spinal cord neuromodulation technology for functional recovery after SCI.
The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.
Control at beyond-visual ranges is of great significance to animal-robots with wide range motion capability. For pigeon-robots, such control can be done by the way of onboard preprogram, but not constitute a closed-loop yet. This study designed a new control system for pigeon-robots, which integrated the function of trajectory monitoring to that of brain stimulation. It achieved the closed-loop control in turning or circling by estimating pigeons’ flight state instantaneously and the corresponding logical regulation. The stimulation targets located at the formation reticularis medialis mesencephali (FRM) in the left and right brain, for the purposes of left- and right-turn control, respectively. The stimulus was characterized by the waveform mimicking the nerve cell membrane potential, and was activated intermittently. The wearable control unit weighted 11.8 g totally. The results showed a 90% success rate by the closed-loop control in pigeon-robots. It was convenient to obtain the wing shape during flight maneuver, by equipping a pigeon-robot with a vivo camera. It was also feasible to regulate the evolution of pigeon flocks by the pigeon-robots at different hierarchical level. All of these lay the groundwork for the application of pigeon-robots in scientific researches.
Affective brain-computer interfaces (aBCIs) has important application value in the field of human-computer interaction. Electroencephalogram (EEG) has been widely concerned in the field of emotion recognition due to its advantages in time resolution, reliability and accuracy. However, the non-stationary characteristics and individual differences of EEG limit the generalization of emotion recognition model in different time and different subjects. In this paper, in order to realize the recognition of emotional states across different subjects and sessions, we proposed a new domain adaptation method, the maximum classifier difference for domain adversarial neural networks (MCD_DA). By establishing a neural network emotion recognition model, the shallow feature extractor was used to resist the domain classifier and the emotion classifier, respectively, so that the feature extractor could produce domain invariant expression, and train the decision boundary of classifier learning task specificity while realizing approximate joint distribution adaptation. The experimental results showed that the average classification accuracy of this method was 88.33% compared with 58.23% of the traditional general classifier. It improves the generalization ability of emotion brain-computer interface in practical application, and provides a new method for aBCIs to be used in practice.
Stroke causes abnormality of brain physiological function and limb motor function. Brain-computer interface (BCI) connects the patient's active consciousness to an external device, so as to enhance limb motor function. Previous studies have preliminarily confirmed the efficacy of BCI rehabilitation training in improving upper limb motor function after stroke, but the brain mechanism behind it is still unclear. This paper aims to review on the brain mechanism of upper limb motor dysfunction in stroke patients and the improvement of brain function in those receiving BCI training, aiming to further explore the brain mechanism of BCI in promoting the rehabilitation of upper limb motor function after stroke. The results of this study show that in the fields of imaging and electrophysiology, abnormal activity and connectivity have been found in stroke patients. And BCI training for stroke patients can improve their upper limb motor function by increasing the activity and connectivity of one hemisphere of the brain and restoring the balance between the bilateral hemispheres of the brain. This article summarizes the brain mechanism of BCI in promoting the rehabilitation of upper limb motor function in stroke in both imaging and electrophysiology, and provides a reference for the clinical application and scientific research of BCI in stroke rehabilitation in the future.
This study investigates a brain-computer interface (BCI) system based on an augmented reality (AR) environment and steady-state visual evoked potentials (SSVEP). The system is designed to facilitate the selection of real-world objects through visual gaze in real-life scenarios. By integrating object detection technology and AR technology, the system augmented real objects with visual enhancements, providing users with visual stimuli that induced corresponding brain signals. SSVEP technology was then utilized to interpret these brain signals and identify the objects that users focused on. Additionally, an adaptive dynamic time-window-based filter bank canonical correlation analysis was employed to rapidly parse the subjects’ brain signals. Experimental results indicated that the system could effectively recognize SSVEP signals, achieving an average accuracy rate of 90.6% in visual target identification. This system extends the application of SSVEP signals to real-life scenarios, demonstrating feasibility and efficacy in assisting individuals with mobility impairments and physical disabilities in object selection tasks.
Aiming at feature selection problem of motor imagery task in brain computer interface (BCI), an algorithm based on mutual information and principal component analysis (PCA) for electroencephalogram (EEG) feature selection is presented. This algorithm introduces the category information, and uses the sum of mutual information matrices between features under different motor imagery category to replace the covariance matrix. The eigenvectors of the sum matrix represent the direction of the principal components and the eigenvalues of the sum matrix are used to determine the dimensionality of principal components. 2005 International BCI competition data set was used in our experiments, and four feature extraction methods were adopted, i. e. power spectrum estimation, continuous wavelet transform, wavelet packet decomposition and Hjorth parameters. The proposed feature selection algorithm was adopted to select and combine the most useful features for classification. The results showed that relative to the PCA algorithm, our algorithm had better performance in dimensionality reduction and in classification accuracy with the assistance of support vector machine classifier under the same dimensionality of principal components.