Data augmentation for self-paced motor imagery classification with C-LSTM.

File Description SizeFormat 
Freer+et+al_2019_J._Neural_Eng._10.1088_1741-2552_ab57c0.pdfFile embargoed until 14 November 20201.33 MBAdobe PDF    Request a copy
Title: Data augmentation for self-paced motor imagery classification with C-LSTM.
Authors: Freer, D
Yang, G-Z
Item Type: Journal Article
Abstract: OBJECTIVE: Brain Computer Interfaces (BCI) are becoming important tools for assistive technology, particularly through the use of Motor Imagery (MI) for aiding task completion. However, most existing methods of MI classification have been applied in a trial-wise fashion, with window sizes of approximately 2 seconds or more. Application of this type of classifier could cause a delay when switching between MI events. APPROACH: In this study, state-of-the-art classification methods for motor imagery are assessed with considerations for real-time and self-paced control, and a Convolutional Long-Short Term Memory (C-LSTM) network based on Filter Bank Common Spatial Patterns (FBCSP) is proposed. In addition, the effects of several methods of data augmentation on different classifiers are explored. MAIN RESULTS: The results of this study show that the proposed network achieves adequate results in distinguishing between different control classes, but both considered deep learning models are still less reliable than a Riemannian Minimum Distance to the Mean (MDM) classifier. In addition, controlled skewing of the data and the explored data augmentation methods improved the average overall accuracy of the classifiers by 14.0% and 5.3%, respectively. SIGNIFICANCE: This manuscript is among the first to attempt combining convolutional and recurrent neural network layers for the purpose of MI classification, and is also one of the first to provide an in-depth comparison of various data augmentation methods for MI classification. In addition, all of these methods are applied on smaller windows of data and with consideration to ambient data, which provides a more realistic test bed for real-time and self-paced control.
Issue Date: 14-Nov-2019
Date of Acceptance: 14-Nov-2019
DOI: 10.1088/1741-2552/ab57c0
ISSN: 1741-2552
Publisher: IOP Publishing
Journal / Book Title: Journal of Neural Engineering
Copyright Statement: As the Version of Record of this article is going to be/has been published on a subscription basis, this Accepted Manuscript will be available for reuse under a CC BY-NC-ND 3.0 licence after a 12 month embargo period.
Keywords: Brain Computer Interface
Data Augmentation
Deep Learning
Motor Imagery
Brain Computer Interface
Data Augmentation
Deep Learning
Motor Imagery
0903 Biomedical Engineering
1103 Clinical Sciences
1109 Neurosciences
Biomedical Engineering
Publication Status: Published online
Conference Place: England
Embargo Date: 2020-11-14
Online Publication Date: 2019-11-14
Appears in Collections:Computing

Items in Spiral are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons