International Journal of Electrical and Electronic Engineering & Telecommunications Vol. 7, No.

4, October 2018

LabVIEW GUI for Emotiv EPOC of Prosthetic

Hand Control
Muhammad Azmi Ayub1, Aainaa Zainal1, Khairunnisa Johar1, Noor Ayuni Che Zakaria1, and Cheng Yee
Low2
1
Faculty of Mechanical Engineering, Universiti Teknologi MARA Shah Alam, Selangor, Malaysia
2
Faculty of Mechanical and Manufacturing Engineering, Universiti Tun Hussein Onn Malaysia, Johor, Malaysia
Email: {muhammadayub, ayuni8098}@salam.uitm.edu.my; {naina_aainaa, khairunnisa_johar}@yahoo.com;
[email protected]

Abstract—The usual body-powered prosthetics is tiring and allowances incentives were given to the registered
lead to compliance and restoration problems. Brain disabled employer by the Malaysian government for them
computer interface (BCI) prosthetic is one of the advanced to purchase the prosthetics products through the
technologies opening up new possibility in providing government hospitals. Based on the development of
healthcare solutions for people with severe motor
modern technology now, various tools can help amputee
impairment. Generally, electroencephalography (EEG) is
historically dominated by BCI researchers for prosthetics to improve and increase the ability of human cognitive or
control. An issue with EEG user BCI researchers are tend to sensory-motor functions [3].
use invasive recording methods, posing surgical risks to One of the technologies, is known as brain computer
generate control signals from brain activity patterns. This interfaces (BCI); a modern technology and is explored in
paper aims at reviewing the conceptual design for a non- many different fields such as communication, neuro-
invasive approach for controlling a prosthetic hand using an prosthetics, robotics and mobility. The signals are
Emotiv EEG Headset integrated with a graphical user collected whether using invasive, partial invasive or non-
interface (GUI) designed in LabVIEW. EEG signals were
recorded from healthy subjects through brain wave rhythm
invasive method. There are four methods to record
at F3 and FC5 of motor cortex area focusing on the artifact microvolt-level extracellular potentials generated by
of upper limb movement; finger flexion-rest-extension. Five neurons in the cortical layers; electroencephalography
healthy subjects was selected for the conceptual proof and (EEG), electrocorticography (ECoG), local field
controlling a robot hand. The accuracies of data potentials (LFPs), and single-neuron action potential
classification for the finger movement for all subjects recordings (single units) [4]. Invasive method requires the
exceeding the 50% for binary classification with average of patient undergo surgery of electrode implantation into
57.96%. This device can be used for paralyzed individuals
their skull. Partial invasive method or called ECoG also
with limited communication to control prosthetics using
required the implantation of electrode inside the skull but
simple GUI. 
above the grey matter. The non-invasive method or EEG
Index Terms—electroencephalography, emotiv EPOC, which is the most popular method used among
LabVIEW, prosthetic hand researchers only placed on the scalp to obtain the signal
[5]. These signals then will be processed and send as
I. INTRODUCTION command to the output devices. BCI can be used to
People who are having difficulties in interacting with restore communication to people who suffer severe motor
the community due to the long-term physical, mental, disabilities such as brainstem stroke, amyotrophic lateral
intellectual or sensory impairments are called amputees sclerosis and spinal cord injury (quadriplegia) [6], [7].
[1]. The lives of the amputees are very challenging in The most challenging part in BCI researches is the
struggling with the disabilities and the self-esteem. The features extraction process of random time-varying EEG
disabilities are divided into several groups such as signals and its classification according to the brain signal
Hearing Impairment, Lack of Vision, Physical unique pattern. Thus, EEG based neuro-prosthetic
Disabilities, Speech Disabilities, Learning Disabilities, devices is yet to be in the market and still undergoes
Mental Disabilities and Cerebral Palsy. Amputees in demonstration. The aim of this study is to develop a
Malaysia must be registered with the Ministry of National concept of a neuro-prosthetics hand for amputee which
Unity and Social Development under the Ministry of includes the designing of a graphical user interface (GUI)
Women and Family Development. From WHO data, using LabVIEW software to capture brain signal using
0.5% of the population of a developing country have a Emotiv EEG Headset. An experimental evaluation to
disability that require prosthetics/orthotics devices [1]. recognize brain wave pattern is conducted to evaluate the
From this WHO prediction, it suggests that around concept.
150,000 of Malaysia’s current population of 30 million [2]
need prosthetic or orthotic devices. This number shows II. CONCEPT OF BCI-EEG SYSTEM
that, an amputee in Malaysia is very high. Medical
Apart from the neuro-prosthetics hand applications,
Manuscript received February 25, 2018; revised July 19, 2018. BCI is also used to control Wheelchair [8], [9],

©2018 Int. J. Elec. & Elecn. Eng. & Telcomm. 190

doi: 10.18178/ijeetc.7.4.190-194
 International Journal of Electrical and Electronic Engineering & Telecommunications Vol. 7, No. 4, October 2018

humanoid robot [10] and mobile robot [11]. There are A complex mechanical BCI system would allow a user
several techniques to collect or mapping the brain which to control an external system possibly a neuro-prosthetic
is through computational topography (CT), magnetic device by creating an output of specific EEG frequency.
resonance imaging (MRI), functional magnetic resonance The EEG records a signal by placing electrodes on the
imaging (fMRI), positron emission tomography (PET), scalp with a conductive gel. Electrodes measures voltage
magnetoencephalography (MEG), EEG, and functional differences at the skin in the microvolt (μV) range.
near infra-red (FNIR) Spectroscopy. A BCI-EEG system is comprised of four different
In this concept, we are focusing on implementation of stages of signal acquisition, signal pre-processing, feature
BCI with EEG. EEG is an activity of recording the extraction and classification, and computer interaction,
electric fields produced by brain by placing electrodes on illustrated in Fig. 2. Signal Acquisition is acquired
the scalp. Local field potential (LFP) are generated as a through the Emotiv EEG headset and two stages of signal
result of the synaptic activities from hundreds of neurons pre-processing and feature extraction and classification is
over the integrated area at the electrode in a synchronized conducted using LabVIEW software. LabVIEW software
manner [12]. In 1924, according to Hans Berger who was is connected to the Arduino driver via USB serial data
the first to record the EEG, human brain waves called connection to completing the BCI four stages. The
Berger or also known as the Alpha wave (8-12 Hz) have a advantage of using LabVIEW is its ability to connect
very low signal. Electrodes are able to measures voltage with other open source drivers. LabVIEW and Arduino is
differences on the skin in the microvolt (µV) range. By linked with specific palette called VISA in VI. Details of
providing some amplification to the acquired signals will each stages is elaborated further in next sections.
bring it up to the millivolt level and can make it available
for digital signal processing. Electrodes used are usually
made up of conductive materials such as gold or silver
chloride. A conductive gel is applied to the electrodes to
enhance its conductivity as well as maintain an
acceptable signal to noise ratio [12].
Despite of instable signal, EEG have excellent
temporal resolution of less than a millisecond. The signal
can be analyzed according to its low frequency bands in
Herts [Hz]. The different waves of brain signals are delta,
theta, alpha, beta and gamma as demonstrated in Fig. 1. Figure 2. Concept of BCI – EEG for neuro-prosthetic hand.
Research has shown the advantages of deploying EEG
technology to offer new solutions in prosthetic devices.
Typically, most research using EEG for rapid III. DATA ACQUISITION
communication with the equipment for easier and cheaper
solution. Furthermore, the EEG has less procedures as Data Acquisition is collected through Emotiv EEG
well as more practical for patients and researchers [13]. headset. The working principle of EEG Emotiv headset is
In addition, the surface EEG does not require surgery. to capture the brain signal in microvolt (μV) produced
during specific activities. Emotiv EEG headset, comes
pre-configured with 14 electrodes located over 10-20
International System positions AF3, F7, F3, FC5, T7, P7,
O1, O2, P8, T8, FC6, F4, F8, and AF4 using 2 reference
electrodes show in Fig. 3. The concept of this study is to
acquire signals from the motor cortex area, thus the
arrangement of Emotiv Headset electrodes focusing on
the pre-motor and frontal regions is found suitable for the
development process at F3 and FC5 location. The headset
aligns; band pass filters, and digitizes the signal at 128 Hz
before transmitting wirelessly to a laptop.

(a) (b) (c)

Figure 3. 10-20 System electrodes position: (a) functional areas of the
cerebral cortex, (b) f3 electrodes placement on pre-motor area, part of
Figure 1. Brain waves classifications according to frequency [Hz]. motor cortex, and (c) Emotiv electrode positions.

©2018 Int. J. Elec. & Elecn. Eng. & Telcomm. 191

 International Journal of Electrical and Electronic Engineering & Telecommunications Vol. 7, No. 4, October 2018

IV. SIGNAL PRE-PROCESSING, FEATURE EXTRACTION used to determine the connection setting USB COM port
& CLASSIFICATION and bit data. While the second consumer interface
integration serves as a data graph. There is also the status
Signal pre-processing and feature extraction and
of eye movement and status subject movement of
classification stages are concluded in LabVIEW
prosthetic hand. It will also show error status if there are
programming. LabVIEW program is one of the products
problems in this programming.
of National Instrument (NI) in 1986 under the name
Laboratory Virtual Instrument Engineering Workbench
(LabVIEW). LabVIEW program is also referred to as
virtual instrument (VI) because some operations in
LabVIEW icon resembling instruments like oscilloscopes
and multimeters. LabVIEW is a graphical programming
language or Graphical Programming lined with a variety
of virtual icons to replace the text programming in
generating application. LabVIEW Software is different
from other software compiler such as MATLAB and
visual BASIC, which are using a text programming.
Programming in LabVIEW is modular in which a Figure 4. Front Panel neuro-prosthetic hand
complex program can be created in a number of other
sub-programs.
In signal pre-processing phase, the EEG signal data is
validated then loaded into the LabVIEW program to
clean it from insignificant artifacts. It is required to clean
the signal data before can be processed further to get
higher classification rates [14]. Then, a cleaned signal
data is sent to be extracted and classified. Classification is
important to determine the pattern recognition of the
brain waves signal of specific activities to control the
neuro-prosthetic hand.
LabVIEW is comprised of three main components; the Figure 5. Subject try to control the neuro-prosthetic hand.
first is the front panel user interface. The second is the
block diagram consisting of graphics resources that The feedback of the brain waves is sent to the
represent functions of the VI and the third component is MechaTE LEFT Robot Hand, a completed five fingers
intended as a connection panel to connector every hand with five degrees of freedom using micro servo
function VI for perfect data flow. Each VI has the motor. The MechaTE LEFT Robot Hand is improved by
functions of each system and represents the specific adding a prosthetic hand finger tips to get more friction
information that is used to transfer data to the computer. for a better grasping movement. The fingertip is designed
The LabVIEW used in particular is connected to using CATIA software and printed using a 3D Printer
MATLAB for the data analysis. The LabVIEW for neuro- Machine.
prosthetics hand is connected with MyRIO drivers. The
advantage of using LabVIEW is that it has the virtual VI. EVALUATION & RESULTS
instrument package manager (VIPM) use toolkit that can The inclusion criteria for the screening of subjects
be upgraded and can use a third party such as a toolkit include the following; a) adult above 18 years old, b)
that can be used in research such as VISA Toolkit, and healthy, c) right-handed, with d) no brain injuries history.
Emotiv Toolkit and Arduino Toolkit. Arduino Toolkit is The subjects are trained to control the prosthetic hand
implemented in this development concept. using finger flexion-rest-extension for brain wave pattern
classifications. During the recording, the subjects were
V. COMPUTER INTERACTION & FEEDBACK asked to sit in a comfortable armchair and a computer
Graphical user interface (GUI) is a monitoring system monitor was fixated in front of the subjects. The subject
which is used in this project was developed by using were asked to perform resting, isometric finger extension
LabVIEW software. The advantage of using LabVIEW and flexion movements, based on a visual stimuli
software is to monitor the voltage on pin Arduino via data presented to the subjects via a computer monitor and to
serial and controlling servo motor using LabVIEW GUI. hold those positions against resistance. The visual stimuli
Arduino has the ability to transmit data in serial form and presented last four seconds and is embedded into a 10
display on a computer monitor, but only in the form of a second cycle including two seconds for baseline
digit number. But LabVIEW has the capability to process correction, and four seconds for the subject to relax the
serial data which is sent to a chart or graphical graph for hand, blink and swallow . The duration of the recording is
more details illustrated in Fig. 4. 60 minutes for each subject. Subjects also need to
This simple GUI template was developed using two minimize the body movement, eyes movement and eyes
consumers setting and simulation. Consumer setting is blinking during recording to decrease signal noise.

©2018 Int. J. Elec. & Elecn. Eng. & Telcomm. 192

 International Journal of Electrical and Electronic Engineering & Telecommunications Vol. 7, No. 4, October 2018

For classification of EEG data, ERD/ERS is referred From the data classifications above, we are able to
for any energy changes of specific frequencies at motor recognize finger flexion-rest-extension pattern through
cortex and increase or decrease in specific frequency the EEG signals. The classification accuracies for finger
bands. An algorithm to solve this is the spectrally- flexion versus finger extension for subjects 1, 2, 3, 4 and
weighted common spatial pattern (Spec-CSP). It 5 are 56.5%, 56.3%, 57.9%, 60.4%, and 58.7%
generates filter vectors that assign a weight to different respectively. Comparing to the random guessing level of
locations and frequencies in order to maximize the 50% for binary classification [16], [17], the evaluation
difference between finger extension, flexion and rest. shows better classification.

Figure 6. Spec-CSP filtered spatial projections from one subject.

Fig. 6, shows the sample of Spec-CSP data projections

from one subject. The classification rates between
extension versus rest, flexion versus rest and extension
versus flexion are calculated using 5-fold cross validation.
The interval providing the best classification result is
used [15] in the analysis. This change of interval allows
finding the part of data that holds the most relevant
information for classification. In machine learning
Figure 7. Time frequency decompositions of FC5 electrode activities for
method, data with label will be trained in training all subjects.
function to calibrate a model. Then a new data with
model calibration will be applied into a predict function
to class a label. VII. CONCLUSION
To generalize the narrow-band ERD/ERS, the baseline
or epoch-mean power spectrum and the event-related The main objectives of this research are to develop a
spectral perturbation (ERSP) of FC5 electrode at each concept of neuro-prosthetics hand, acquiring the signal
subject were measured in time frequency analysis. data from the EEG Emotiv Headset and develop a GUI
Calculating an ERSP requires computing the power using LabVIEW software based on the signal obtained
spectrum over a sliding latency window and averaging from the Emotiv EEG headset. An EEG data
across data trials. The color at each image pixel indicates classifications of finger flexion-rest-extension movement
power (in dB) at a given frequency and latency relative to has been successfully conducted offline. A real-time
the time locking event. From Fig. 7, subject 1, 2, 3, 4 and evaluation with the LabVIEW control system using
5 shows de-synchronization of beta rhythms (14-30 Hz) MechaTE Robot Hand shall proves the concept further.
in the respective area (FC5) for right finger movement. Towards development of neuro-prosthetic hand with BCI
Significant EEG changes were observed over FC5 since it control, the classification accuracy is playing the main
is the closest to the primary sensorimotor area. In all five role in interpreting signal data. Based on review [18],
subjects, differentiation between isometric finger flexion classification of different movements of the same hand
and extension movement for right handed subject was should increase the number of separable classes available
possible within the beta band (14-30 Hz). for a BCI system.

©2018 Int. J. Elec. & Elecn. Eng. & Telcomm. 193

 International Journal of Electrical and Electronic Engineering & Telecommunications Vol. 7, No. 4, October 2018

ACKNOWLEDGMENT [14] K. Johar, C. Y. Low, F. A. Hanapiah, A. Jaffar, and M. A. A.

Kasim, “Towards the development of an electroencephalography
The research team thanks Universiti Teknologi MARA based neuroprosthetic terminal device,” J. Teknol., vol. 76, no. 4,
(UiTM) Shah Alam, Selangor and the National 2015.
[15] J. Boelts, A. Cerquera, and F. Ruiz-olaya, “Decoding of imaginary
Instruments (NI) for supporting this research under the motor movements of fists applying spatial filtering in a BCI
grant number 600-IRMI/PERDANA 5/3 BESTARI simulated application,” Artif. Comput. Biol. Med., vol. 3, pp. 153–
(087/2018) and 2017 Academic Research Grant Program. 162, 2015.
[16] G. Lange, C. Y. Low, K. Johar, F. A. Hanapiah, and F.
Kamaruzaman, “Classification of electroencephalogram data from
REFERENCES hand grasp and release movements for BCI controlled prosthesis,”
[1] World Health Organization. Guidelines for training personnel in Procedia Technol., vol. 26, pp. 374–381, 2016.
developing countries for prosthetics and orthotics services, [17] G. R. Müller-Putz and G. Pfurtscheller, “Control of an electrical
Geneva, 2005. prosthesis with an SSVEP-based BCI,” IEEE Trans. Biomed. Eng.,
[2] Malaysia Statistics Department. Population clock. (2018). [Online]. vol. 55, no. 1, pp. 361–364, 2008.
Available: https://www.dosm.gov.my [18] A. Vuckovic and F. Sepulveda, “Delta band contribution in cue
[3] J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, P. based single trial classification of real and imaginary wrist
H. Peckham, G. Schalk, and T. M. Vaughan, “Brain-Computer movements,” Med. Biol. Eng. Computer, no. 46, pp. 529–539,
interface technology: A review of the first international meeting,” 2008.
IEEE Trans. on Rehabilitation Engineering , vol. 8, no. 2, pp.
164–173, 2000. Muhammad Azmi Ayub is currently the Dean of the Faculty of
[4] A. B. Schwartz, X. T. Cui, D. J. Weber, and D. W. Moran, “Brain- Mechanical Engineering, Universiti Teknologi MARA Selangor,
controlled interfaces: Movement restoration with neural Malaysia. His research interest are particularly related to Control
prosthetics,” Neuron, vol. 52, pp. 205–220, 2006. System Engineering, Design and Modeling of Mechatronic Systems,
[5] Q. Li, D. Ding, and M. Conti, “Brain-Computer Interface Visual Servo Control, Vision Directed Laser Materials Processing,
applications: Security and privacy challenges,” in Proc. IEEE Automation, Unmanned Ground Vehicles, Machine Vision,
Conf. on Communications and Network Security, 2015, pp. 663- Mechatronics And Robotics System, and Engineering Education. He has
666. been with Faculty of Mechanical Engineering, Universiti Teknologi
[6] J. Wolpaw, N. Birbaumer, D. McFarland, G. Pfurtscheller, T. MARA, Selangor Malaysia since 1990 and is registered with Board of
Vaughan, “Brain-computer interfaces for communication and Engineers Malaysia as a Professional Engineer carrying the title of Ir.
control.,” Clinical Neurophysiology, vol. 113, no. 6, pp. 767-91,
2002. Aainaa Zainal is currently registered as a student in Master of Science
[7] T. Kaufmann, S. Schulz, A. Köblitz, G. Renner, C. Wessig, and A. in Mechanical Engineering (By Research) at Universiti Teknologi
Kübler, “Face stimuli effectively prevent brain-computer interface MARA. Her research interest involves prosthetic hand and robotics
inefficiency in patients with neurodegenerative disease,” Clinical technology.
Neurophysiology, vol. 124, no. 5, pp. 893-900, 2013.
[8] B. Rebsamen, C. Guan, H. Zhang, C. Wang, C. Teo, M. H. Ang, Khairunnisa Johar is currently registered as a Ph.D. candidate in the
and E. Burdet, “A brain controlled wheelchair to navigate in Faculty of Mechanical Engineering at Universiti Teknologi MARA. Her
familiar environments,” IEEE Trans. on Neural Systems and research interest involves bio-mechanical engineering, EEG-EMG data
Rehabilitation Engineering, vol. 18, no. 6, pp. 590–598, 2010. analysis, and prosthetic hand technology. She is pursuing her study in
[9] Y. Wang, B. Hong, X. Gao, and S. Gao, “Implementation of a the field of rehabilitation engineering.
brain-computer interface based on three states of motor imagery,”
in Proc. Annual Int. Conf. of the IEEE Engineering in Medicine Noor Ayuni Che Zakaria is currently the Malaysia Coordinator of the
and Biology, 2007, pp. 5059–5062. Research Alliance for Intelligent System in Medical Technology
[10] M. Bryan, J. Green, M. Chung, L. Chang, R. Scherer, J. Smith, (RAISE-MED), a project that establishing the relation of Germany –
and R. P. N. Rao, “An Adaptive brain-computer interface for Malaysia in system intelligent field. Her research interests include
humanoid robot control,” in Proc. 11th IEEE-RAS International Mechatronic Intelligent Systems, Medical Internet of Things and
Conference on Humanoid Robots, 2011, pp. 199–204. Rehabilitation Engineering. She was graduated from the Shibaura
[11] V. Bento, L. Paula, A. Ferreira, N. Figueiredo, A. Tomé, F. Silva, Institute of Technology, Japan with the Doctor of Philosophy
and J. Paulo, “Advances in EEG-based brain-computer interfaces (Functional Control System) in the year of 2016.
for control and biometry,” presented at the 7th Int. Conf. on Image
Analysis and Recognition, Póvoa de Varzim, June 2010. Low Cheng Yee was graduated from Paderborn University in the state
[12] T. D. Sunny, T. Aparna, P. Neethu, et al., “Robotic arm with of North Rhine-Westphalia in Germany with the Doctor of Philosophy
brain-computer interfacing,” Procedia Technology, vol. 24, pp. (Mechatronics) in the year of 2009. He is currently the Head of the
1089-1096, 2016. Advanced Dynamic Control Research Group in Universiti Tun Hussein
[13] R. G. de P. Menendez, Q. Noirhomme, F. Cincotti, D. Mattia, F. Onn Malaysia and also the Malaysia Coordinator of Research Alliance
Aloise, and S. G. Andin, “Modern electrophysiological methods for Intelligent System in Medical Technology (RAISE-MED). His
for brain-computer interfaces,” Computational Intelligence and research interests involves Smart Health, Mechatronics Rehabilitation,
Neuroscience, 2007. Robotics, and Design Methodology.

©2018 Int. J. Elec. & Elecn. Eng. & Telcomm. 194