Download
1 / 33
330 likes | 554 Views
Brain Computer Interfaces and its Application in Aeronautics. Ing. Nay Mezannar University of Bologna University of Balamand - Lebanon. ENAV Academy September 19, 2012. Presentation Outline. Introduction BCI – How they work Interfaces and Devices Level of Development
E N D
Brain Computer Interfacesand its Application in Aeronautics Ing. Nay Mezannar University of Bologna University of Balamand - Lebanon ENAV Academy September 19, 2012
Presentation Outline • Introduction • BCI – How they work • Interfaces and Devices • Level of Development • Applications in Aeronautics • Future Projects ENAV Academy September 19, 2012
Interaction with Complex Systems Cockpit Design Air Traffic Control Maintenance Operations 1. Introduction Complex Systems Operator Design of Man Machine Interface ENAV Academy September 19, 2012
1. Introduction The research activity is based on virtual three-dimensional environments and multimodal interaction. It will be focused on: • The study, • The design, and • The evaluation of innovative man-machine interfaces. ENAV Academy September 19, 2012
2. BCI – How they work ENAV Academy September 19, 2012
2. BCI – How they work • Interaction with Machine: • Conscious Form • Direct Form Series of Commands • Interaction between People: • Facial Expression • Body Language • Perceive Feelings/Emotions Human Computer Interaction Human Interaction ENAV Academy September 19, 2012
2. BCI – How they work • Three types of Neural Sensors: • Invasive Methods (Intracortical Sensors) • Partially Invasive Methods (Electrocorticography) • Non-Invasive Methods (Electroencephalography and Electromyography) ENAV Academy September 19, 2012
2. BCI – How they work Non-Invasive Method : EEG • A recording of the electrical activity of the brain directly from the scalp produced by the firing of neurons within the brain. • No EEG signal pattern is duplicated for any two distinct actions ENAV Academy September 19, 2012
2. BCI – How they work • Billions of active neurons (nearly 170 000 km of combined axon links) • When these neurons interact, the chemical reaction emits an electrical impulse which can be measured. ENAV Academy September 19, 2012
2. BCI – How they work Effect of Brainwaves: • Electrical activity within the brain changes depending on the current mental state of an individual. • Simply, viewing/using/capturing the brainwave patterns will provide great insight into that individual’s mental state. ENAV Academy September 19, 2012
2. BCI – How they work Actions that affect the EEG signals • Muscular Movements • Expressive States • Cognitive States ENAV Academy September 19, 2012
3. Interfacesand Devices ENAV Academy September 19, 2012
3. BMI - Neuroheadset How does EPOC Neuroheadset Works? • 14 saline sensors • Measures Brain Wave Activity • Raw Data sent to PC • 3 suites • Expressiv • Affectiv • Cognitiv • Gyroscope • Measures Head Rotation ENAV Academy September 19, 2012
3. BMI - Neuroheadset Channel names based on the International 10-20 locations are: AF3, AF4, F3, F4, F7, F8, FC5, FC6, T7, T8, P7, P8, O1, O2. ENAV Academy September 19, 2012
3. BMI - Neuroheadset ENAV Academy September 19, 2012
3. BMI - Neuroheadset “you think, therefore you can” “We are looking at the tip of the iceberg, We are looking at the computer of the 70’s. Everybody knows this is going to be awesome in the future and do a lot of things” – Tan Le ENAV Academy September 19, 2012
According to NASA TRL, Emotiv EPOC is classified as TRL 3. 4. Level of Development ENAV Academy September 19, 2012
Already existing applications: Medical Applications Electro-mechanical Applications Entertainment Applications 5. Applications ENAV Academy September 19, 2012
SWARM Extreme, Controlling AR Drone using Brain Signals EEG Navigation in Virtual Reality Driving the toy car with facial expressions
5. Applications in Aeronautics C3 Command Control Communicate ENAV Academy September 19, 2012
5. Applications in Aeronautics Use of Brain activity to control an existing machine (ie. control the joystick) Use of Brain activity to control a system (ie. control the airplane) ENAV Academy September 19, 2012
5. Applications in Aeronautics • Pilots monitored by EEG ENAV Academy September 19, 2012
5. Applications in Aeronautics Types of Brainwaves: • Brainwaves are connected to different mind states, or states of consciousness. • They are divided into four predominant speed ranges, or types. ENAV Academy September 19, 2012
5. Applications in Aeronautics Neurofeedback • Uses real time displays of EEG or fMRI Goal: Controlling central nervous system activity ENAV Academy September 19, 2012
5. Applications in Aeronautics Neurofeedback: • Select a targeted area that has proven to be particularly active in a prior test for a particular task, ENAV Academy September 19, 2012
5. Applications in Aeronautics Neurofeedback: • Show to the user the level of activity that he/she should reach, ENAV Academy September 19, 2012
5. Applications in Aeronautics Neurofeedback: • After some tests, users are generally able to modulate the level of activity in the targeted region. ENAV Academy September 19, 2012
5. Applications in Aeronautics • Pilots – Neurofeedback (NASA) ENAV Academy September 19, 2012
5. Applications in Aeronautics • Pilots – Neurofeedback (NASA) ct’d ENAV Academy September 19, 2012
5. Applications in Aeronautics • Pilotinga swarm of UAV’s • Flight simulator / Cockpit • Air Traffic Control • Maintenance Operations • … ENAV Academy September 19, 2012
What do YOU use to communicate? Brain Body Voice Eyes 6. Future Projects BMI Motion Sensing Input Devices Voice Control Devices Eye Tracking ENAV Academy September 19, 2012
6. Future Projects BMI Brain Motion Sensing Input Devices Body Voice Control Devices Eyes Eye Tracking Voice Machine User ENAV Academy September 19, 2012
Nay Mezannar Second Faculty of Engineering, University of Bologna nay.mezannar@gmail.com www.unibo.it ENAV Academy September 19, 2012
