Virtual Reality visualization of live EEG data
?Download as PPTX, PDF?
1 like?6,090 views
Presentation of a talk I gave at the Art of Neuroscience symposium in Amsterdam March 24th 2015. (http://aon.nin.knaw.nl/) In the talk I present the project our team has made at the Hack the Brain hackathon (www.hackthebrain.nl). More information about the project can be found here: http://www.robindelange.com/hackthebrain/
Virtual Reality visualization of live EEG data
- 1. ART OF NEUROSCIENCE 2015 Live visualization of EEG data in Virtual Reality Robin de Lange
- 2. Hack the Brain Universiteit Leiden www.robindelange.com
- 3. Hack the Brain - Program Public debate ? Lectures by Pim Haselager, Victor Lamme and Arnon Grunberg Hackathon ? 45 programmers, designers, artists and scientists ? Teams with own projects ? EEG scanners & FabLab facilities ? Researchers from TNO and Donders Institute Universiteit Leiden www.robindelange.com
- 4. Hack the Brain – Brain Computer Interfaces A bit skeptical about BCIs 1. Many projects and devices tend to oversell ? Really hard to measure mental events like emotions or thoughts 2. Many projects that detect electrical activity associated with moving a part of your body ? Useful for physically disabled people ? For others: why not use the native input and output modules?Universiteit Leiden www.robindelange.com
- 5. Hack the Brain - Output Universiteit Leiden www.robindelange.com
- 6. Hack the Brain - Output Universiteit Leiden www.robindelange.com
- 7. Hack the Brain - Media Universiteit Leiden www.robindelange.com
- 9. Project Brainstorm – Technical realization Universiteit Leiden www.robindelange.com
- 10. Project Brainstorm – Technical realization Universiteit Leiden www.robindelange.com
- 11. Project Brainstorm – Technical realization Universiteit Leiden www.robindelange.com
- 12. Project Brainstorm – Technical realization Universiteit Leiden www.robindelange.com
- 13. Challenges: 1. Understand the nature of the data and types of brain waves 2. Transform the data to be interpreted in different programming environments Universiteit Leiden www.robindelange.com Project Brainstorm – Technical realization
- 14. Project Brainstorm – Technical realization Universiteit Leiden www.robindelange.com ? Matlab + Buffer BCI ? Output: stream of amplitude of alpha waves per channel ? In Unity3D ? read out amplitudes and link them to the intensity of the visual effects
- 15. Project Brainstorm – Experience Universiteit Leiden www.robindelange.com DEMO
- 16. Project Brainstorm – Further development Universiteit Leiden www.robindelange.com Project created in three days, by people with little experience How to extend this project?
- 17. Project Brainstorm – Further development Universiteit Leiden www.robindelange.com ? Potential of immersive data visualization ? EEG data in form that is hard to understand for humans ? Data visualization makes data easier to understand ? Immersive data visualization uses 3D navigation skills
- 18. Project Brainstorm – Further development Universiteit Leiden www.robindelange.com Create a complete VR interface for studying EEG data ? Improve data analysis and visualization ? Selecting different brain waves ? Interaction to optimize visualization
- 19. My research Universiteit Leiden www.robindelange.com Exploring how Augmented and Virtual Reality technologies can help us in understanding complex problems Generate ideas for applications of VR in different fields Elective: creating a VR prototype