Final : From Dreams to Thought Bubbles – Julie Huynh
Initial Project Statement:
Using a brainwave sensor as the next step in my immersive tools research to access the recesses of dreams because they can create the most enveloping environments in your mind tricking your body and senses to believe you are in another environment.
Science Fiction to Reality
Brainwave Sensor Options:
Emotiv 14 Channel Sensor
OpenBCI 8 Channel Sensor
MUSE 4 Channel Sensor
1 Contact Affordable Sensor
Children and adults ages 13 and up because by approximately 13 years their Alpha and Theta waves are similar to adults, so at this age the code will work similarly for their brainwaves from 13 years and up.
- Abstract data hard to map
- Some technology is inaccessible, for example Conor Russomanno and Lisa Park expressed that Emotiv’s Epoc technology is hack-blocked
- Needs more scientific research on the complex roles of the waves detected
- Brainwaves can be detected and data received, but large gap in the interpretation of data
First Digital Data to Physical Device Connection Issues:
Using openFrameworks to Arduino, initially I used firmata to make the connection, but finding glitches in my connection I switched to serial communication.
However I was unable to send strings of serial data because I did not use a PWM pin to receive analog data output, so I tried using an LED to to photoresistor, but that issue was solved by using a PWM pin and getting serial communication to work sending from openFrameworks and receiving serial data in Arduino.
Revised Project Statement/Concept:
To create the best translation of digital brainwave data to physical play.
Originally hoping to find a more accurate way to interpret the data read from the thinkgear and translating it to aiming a water gun and shooting it, I ran into technical limitations that led me to use a bubble gun instead to better interpret the brainwave readings. By using the the data and mounting the physical translating onto the user’s head, it aids in creating the illusion that they are making actual thought bubbles out of their own head with the use of the sensor worn underneath to track their attention level. It becomes a play on words to create actual bubbles with their mind allowing the user to have a more immersive experience. The project concept allows the user to believe that their attention can be measured based on the amount of bubbles emitted from the thought bubbler headgear. Moving the physical interface to become an attachment of the user’s head creates a physical extension of the user’s head, and allows them to believe that it is an extension of their mind with the aid of the thinkgear sensor. The thought bubbler headgear becomes an embodied experienced through its physical interface and brainwave sensing technology.
- Digital data to physical play
- Create a digital sketch to control physical device
- Prototypes 1-3: Parse out different waves, connect with CV object, use CV object as trigger, connect CV trigger to air pump
- Prototype 4: Blow-up balloon with detection of attention level measured by Mindwave sensor
- Prospective Prototype 5: Control water gun aim and water pressure with different wave channels (CANCELED)
- Final Prototype 5: Bubble gun best translation of brainwave data within hardware limitations to create bubbles based on thought rate
Prototype 1: Parse out Channels
Prototype 2: Draw a CV object and move with Attention and Meditation levels
Video showing jumpiness of data received from Thinkgear
Prototype 3: Use Visualization to Trigger Air Pump
Serial Connection from openFrameworks to Arduino
Working Pump Triggered by Serial Communication from Thinkgear
Playtech Title: Don’t Think Too Hard
Kids will concentrate on openFrameworks sketch to start the signal connection, and try to reach an attention threshold to blow up the balloon connected to the air pump.
New Physical Computing Challenges
Translating the new openFrameworks sketch and arduino sketch to the hacked motor of the bubblegun, and moving the h-bridge to a smaller board to mount onto headgear.
Thought Bubbler Headgear Diagram
Creating headgear to hold the thought bubbling device while also fitting the thinkgear sensor on the tester’s head.
Final Thought Bubbler Headgear:
Back H-Bridge Detail
Final Headgear Worn by Tester
Progression of the Thought Bubbler Video:
Thought Bubbler Code
- Create 2 wireless Thought Bubblers and use 2 Mindwave sensors
- Make wireless, using wifi or bluetooth to arduino
- Connect with a game interface for users to compete with who can produce the most thought bubbles
- Complete a digital to physical interaction to simulate an immersive environment
- Explorations of other sensors that can simulate immersion
- Other tools to access the change of embodiment created by dreams, possibly by sending in different brain wave patterns to users to recreate the visualizations stored in those patterns