This week I did several small tests. Mainly tech stuff. And I found out that it’s really not easy to come out a good scenario.
Realized only laptop needed to link to itpsandbox to be server, and all the phones can connect to nyu wifi and access laptop server by going to laptop’s IP address. The whole world can access my laptop if they know my IP address! So crazy!! Mind blown!!!
Try to figure out how to get 360 rotation from accelerometer, and magnetometer of bluetooth TI Sensor Tag.
So far get pitch and roll from accelerometer, and yaw from magnetometer, but works kind of weird when using all of three at the same time. Works fine if just use pitch and yaw.
Bluetooth data transfer is not as free as serial communication. Might have to swtich to XBee/radio? :/
I bought a Slimport MicroUSB to HDMI adapter cable and tested it with projectors. It didn’t work with Samsung Pico project (HDMI to VGA to VGA 15pin), which is very small. But it worked with the medium size ones (HDMI to HDMI)!
Control Room 2.0
Following the new strategy, get one done in detailed and change based on feedback, and experiment others freely, I chose Control Room as my target mask, since it already had physical form.
Things planed to change:
How can it integrate into daily life? Use it in front of laptop, use it outside home?
–> Only one window is remote view, others all local view
–> Portable home: always connected with your home. So you can see/talk with family members all the time, and your pets too
–> Open field option of relaxing escape for daily use
Based on feedback from user testing, people want to see the real world more(= see more windows, e.g. be able to see their hands if they want)
–> More windows to see more clearly
More comfortable (suggestion from teacher Despina)
Smell good –> To do
Easy to put on, pillow in the back? –> To do
Aim for wearing for longer time, since it represents Home
Self: Based on where your head turns toward to, the things in the house react to it
Open the door –> explode the house
T_T so difficult
Quaternion & Euler
“Ahhhhhhhhhhhhhhhhhhhh!!!! TvT” –> famous Fxck & Yeah moment
Spent almost three hours trying to rotate the body with quaternion, but only change rotation.y, trying to deal something looks like this , and then found out that Three.js has Euler FUNCTION that can just convert Quaternion to Euler for you. Just need the source quaternion and order of axes.
It seems my “design for overcoming things”, a.k.a Introversion inclination, is not strong (might because I didn’t research enough to back it up), and can’t cover/explain what I’ve done and going to do. I know it depends on what I my main desire is. But I kind of don’t know it clearly enough now…
SO. New strategy! For introvert is my original motivation, and then it gradually becomes the process of experiment, and suggest different ways to incorporate VR into daily life, with the physical medium: Mask, in two categories: functional & identity shift.
How to fool the perception, to self and to others?
Qs to answer
“What consciousness is?”
American philosopher Thomas Nagel argued that, even if you were somehow able to transport yourself into the mind of a bat, you still wouldn’t really know what it’s like to be a bat; you would only have the experience of being a person inside the mind of one. Nagel’s arguments rest on the fact that we don’t yet fully understand what consciousness is, and perhaps we never will.
Computer vision, HTML5, Three.js, WebRTC
Fabrication: cardboard, paper, paper mache
2/25, got advice from Alex Kauffmann, who works on the Cardboard in Google!
The distance between lenses and phone screen is fixed (in the current version, somewhere in the vicinity of 44mm). Provided they respect the fixed focal distance, you should be fine. Velcro is your friend. So is hot glue.
For interaction, I recommend not having straps—make people hold the mask as they wear it, it avoids all sorts of latency problems (your torso rotates much slower than your neck, and when you’re holding the mask, you can only turn your head as fast as your torso). Also, don’t do motion in more than one direction (if there is motion at all) and don’t accelerate and decelerate (it’s a recipe for vomit). In virtual reality, there is no friction, so no need to simulate it.
In terms of software, I would steer you either towards WebVR (here’s a good overview with relevant links) or the Unity plugin for the Cardboard SDK. They take care of most of the difficult optical things so you can focus on just building your 3D environments.
Suggested testing different ways to max the performance, setting benchmark and see which part costs the most
Use small canvas for executing face detection, display the image with big size of canvas.
From below test pics you can see, it’s much better to analyze with smaller canvas, but there’s no big difference between displaying big and small canvas, so for better resolution, it seems ok to display bigger canvas.
Greyscale + Blur
multiple faces detection, yet not stable due to changing lightness
Collect personal moment as taking photos –> accompany with you all the time to comfort you to confront unknown
Affecting virtual world
Thanks toAndy‘s advice on hooking up localhost of my laptop through itpsandbox wifi, now I can run codes on mobile phone using laptop as server! (ps. It also works at home, just in NYU because of the security issue, using ITPSANDBOX is needed.)
*Note* It’s not advised to run server elsewhere (e.g. heroku, digitalOcean) because it takes more time to transfer the data back and forth. Localhost with laptop is the best option for proof of concept!
–> Decide to do it after finalizing the virtual content.
First prototype (or maybe not just a prototype…) of MASK collection – Control Room.
It’s the kind of fantasy castle that a child builds up and role-play inside. The interior is rough and the space is tiny, but with the protection and imaginary friends, you feel less timid to the outside world.
It’s a townhouse cardboard mask
User is virtually in a cardboard room, and sees the real world through different windows
The distance between self and the world is created, thus decreased the threatening feeling
When you stay still, imaginary friends start to encourage you
Things I learned
For improving performance of phone, reducing face amount
Detailed model –> NO, simple yet interesting shape –> YES
Texture’s effect is more powerful than model
Imagination friend test
Normal, discarded cardboard is too thick… have to buy a good thin quality cardboard.
Scale up for eyeglasses. Too big unfortunately. Width between them will be perfect. One good thing is although the mat board is a little bit heavier, it’s not that big difference.