I took a Creative Writing class in my Sophomore year of high school. That's when I discovered my passion for writing stories. It is another way to create a virtual world and transport someone to it. I started writing a lot of short fiction after that semester—mostly apocalyptic and science fiction. When I decided where to attend college, I chose Saint Louis University in part because of its inclusion of Computer Science in its College of Arts and Sciences. This arrangement allowed me to pursue a Minor in English and continue developing my storytelling and rhetorical skills alongside a rigorous Computer Science curriculum.
My English professors taught me about the technical side of storytelling and introduced me to writing poetry, which is my main form of creative expression today. Moreover, working with Dr. Nathaniel Rivers in rhetoric courses taught me the strength of combining my fields of study. Previously, my Computer Science studies had not included the humanist side of things; we learned about coding concepts but not about how humans fit into our programs. As a result, I perceived STEM fields as strictly separate from liberal arts ones. I did not realize that the humanities framework would have deeper implications for my understanding of the world.
Storytelling is such a foundational and powerful way we relate to each other. I always will be interested in building technology that can help someone express themselves or share human experiences in a some way.
The sciences and arts of computers and humanities has informed my academic perspective.
I took a high-level rhetoric seminar my Junior year with Dr. Rivers. The course focused on how human and non-human systems of attention interact. Although it was a class listed under the English department, he allowed students to tailor their projects and assignments to their specific interests. I centered my work around computing and humans. We examined how information and communication technologies have transformed human networks. They have muddled common conceptions of attention, relationships, and presence. My final project examined how people function in virtual reality. I used Mozilla’s A-Frame technology to create a web-based digital sphere. That world is one of stars, designed to persuade users to feel as though they are floating in outer space. As they progress through the experience, different simulated factors such as time and gravity mutate. A handful of my friends tried it, and I observed how they behaved as they noticed—consciously or not—that things were not-the-way-they-ought-to-be. Conscious responses like verbal feedback after certain events confirmed that they were following the world’s narrative. Subconscious reactions such as feeling off balance or flinching were evidence of lower-level consequences.
These observations made me think about how immersive digital technology affects people, and how people adapt it to their lives. A lot happens when we are immersed in the digital world, and I want to crack the code about how those processes work. These interests laid the foundation for my interest in pursuing a PhD in VR with an HCI angle.
One of the tricky things about virtual reality tech is that the user is traditionally isolated from the physical world. This is by design. VR is crazy immersive. You throw on some noise-canceling headphones and some goggles that are the visual equivalent, and you end up in a whole new world or universe. Your brain can get pretty good at giving into the digital illusion, but some things from the physical world should not be ignored. For example, you'll want to know if you're about to run into the wall or if your dog is walking around the play area.
There are enough funny/concerning videos of "VR fails" that some of the main issues are being resolved by the goggle makers. But there are some interesting questions remaining. Should the user be completely isolated from other people in the room? I tend to think no. Then: How can another person be brought into the virtual environment so the VR user may become aware of them and interact with them? What information should be provided to non-VR people in the room so they can know when or how to interact with the VR user?
I am working on these questions right now. There is a lot of HCI research along these lines—interruptions, seamless transitions, collaborative VR.
There is all kinds of friction involved in the processes of going into an immersive virtual environment. For starters, you have to fit a kind of bulky and kind of heavy pair of goggles on your head and carefully adjust them so that they are comfortable and are in the right position for your eyes. This part becomes more complicated if you have glasses, if you're not used to the particular device, or if you're not used to it. Then there's the virtual transition. You go to a digital world that might not have the same rules as the physical world you just came from. The world builders might have programmed your hands to emanate lasers that can move ten-ton boulders, or they could have skipped the whole gravity thing altogether.
And after you've been immersed in that kind of world for a while, coming out of it is no less jarring.
There is a lot of work to be done to better transition people to and from the physical and virtual. Transitioning gets a little better as the person gains experience with the technology, but anecdotally, it still has rough edges. And the friction can become complicated over time. For instance, I know I sometimes get cybsersick after using VR, so I feel a pang of anxiety as I don a headset.
I don't have an experiment planned in this area yet, but I am very interested in it. To this end, I am looking at research in meditation and impossible spaces.
A quick note on terminology. I am resistant to differentiating between the "real" and "virtual" as is popular in the literature. VR worlds are just as "real" as the "real world" as far as I can tell. They are dynamic; they interact with your senses, your mind. It is also popular to use "physical" in lieu of "real". Of course, a computer system is quite physical—it produces physical sensory stimuli (e.g., light, sound, vibrations) that interact with your senses. Differentiating between the "analog" and "digital" worlds feels a bit better for me.