On the opposite end of the Media Lab complex from the Director’s office resides MIT’s Program in Art, Culture, and Technology (ACT), a long-unrelated program which spent 30 years on opposite side of campus, by choice. In 2010, after the Media Lab tripled its size with an expansion, MIT leadership decided to move ACT into the expanded complex, presumably for more interaction with the Media Lab. While the Media Lab is about “technologies that promise to transform,” ACT is about “critical studies and production.”

Since the move, as before, there’s been little interaction. But what if, challenging as it may…

more risky research, less master classes

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]
[October 2020: Additional VR/AR class projects from NYU Shanghai since publication can be found here.]

Shanghai

The first half-semester was pretty easy on the students. They sat back through several weeks of richly audiovisual presentations on “VR / AR Fundamentals.” They unboxed and set up all five major VR platforms, then curated and experienced dozens of VR titles. They enjoyed the buzz of our “VR / AR News of the Week” class time.

…

Being immersed in live events and with other people.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Using our effectors and intentions as inputs and how they shape interactive experiences.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Fooling the non-audiovisual senses.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Fooling two eyes and two ears, moving around, and with an unframed image.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Fooling a single static eye and a single static ear into believing that a framed representation is real.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Science with Attitude.

[March 2019: This article, and the entire VR/AR Series, is now available bilingually in Chinese and English courtesy of NYU Shanghai.]

Greetings! And welcome to the first in a series of six weekly pieces on Virtual Reality and Augmented Reality “fundamentals”. They’re meant to be fast, brief, holistic, and accessible to non-engineers.

The motivation is practical. I get calls from novice VR/AR producers and from check-writing executives worried about expensive camera stitching, or wanting awesome spatial sound, or feeling obliged to always fill the entire 360 degree view. But all too often they are unaware of zero-parallax…