Lost in Translation is an interactive game called findX that explores language, as a way of seeing. It pays homage to early text based adventure games, from the 1970s (onset of home computing) by situating a physical robot (Bob) within its world, an embodied version of the player themselves. The objective is to find something hidden, the nature of which is unknown. The player has no idea where the robot is. The robot provides limited textual and visual feedback to the player, as extractions of its environment. While incomplete, they allow the player to use their imagination and weave a physical world through the descriptive power of language.
You can visit our website to keep track of the development of the game.
The robot sends visual information to Runway ML, a software that allows you to train and use pre-existing machine learning models, that can be run on remote servers. We are using three of these models to read the environment that the robot is situated in. The models help us read the objects, textures, materials and spaces in the environment, based off of the visual information collected on site, by the robot (Bob).
Once processed, the information is presented to the player, sitting in front of the computer screen in a separate location. The processing of information follows the following steps.
In the coming months, the project would like to further explore language as a way of seeing. The idea of a physically embodied robot, separate in location from the player and the game will be extended by the number of robots as well as the number of locations.
Can we through the descriptive power of language, create worlds that don’t exist?
The idea of having multiple robots in multiple locations, connected through portals shall be explored in the next phase. Can language transcend the notions of space and time?
Venturi, Robert, Denise Scott Brown, and Steven Izenour. Learning from Las Vegas. Cambridge, Mass: Mit Press, 1967.
Cardiff, Janet, and George Bures Miller. “The Missing Voice (Case Study B). 1999.” Soundwalk. Artangel, London (2011).