Andy Wilson, a researcher in Microsoft Research's adaptive systems and integration group, demonstrates his latest innovation in surface computing. The pieces of construction paper on the table form a real-life terrain that can be explored by virtual cars. Andy's Xbox controller guides the cars over and around obstacles inside the 3D world on the display behind him. The system also projects the cars' current locations onto the table. It's all accomplised using software rendering, a cheap projector and a depth-sensing infrared camera made by 3DV.
This project doesn't have a name yet, but a TechFest attendee suggested "Zune Buggy."