Annotated Reality Design for Novices

Technology for capturing 360° photos and video is heading towards ubiquity, as is the ability to consume it in various forms, whether on desktops and laptops, mobile devices, or in VR headsets. This project explores two questions related to this rise of access.

• Within the context of the established usefulness of low fidelity prototyping, we ask "How can low fidelity techniques support the brainstorming process for a 360° space?" We have created a new prototyping technique called The 360th Degree that extends the classic big paper and sticky note low fidelity techniques into the domain of 360° experiences (HCIL Tech Report). We are also exploring another new technique called CubeDraw to support the creation of a 360° background using simple drawing supplies.

• Within the context of novice programmers or medium-fidelity prototyping, we ask "How can a simple JavaScript library support the rapid creation of informational hotspots in a 360° static space?" We have a beta JavaScript library that can be used to quickly add hotspots using that library and create a simple annotated reality experience of a campus mall with gaze-activated fact boxes, information boxes, and picture boxes. This experience can then be viewed on devices from a desktop to a mobile device to a VR headset.

We also have a page showing how to use Hugin to adjust 360° images in situations where (for example) the camera wasn't level or pointing in the right direction as "forward" for the desired result. It also explains how to use Hugin to convert a six-image cubemap into an equirectangular image.