Shadow En(Counter)
I am looking at creating an interface that would be incorporated into a “smart home” environment like Ambient Kitchen and leverage the tracking model in a project like COACH.
The COACH project is a prompting system that helps people with dementia accomplish activities of daily living. Here is a User Persona of someone who might use such a system:
I am proposing a countertop interface that would act as a display surface in a system like COACH. Here is one possible setup:
The user’s movements and interactions with objects on and above the counter are recorded by the video camera. Once a recording has been determined to be of a “correct” execution of a task, it can then be played back later as a “shadow” – a guide for the user to follow. Here is a rough prototype:
I just like this image of props from the prototype.

The deck from my studio presentation has some additional information:


