Project by: Yaniv Steiner & Ofer Luft.

SmartRetina is a lightfast gesture-tracking platform written in Macromedia Flash 8, utilizing its flash.geom. package, flash.display package, Video class, Camera
class and their motion-tracking capabilities.

SmartRetina is used to develop Retina Based Interfaces – Interfaces which:

1. Purely use visual interaction and can fully function without using text or audio.
2. Strictly serve as translators between human gestures and machine functions.
3. Can be self-explanatory at their introductory level, since representations of the supported gestures can serve as the actual visual interface (a reflexive interface)
4. Can act as self-organizing systems (see Mossalibra for example).

Retina Based Interfaces therefore escape both the language barrier and the age barrier.

Since SmartRetina serves only as a translator between human gestures and machine functions, these machine functions can include usage of audio, text and actuators thus expanding SmartRetina’s capabilities beyond the visual.

The above video demonstrate how SmartRetina can be used as a navigating tool combined with Google earth. SmartRetina (working on the black laptop on the right) captures the user’s hand gestures, understanding them as computer actions such as up, down, left, right, Zoom In etc, then sends the commands to a computer running Google earth (the desktop on the left).

The following video presents a fast navigation from Greece to Rome.

Public Implementation - Mossalibra