SmartRetina
What is it?
SmartRetina is a lightfast gesture-tracking platform written in Macromedia Flash 8, utilizing its flash.geom. package, flash.display package, Video class, Camera
class and their motion-tracking capabilities.
Usage
SmartRetina is used to develop Retina Based Interfaces – Interfaces which:
1. Purely use visual interaction and can fully function without using text or audio.
2. Strictly serve as translators between human gestures and machine functions.
3. Can be self-explanatory at their introductory level, since representations of the supported gestures can serve as the actual visual interface (a reflexive interface)
4. Can act as self-organizing systems (see Mossalibra for example).
Retina Based Interfaces therefore escape both the language barrier and the age barrier.
Since SmartRetina serves only as a translator between human gestures and machine functions, these machine functions can include usage of audio, text and actuators thus expanding SmartRetina’s capabilities beyond the visual.
The above video demonstrate how SmartRetina can be used as a navigating tool combined with Google earth. SmartRetina (working on the black laptop on the right) captures the user’s hand gestures, understanding them as computer actions such as up, down, left, right, Zoom In etc, then sends the commands to a computer running Google earth (the desktop on the left).
The following video presents a fast navigation from Greece to Rome.
Interfacing with GoogleEarth via GoogleEearth API by Riccardo Strobbia.
Public Implementation - Mossalibra
Keywords:
Motion tracking , Top-Projects
July 17th, 2006 at 12:25 pm
beautiful work guys. shape recognition via motion detection using getPixel data from the bitmap class in flash eight yes? beautiful application - think of retraining software for stroke victims etc…spatial recognition and visualisation…working on all this too…. maybe its time to start building an os project (eclipse based?) to pool work here and focus on pushing all this forward and identifying target applications for this. But, congratulations, you have built a fantastic system here.
July 18th, 2006 at 1:16 pm
Very interesting.
Could you tell what kind of camera are you using?
July 22nd, 2006 at 5:59 am
Hi.
This simply awesome - seeing all the uber-complicated gesture tracking systems out there, it’s unbelievable that this can be achieved via Flash. Will the source be available for a download, as with the “Flash motion tracking”?
Thanks,
Stas.
September 1st, 2006 at 8:19 pm
[...] The Mossalibra is a new game aimed at dance clubs and parties. Using motion capturing technology to map the player’s movements, the game translates the player into a pixelated image. The image is then projected on to a wall, enabling everyone to watch what a bad dancer you are. Points are scored when you mimic other character’s movements or if you create something new and exciting. This way, the game is always new and organic. The venue is also supposed to be able to keep up with the “changing mood in the club” by seeing what the current dance moves are. [...]
September 9th, 2006 at 8:15 am
Hey Mitja, right now we are using a simple Creative Webcam Notebook. after all 30% of the development time was on train :).
September 14th, 2006 at 6:16 pm
[...] The following video demonstrate how SmartRetina can be used as a navigating tool combined with Google earth. SmartRetina (working on the black laptop on the right) captures the user’s hand gestures, understanding them as computer actions such as up, down, left, right, Zoom In etc, then sends the commands to a computer running Google earth (the desktop on the left). The following video presents a fast navigation from Greece to Rome. [...]
November 13th, 2006 at 4:22 am
[...] The project is based on NastyPixel’s SmartRetina™ technology, which provides the designer with a programmable “eye”, allowing him to easily design new experiences and interactions which do not require a tangible interface. [...]
November 18th, 2006 at 4:40 pm
[...] motiondetection.swf I was looking at another project: http://www.nastypixel.com/prototype/?page_id=86 [...]
November 18th, 2006 at 4:53 pm
Any chance of the code for this being realeased? Am doing something sort of similar and would love to have a look at how other people have gone about it all.
November 18th, 2006 at 8:49 pm
Hey Katy,
We’re pretty swamped with work at the moment, but we’re planning to
release a stripped-down, open source version once we have some free
time
Meanwhile, you can send us some info about your project and code,
and maybe we’ll have time for some specific questions.
Good luck!
Ofer@Nasty
November 20th, 2006 at 3:38 pm
Thanks for your offer of help - Can I have an e-mail address to contact you on?
January 1st, 2007 at 6:12 pm
[...] Fashion Victims Not So White Walls Speed Factory AudioLandscape Mass Distraction Fashion Victims instantSOUP - Instant satisfaction potential useful objects Wiring Strangely Familiar Floor It! is arcade car racing brought to life Virtual Sumo SmartRetina - A lightfast gesture-tracking platform Mossalibra - interactive game installation, operated solely by intuitive human gestures. Artissima - Gesture-based interface מאת y.steiner, ינואר 1, 2007, [...]
March 9th, 2007 at 1:28 am
I am a resident artist at Eyebeam in NYC. Trying to develop a game that
uses motion detection and tracking of player’s movements to activate
virtual game components - very similar to the Eyetoy “Play” series of
games on the PS2. I considered Jitter but the graphics are not
sophisticated enough. It looks like Flash 8 new motion tracking
capabilities might be a viable direction for my project. I’d like to
get more info on your Smart Retina. Please contact. Thanks!
April 20th, 2007 at 3:28 pm
What sort of hardware is in the device itself? Is it solely a camera and all the grunt work is done on the PC? If not, could it be connected to other devices? I.E. a small microcontroller not running Mac or Win?
May 4th, 2007 at 2:07 pm
Ciao Bill.
We recommand Creative small Ultra Notebook , simple and powerful.
it should do the trick.
Contact me if u need more info
May 15th, 2007 at 1:18 pm
[...] am doing some research into Flash Motion detection and have found some really useful links. SmartRetina research codeproject Guy [...]
August 28th, 2007 at 1:45 pm
gesture recognition using webcam.
I made first engine for recognition with webcam
small video presentation for my program
http://www.robotdimitron.com/oblici
Autor: Dimitron