This is an older experiment, but I think it's still fairly interesting, and I wanted to post it to the blog so that it has a home on my site. This system demonstrates converting user gestures into machine readable information - in this case, it simulates Palm graffiti recognition. Click and drag to write graffiti characters on the input pad, and the system will convert them into characters on screen. Supports almost the full range of graffiti inputs including letters, numbers, uppercase, backspace and punctuation.
Here's a graffiti guide to help you out - the dot shows the starting point of the stroke. It also supports caps shift (upwards stroke), caps lock (two upwards strokes), and punctuation shift (single tap).
The cool thing is that this is all based on a very generic pattern recognition engine that I wrote, which can be used to identify patterns in any kind of linear 2 axis data.
Comments (14)
As always, really nice, mate.
Posted by: Matti at March 8, 2005 02:27 AMbut... Somehow all the things I did turned out wrong at the text field.
probably you made a chart on how to draw those letters to come up right, like the palm has.
URL:
Added a graffiti guide. I haven't had any problem drawing any of the characters - it's at least as accurate as my old Palm Pro (though that's not saying much). Then again, it is trained to my graffiti input.
Posted by: Grant Skinner at March 8, 2005 12:07 PMURL: http://gskinner.com/
Very nice. I got all the letters fine. I'll be taking a look at this soon.
Cheers.
Posted by: LordAlex at March 9, 2005 07:40 AM+LA
URL: http://www.lordalex.org
Really nice!
Posted by: kembond at March 10, 2005 10:07 AMThe things that can be done with flash never stop amazing me.
URL: http://www.kembond.com
A more reliable algorithm may go like this:
Record the position of the mouse at different intervals. Create two sub-graffities, x against t and y against t. For example, A maps to rising line in x versus t and a up and down line in y against t.
Normalize those and do a fit to find the good letter. Because it uses speed instead of position, and because x and y are functions of t instead of things doing loops and such, it should be faster and more reliable.
Posted by: Patrick Mineault at March 10, 2005 08:59 PMURL: http://www.5etdemi.com/blog
Someone actually released a system based on discrete gestures similar to what you described. It was less processor intensive, but far less accurate - this is because it relies on the accuracy of independent strokes, rather than a comparison across an entire character.
Posted by: Grant Skinner at March 13, 2005 10:31 PMURL: http://gskinner.com/
Hello, very nice !
The only problem is the url
http://www.gskinner.com/playpen/graffiti.html
isn't working yet... Any idea ?
Ciao, r0main
Posted by: r0main at March 29, 2005 02:54 AMURL:
i have a palm pilot and this is crap!!!!!!!
Posted by: slitix at May 17, 2005 06:14 PMURL:
I also would like to see the http://www.gskinner.com/playpen/graffiti.html page. Thanks!
Posted by: deecay at May 26, 2005 02:34 AMURL:
Really sweet!! Excellent work indeed!!
Posted by: Harsha Hegde at June 1, 2005 02:36 PMURL:
very nice
Posted by: david at September 29, 2006 06:28 PMgood idea
URL: http://www.supermali.com
Why can't I seem to get numbers to work?
Also I would like to see the link fixed to the http://www.gskinner.com/playpen/graffiti.html page
Cheers!
Nice work by the way
Posted by: Ryan Preece at November 2, 2006 04:56 AMURL: http://www.visual-voice.co.uk
gesture recognition with webcam.
First engine for recognition with webcam
small video presentation for my program
http://www.robotdimitron.com/oblici
Autor: Dimitron
Posted by: dimitron at July 23, 2007 07:22 AMURL: http://www.robotdimitron.com/oblici
First engine for gesture recognition using webcam with hand control( no color detection )
http://interaktivnamatematika.com/oblici/
I am from Macedonia where is born Alexander Macednien, its small country with bigs ideas.
Posted by: dimitron at March 16, 2008 02:09 PMThank you Grant Skinner for pioner idea and realisation of this program
URL: http://interaktivnamatematika.com/oblici