M5_htm Computer Inspired by Hawkins Theories
Tech Center Labs has released an interesting piece of freeware for the Palm OS. Inspired by Jeff Hawkins book ON INTELLIGENCE and the work they are doing at Numenta, M5_htm Computer is an interactive simulation of memory prediction framework for Palm OS devices 3.5 and above.
The Input and Output environment is a 16 X 16 grid to make it easy to share data with a cluster of Palms. The software "learns" sequences of what is happening in its environment a step at a time, the present prediction grid was caused by the previous 'cause' grid (which was the prediction of a previous grid). M-5 can learn many memory sequences of various lengths and use a combination of them to interact with the environment.
Gary from TCL says, "M5 is the beginning of a very simplistic overview of what I gathered from On Intelligence. It is a pattern machine, it stores pattern sequences and recalls the patterns relevant to its present environment, there is very little invariance in M5 but its not desirable in this small simulation. I wanted it to have more exact memories of the environment so it would be useful to some degree. There is a simple hierarchy used to create the vectors but additional levels could use the predictions of M5 as their inputs to learn sequences of sequences while running the same simple code. The fact that a little 150k program can do what it is doing makes me think Jeff has it right and that NuPICs capability will be astounding!"
Permalink
PrintArticle Comments
(79 comments)
The following comments are owned by whoever posted them. PalmInfocenter is not responsible for them in any way.
Please Login or register here to add your comments.
RE: M5, huh?
RE: M5, huh?
RE: M5, huh?
Tech Center Labs
RE: M5, huh?
Hmmmm... what engrams did TCL put in it?!!?
Why does it keep asking to predict my Social Security Number?! And why does it keep searching for a WiFi hotspot?
Ha!
RE: M5, huh?
I like your blog, good luck with the lotto
http://mikecane.wordpress.com/2007/04/27/you-can-now-play-with-a-hawkins-machine/
Tech Center Labs
RE: M5, huh?
I'm glad you find it funny. Most of us died after he shut off the computer that fed us...
- Keeper of Vaal
RE: M5, huh?
http://mikecane.wordpress.com/2007/04/
You were expecting Nostradamus to pop out of your antiquated Clie and give you some winning lotto numbers. You need to wait for Numenta's final version of NuPIC running on a grid of super computers.
In the mean time, I've heard that the 'strange attractors' theory works best in the dark, so you could try putting your list of past lotto numbers where the sun doesn't shine, get a good night's rest and maybe you'll wake up in the morning with the winning combination.
Let me know if it works ;-)
Gary
Tech Center Labs
RE: M5, huh?
Really, just my attempt at hummor after having a few beers last night.
Let me know how the M5_NN does, even a tiny bit above random could pay of in the long run.
Gary
Tech Center Labs
RE: M5, huh?
Tech Center Labs
RE: M5, huh?
If M5_htm is a real indicator of Hawkins' theories, it's not a good augur. However, it does explain, in terms of neurological processing, how it is possible for something to "hide in plain sight." The brain expects what it has seen, not what it hasn't; its prediction -- expectation -- of reality overrides actual reality at times. Novelty is its downfall.
Still, I think Hawkins has something. I just don't know exactly what.
RE: M5, huh?
My real question is... At what point will a Numenta creation be considered an intelligent machine??? I think building intelligent machines is their goal but how is it defined?
Tech Center Labs
RE: M5, huh?
Since I'm not interested in those two examples, I'll refrain from otherwise commenting.
Now we shall see!!!
Using this grid, it will be painful as hell, but I think I'm going to bust my ass this weekend and feed in a year's worth of historic data and see what comes out.
I've already inputted ~35 instances of historic data and gotten an interesting prediction.
*rubbing my hands in glee*
(How come that moneygrubber Gekko isn't jumping up and down at the possibilities?!!?)
RE: Now we shall see!!!
> a term! -- A Hawkins Machine...
Lol!
A long long time ago in a different lifetime I had a brother in law, in Taiwan of all places, who was Big Time into playing the (Taiwan) lottery - he would stay up quite late every night STARTING at 2 AM (after closing his restaurants) to take the daily lottery numbers and attempt to find patterns between them and prior numbers. He also, not surprisingly, was Big Time into chewing betel nuts:
-- http://en.wikipedia.org/wiki/Betel_nut
One time while I was on vacation there he asked me to go with him to a computer show and help him buy a PC - I thought that was cool since this certainly would be the first computer in the entire family. The computer show was sorta like those held by Marketpro:
essentially displaying the wares of local and traveling PC stores, etc. He arranged with one of the displaying guys to go to the store after the show and buy a 286-based (I think) PC et al (for a couple thousand bucks, I think).
As we're leaving the show he asks me to write him a program to show frequency of occurrence of sets of 2, 3, 4, 5, and 6 numbers from the lottery drawings.
Before I left Taiwan for home.
In something like 2 days.
On a PC - something I'd never used before (I was a CP/M guy then moved on to an Amiga - never had used a MSFT PC at that time).
Gack.
We go to the store to pick up the computer - I'm wondering what I'm going to do - write in Basic? - when I see a Turbo Pascal book on the shelf! Whoa! I've used Turbo Pascal on CP/M! (I think it was $25 when I used it - the reason I had it for CP/M - thanks, Borland!). I ask about it and THEN find out that the store will load any 5.25" floppy disks we buy with whatever software they have! I buy the book (in Chinese!) and a couple boxes of blank floppies and get a copy of PC-Turbo Pascal loaded for free.
Well, to make a long story longer, the Pascal environment on the PC was essentially the same as under CP/M (as was MS/DOS - no Windows then) so, using the illustrations in the book and my memory, on a PC with 64Kbytes of memory and a 5.25" floppy disk drive (only), I hacked out a simple sorting/counting algorithm with a user-friendly arrow-key-driven "curses"-like:
-- http://www.oreilly.com/catalog/curses/
interface.
Due to memory limitations, of course, "simple" wasn't really simple given the need to sort/count/display sets of as many as 6 numbers requiring more "bins" than integers on the computer!
He loved it.
I left Taiwan with a large chunk of cash - my very first "contract" job - and a happy in-law who, a few months later, credited the program with helping him select numbers for a fairly large win in the lottery! (No, it was purely random, of course, but HE thought so! Lol!)
So, good luck, Mike! It's doable!
Giggle.
RE: Now we shall see!!!
That was a great tale, complete with betel nuts and computer market. It transported me to another time and place and the punchline was fantastic. Did you miss your calling in life?
RE: Now we shall see!!!
And come to NYC's Chinatown. They are gambling mad over there! OTB, scratch-offs, and draws. (There are also hidden gambling dens, of course.)
For your education, btw, go read The Eudamonic Pie and The Predictors:
http://www.thomasbass.com/work3.htm
http://www.thomasbass.com/work2.htm
OMG! Links that *aren't* to *my* blog!!
RE: Now we shall see!!!
> and other crap to predict...
At the time (early 80s?) in Taiwan, the MAJOR money was in publishing those types of rags.
There even were pseudo-buddhist temples set up to help you with your number picking.
And, of course, said bro-in-law spent HOURS every night reading some of those rags and hand-computing scads of useless numbers to try to pick the winners. His "notes" were an amazing thing to behold - truly amazing - numerology at its finest!
[and folks sometimes wonder why I am SO against TA with stocks...giggle]
RE: Now we shall see!!!
Purely random? I doubt it.
Repeating:
For your education, btw, go read The Eudamonic Pie and The Predictors:
http://www.thomasbass.com/work3.htm
http://www.thomasbass.com/work2.htm
Additional: There are *many* Wall Street firms that use such systems on that lottery called the stock market. What, you *really* think they go by earnings, leadership, products, market share? Puhleeze! I've been there on the inside on such a project, and I've read about it too.
RE: Now we shall see!!!
upgrade
M5 version 1.1 uses invariant representation for position of an object on the grid, if you want it to treat the entire grid as an object turn on the top left pixel. It isn't able to use memos created with version 1.0 (sorry Mike ;)
Gary
Tech Center Labs
RE: upgrade
I'll stick with this XP version until you make a case for moving to Vista!
RE: upgrade
It was interesting - a few hours after writing that I clickety-clicked on some of the sub-links at some of the pages I linked to in the original telling.
In particular, the Betel Nut Girl links! E.g.:
-- http://en.wikipedia.org/wiki/Betel_nut_beauty
-- http://www.youtube.com/watch?v=HJo7ZkLwkng&mode=related&search=
Talk about flashbacks! These sites are just totally right-on w.r.t. How It Was in Taiwan in the 80s (minimally). (the "barber shop pole" parlors were equally interesting...we won't get into that, however).
BTW - I tried a betel nut JUST once in many visits to Taiwan - bit hard onto it and had an AMAZING searing-flame pain crash against the back of my throat. I ended up chewing it down to the fibrous mass state but it was NOT a pleasant experience. To this day I do not know what that particular Betel Nut Beauty had put into that betel nut but I wouldn't be surprised to find out it was a Thai Pepper:
-- http://en.wikipedia.org/wiki/Thai_pepper
or something - rumors (and probably truths) suggested illegal amphetamines were often added to the nuts (cut a slit, insert goop) to generate extra kick (and addiction).
RE: upgrade
Anyone eejit (credit Cane please) that is stupid enough to flush their hard earned $$$ down the toilet on lotteries and related fools games would jump at the opportunity. Two hundred bucks for a Palm handheld and $30 of software, for a step up on mega-millions. It's a no brainer. Before the foos got enough feedback to realize that they all can't win, these guys would have sold a 100 million units.
Pat Horne
In all due respect to Jeff Hawkins...
Genius Hawkins is helping develop a science that taken to its extreme evolution, will create beings with a consciousness that will ultimately be able/want to enslave or destroy humanity.
Numenta may seem harmless, and we all love to embrace science, and chances are there is nothing going to stop AI development, but damn Hawkins to hell for helping to make it happen.
You guys can play with your first little Palm AI program (and I likely will as well - talk about a hypocritical irony), but let it be known that this is the beginning of the end (*dramatic music*).
I guess my point here is that Jeff Hawkins, philosophically, is guilty of involuntary crimes against humanity for conspiring (since AI has been worked on by others before him) to develop technology that mimics the human brain. [AND YES I'M NOT BEING 100% SERIOUS HERE! HAVE A SENSE OF HUMOR]. And there is no stopping this science now. Now comes the era in which we have to manage and control its development, same way we did/are doing with nukes.
Man o man, life is getting more complicated and risky everyday.
In the end, curiosity killed the cat.
Have fun with your little early stage Palm AI program!
RE: In all due respect to Jeff Hawkins...
Might sell well to naive Venture Capital though!
Giggle.
RE: In all due respect to Jeff Hawkins...
Explain? Have you read 'On Intelligence'? I am not nesesarily disagreeing with you, but as Hawkins book is highly regarded by some heavy hitters in the AI field - and as he spends a considerable part of the book recapping the history of and thinking behind the field of AI - I assume that you have a detailed response. Whats your beef?
Seriously - let's hear it dude.
Only the first 50 comments are displayed within the article.Click here for the full story discussion page...
Latest Comments
- I got one -Tuckermaclain
- RE: Don't we have this already? -Tuckermaclain
- RE: Palm brand will return in 2018, with devices built by TCL -richf
- RE: Palm brand will return in 2018, with devices built by TCL -dmitrygr
- Palm phone on HDblog -palmato
- Palm PVG100 -hgoldner
- RE: Like Deja Vu -PacManFoo
- Like Deja Vu -T_W
Bad links?