From: Elvis' Hometown
After spending a week cleaning up my research wiki, I will be disappearing for two weeks--without my computer--hopefully finding that AE has been released (and is working) upon my return. There are some pages on my wiki that are relevant to game AI.
There are two kinds of purposeful behaviour that we study--habitual and goal-directed behaviour. There is a problem with both that researchers find difficult--the state space explosion that occurs when you try to learn appropriate behaviour in a rich environment, but we can often solve it and currently have a model for learning habitual behaviour called the actor-critic model, where behaviour is learned by caching the values of actions in previous experience. Goal-directed behaviour involves planning: predicting the outcomes of actions and then back-propagating the resulting rewards to the current set of actions rather than learning by trial and error. It's much harder to programme. If you examine my page on prediction, you'll discover that most researchers currently assume away the difficulty and often come up with an actor-critic model for goal-directed behaviour. Unfortunately for that approach, in goal-directed behaviour, animals change their behaviour when their perception of the final reward changes, and an actor-critic model cannot do that. However, there was a Nature paper about a month ago that suggests that the way we model a plan is not by simulating it, but rather by graphing it. The hippocampus then stores the complete graph, and uses that to back-propagate rewards.
Why discuss this stuff here?
Later this summer, I will be writing a research grant proposal to explore this. It may lead to a better way for representing plans in games like WitP AE.
I felt the need to translate the above into 'Redneck Texan':
I’m gonna spend me a week cleanin' my garage, then I’m gonna go on a drinkin' binge for a week or two. When I get back I’ll be a-lookin’ for that there AE game.
I got me a couple of things I done noticed that probably ain't got nothin to do with AE but I’m gonna say it here anyhow. When women folks are a-drinkin’ real heavy-like they tend to act in two ways – horny or funny. Now when they’re actin’ all horny good ol' boys tend to get all excited and try to load’em up and take’em down some dirt road, but it ain’t that easy. Sometimes they act all horny, but they ain’t so we have to buy'em some drinks and figure out if they’re wantin’ to hop in the sack or if they’re just tryin’ to make some Bubba jealous. It ain’t always easy to figure out. Most good ol’ boys ain’t able to do it. They see a gal dancin’ all hot-like and they try to load her up; poor boys end up getting’ shot down or slapped right hard-like. Now me, I’m a cool cat. I done studied them women folk and I done figured them out – if they drinkin’ pretty drinks, they just messin’ with you; if they takin’ tequila shots, go a head and fire up the truck.
Why talk about that here?
(no disrespect meant; I just had to)
You know, I found your version not only easy to understand, but I can actually attest to everything you just wrote. Not sure if that is good, or bad.
" Gentlemen, you can't fight in here! This is the War Room. " President Muffley