Connectionist methods

Version 1 (Benjamin Johnston, 07/21/2011 10:09 am)

1 1 Benjamin Johnston
h1. Connectionist methods
2 1 Benjamin Johnston
3 1 Benjamin Johnston
Connectionist methods attempt to mimic the essential behavior of the brain using artificial neural networks. An artificial neural network is an abstraction of the networks of biological neurons that appear in the human brain. An artificial neural network is comprised of a large set of artificial neurons that are densely interconnected and have a simple mapping from input to output. While an artificial neural network is not engaged in the same kind of electrochemical interactions as a biological neuron, it shares similar macroscopic behaviors.
4 1 Benjamin Johnston
5 1 Benjamin Johnston
Connectionism was founded with an ambitious vision of creating deep, human-like intelligence (and commonsense). Today, it is primarily seen and applied to ‘narrow-AI’ problems of image recognition and other learning of non-linear functions.
6 1 Benjamin Johnston
7 1 Benjamin Johnston
Hugo de Garis’ "China-Brain project":http://naoforge.net/blog/2011/04/18/china-brain-project/ stands out as a dramatic return to the original ideals of connectionism. The project is attempting to train thousands of high-speed artificial neural networks (using custom hardware) and assemble the networks into a larger super-network to drive the intelligent behavior of a robot. So far, the system is capable of recognizing limited objects but work is ongoing in order to build sophisticated behaviors.
8 1 Benjamin Johnston
9 1 Benjamin Johnston
There are other, less grandiose, attempts to apply artificial neural networks to challenging problems of general-purpose intelligences. "Numenta Corporation’s":http://www.numenta.com/ Hierarchical Temporal Networks (HTM) are hierarchical layers of nodes that can perform spatio-temporal reasoning and learning; recurrent neural networks are being successfully applied to increasingly difficult learning problems in work such as that of "Graves and Schmidhuber":http://www.idsia.ch/~juergen/nips2009.pdf ; and Steven Thaler’s "Imagination Engine":http://www.imagination-engines.com/ is used to generate creative and novel inventions by adding noise to a trained neural network.