Editing On Intelligence

{{short description|Book by Jeff Hawkins}}
{{Multiple issues|
{{more citations needed|date=April 2013}}
{{Cleanup reorganize|date=November 2024}}
}}
{{Infobox book 
| name          = On Intelligence: How a New Understanding of the Brain will Lead to the Creation of Truly Intelligent Machines
| title_orig    = 
| translator    = 
| image         = OnInt.png
| caption       = Front cover
| author        = [[Jeff Hawkins]] & [[Sandra Blakeslee]]
| illustrator   = 
| cover_artist  = 
| country       = United States
| language      = English
| series        = 
| subject       = [[Psychology]]
| genre         = 
| publisher     = [[Times Books]]
| release_date  = 2004
| english_release_date =
| media_type    = [[Paperback]]
| pages         = 272
| isbn          = 0-8050-7456-2
| dewey= 612.8/2 22
| congress= QP376 .H294 2004
| oclc= 55510125
| preceded_by   = 
| followed_by   = 
}}

'''''On Intelligence: How a New Understanding of the Brain will Lead to the Creation of Truly Intelligent Machines''''' is a 2004 book<ref name= hawkins >{{cite book|last1=Hawkins|first1=Jeff|title=On Intelligence|url=https://archive.org/details/onintelligence0000hawk/page/272|url-access=registration|date=2004|publisher=Times Books|isbn=978-0805074567|pages=[https://archive.org/details/onintelligence0000hawk/page/272 272]|edition=1st}}</ref> by [[Jeff Hawkins]] and [[Sandra Blakeslee]]. The book explains Hawkins' [[memory-prediction framework]] theory of the [[brain]] and describes some of its consequences.
 
==The theory==
{{main|Memory-prediction framework}}
Hawkins' basic idea is that the brain is a mechanism to predict the future, specifically, hierarchical regions of the brain predict their future input sequences. Perhaps not always far in the future, but far enough to be of real use to an organism.  As such, the brain is a [[Feed forward (control)|feed forward]] [[hierarchical state machine]] with special properties that enable it to [[learning|learn]].<ref name= hawkins />{{rp|208-210,222}}

The [[state machine]] actually controls the behavior of the organism.  Since it is a [[Feed forward (control)|feed forward]] state machine, the machine responds to future events predicted from past data.

The hierarchy is capable of memorizing frequently observed sequences ([[Cognitive modules]]) of patterns and developing invariant representations.  Higher levels of the cortical hierarchy predict the future on a longer time scale, or over a wider range of sensory input. Lower levels interpret or control limited domains of experience, or sensory or effector systems. Connections from the higher level states predispose some selected transitions in the lower-level state machines.

[[Hebbian learning]] is part of the framework, in which the event of learning physically alters neurons and connections, as learning takes place.<ref name= hawkins />{{rp|48,164}}

[[Vernon Mountcastle]]'s formulation of a [[cortical column]] is a basic element in the framework.  Hawkins places particular emphasis on the role of the interconnections from peer columns, and the activation of columns as a whole.  He strongly implies that a column is the cortex's physical representation of a state in a state machine.<ref name= hawkins />{{rp|50,51,55}}

As an engineer, any specific failure to find a natural occurrence of some process in his framework does not signal a fault in the memory-prediction framework ''per se'', but merely signals that the natural process has performed Hawkins' functional decomposition  in a different, unexpected way, as Hawkins' motivation is to create intelligent [[machine]]s. For example, for the purposes of his framework, the nerve impulses can be taken to form a temporal sequence (but phase encoding could be a possible implementation of such a sequence; these details are immaterial for the framework).

==Predictions of the theory of the memory-prediction framework==
His [[prediction]]s use the [[visual system]] as a prototype for some example predictions, such as Predictions 2, 8, 10, and 11. Other predictions cite the [[auditory system]]  ( Predictions 1, 3, 4, and 7).
*An Appendix of 11 Testable Predictions, beginning on page 237:

=== Enhanced neural activity in anticipation of a sensory event===
1. In all areas of [[Cerebral cortex|cortex]], Hawkins (2004) predicts "we should find ''anticipatory cells''", cells that fire in anticipation of a sensory [[Phenomenon|event]].
:Note: As of 2005 [[mirror neuron]]s have been observed to fire ''before'' an anticipated event.<ref>
{{cite journal
 | last1 = Fogassi | first1 = Leonardo | first2 = Pier Francesco | last2 = Ferrari | first3 = Benno | last3 = Gesierich | first4 = Stefano | last4 = Rozzi | first5 = Fabian | last5 = Chersi | first6 = Giacomo | last6 = Rizzolatti
 | date = April 29, 2005
 | title = Parietal lobe: from action organization to intention understanding
 | journal = Science
 | volume = 308
 | issue = 5722
 | pages = 662–667
 | doi = 10.1126/science.1106138
 | pmid = 15860620
 | bibcode = 2005Sci...308..662F | s2cid = 5720234 | url = http://www.unipr.it/arpa/mirror/pubs/pdffiles/Fogassi-Ferrari2005.pdf
 | access-date = 2006-11-18
 | archive-url = https://web.archive.org/web/20170809160457/http://old.unipr.it/arpa///mirror/pubs/pdffiles/Fogassi-Ferrari2005.pdf
 | archive-date = 2017-08-09
 }}</ref>

=== Spatially specific prediction===
2. In primary sensory [[Cerebral cortex|cortex]], Hawkins predicts, for example, "we should find anticipatory cells in or near [[Visual cortex#Primary visual cortex (V1)|V1]], at a precise location in the visual field (the scene)". It has been experimentally determined, for example, after mapping the angular position of some objects in the visual field, there will be a one-to-one correspondence of cells in the scene to the angular positions of those objects. Hawkins predicts that when the features of a visual scene are known in a memory, anticipatory cells should fire ''before'' the actual objects are seen in the scene.

=== Prediction should stop propagating in the cortical column at layers 2 and 3===
3. In layers 2 and 3, predictive activity (neural firing) should stop propagating at specific cells, corresponding to a specific prediction. Hawkins does not rule out anticipatory cells in layers 4 and 5.

=== "Name cells" at layers 2 and 3 should preferentially connect to layer 6 cells of cortex===
4. Learned sequences of firings comprise a representation of ''temporally constant invariants''. Hawkins calls the cells which fire in this sequence "name cells". Hawkins suggests that these ''name cells'' are in layer 2, physically adjacent to layer 1. Hawkins does not rule out the existence of layer 3 cells with dendrites in layer 1, which might perform as ''name cells''.

=== "Name cells" should remain ON during a learned sequence===
5. By definition, a ''temporally constant invariant'' will be active during a learned sequence. Hawkins posits that these cells will remain active for the duration of the learned sequence, even if the remainder of the cortical column is shifting state. Since we do not know the encoding of the sequence, we do not yet know the definition of ''ON'' or ''active''; Hawkins suggests that the ON pattern may be as simple as a simultaneous [[logical and|AND]] (i.e., the name cells simultaneously "light up") across an array of name cells.
:See [[Neural ensemble#Encoding]] for ''grandmother neurons'' which perform this type of function.

=== "Exception cells" should remain OFF during a learned sequence ===
6. Hawkins' novel prediction is that certain cells are inhibited during a learned sequence. A class of cells in layers 2 and 3 should NOT fire during a learned sequence, the axons of these "exception cells" should fire ''only if a local prediction is failing''. This prevents flooding the brain with the usual sensations, leaving only exceptions for post-processing.

=== "Exception cells" should propagate unanticipated events===
7. If an unusual event occurs (the learned sequence fails), the "exception cells" should fire, propagating up the cortical hierarchy to the [[hippocampus]], the repository of new memories.

=== "Aha! cells" should trigger predictive activity ===
8. Hawkins predicts a cascade of predictions, when recognition occurs, propagating down the cortical column (with each [[saccade]] of the [[human eye|eye]] over a learned scene, for example).

=== Pyramidal cells should detect coincidences of synaptic activity on thin dendrites===
9. [[Pyramidal cell]]s should be capable of detecting coincident events on thin [[dendrite]]s, even for a [[neuron]] with thousands of [[synapse]]s. Hawkins posits a temporal window (presuming time-encoded firing) which is necessary for his [[theory]] to remain viable.

=== Learned representations move down the cortical hierarchy, with training ===
10. Hawkins posits, for example, that if the [[Inferotemporal cortex|inferotemporal]] (IT) level has learned a sequence, that eventually cells in [[Visual area V4|V4]] will also learn the sequence.

==="Name cells" exist in all regions of cortex===
11. Hawkins predicts that "name cells" will be found in all regions of the cortex.

== See also ==
* [[Hierarchical temporal memory]], a technology by Hawkins's startup Numenta Inc. to replicate the properties of the neocortex.
* [[Memory-prediction framework]]

==References==
{{reflist}}

== External links ==
* {{official website|http://www.onintelligence.com}}
* {{cite journal | citeseerx = 10.1.1.132.6744 | title = A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex | first1 = Dileep | last1 = George | first2 = Jeff | last2 = Hawkins | year = 2005 | pages = 1812–1817 }}
* [https://web.archive.org/web/20061013134333/http://www.phillylac.org/prediction/ Saulius Garalevicius' research page] - Research papers and programs presenting experimental results with Bayesian models of the Memory-Prediction Framework
* [http://sourceforge.net/projects/neocortex/ Project Neocortex] - An open source project for modeling Memory-Prediction Framework

=== Reviews ===
* {{cite journal | url = http://www.computer.org/computer/homepage/0105/random/index.htm | title = Machine Intelligence Meets Neuroscience | first = Bob | last = Colwell | publisher = [[IEEE]] | journal = Computer | volume = 38 | issue = 1 | pages = 12–15 | date = January 2005 | archive-url = https://web.archive.org/web/20050204164903/http://www.computer.org/computer/homepage/0105/random/index.htm | archive-date = 2005-02-04 | doi = 10.1109/MC.2005.24 | url-access = subscription }}
** {{cite journal | title = Machine Intelligence Meets Neuroscience | doi = 10.1109/MC.2005.24 | year = 2005 | last1 = Colwell | first1 = B. | journal = Computer | volume = 38 | pages = 12–15 }}
* {{cite web|url=http://future.iftf.org/2004/10/jeff_hawkins_on.html|archive-url=https://web.archive.org/web/20120205200130/https://future.iftf.org/2004/10/jeff_hawkins_on.html|archive-date=2012-02-05|first=Franz|last=Dill|date=October 30, 2004|title=Jeff Hawkins: On Intelligence}}
* {{cite web|url=http://www.techcentralstation.com/article.aspx?id=112204B|archive-url=https://web.archive.org/web/20120305062713/http://www.techcentralstation.com/article.aspx?id=112204B|archive-date=2012-03-05|title=On Intelligence, People and Computers|first=Arnold|last=Kling|website=Tech Central Station|date=22 November 2004}}
* [http://www.goertzel.org/dynapsyc/2004/OnBiologicalAndDigitalIntelligence.htm On Biological and Digital Intelligence] A review by [[Ben Goertzel]] (7 Oct 2004)

[[Category:2004 non-fiction books]]
[[Category:Non-fiction books about artificial intelligence]]
[[Category:Books about human intelligence]]