27 Oct The Nature of Innovative Thinking
Mental Exploration The shape of the world changed radically when folks from the eastern and western hemispheres became aware of one another and of their respective geographies. The Age of Exploration (AKA the Age of Discovery) was amazing – or should I say “it is amazing”? While the focus has changed from continents and cultures, to galaxies […]
17 Oct Neural Conceptual Dependency
Conceptual Dependency Much of this blog has been about knowledge representation: how the brain might learn and process it, how cognitive functions treat knowledge, and now, how computers may store and process it. Conceptual structures and conceptual dependency theories for computation have been useful for categorizing and representing knowledge in intuitively simple and cognitively consistent […]
14 Oct Knowledge in Non-Neural Models
Non-Neural Models So far we have examined a number of models that are explicitly designed to be neuromorphic. This categorization is useful for two reasons: the apparent chaos or non-deterministic functioning of the brain is represented by these models; and neural networks explicitly use large numbers of distributed processors or neurodes that each contribute to […]
08 Sep Gnostic Learning Model
In prior posts in this section, and periodically in other sections of my blog, I have been exploring how humans learn, and how we might replicate those processes in computer software or (less likely) hardware. The context of the learning, or knowledge acquisition, upon which I choose to focus is language learning. While knowledge acquisition is much broader, this is an […]
28 Aug Weight Control for Knowledge
Stochastic Models Data, information and knowledge may be stored in many different ways in computers. Most artificial neural models rely heavily on stochastic or probabilistic techniques for establishing the internal structure that represents the data. The generalized delta rule for adaptation is an example of this sort of technique. The generalized delta rule, developed by D.E. […]
25 Aug Determinacy in Neural Connections
For many years, researchers thought that it was wrong to assume that there was a cell or set of cells in the brain that stored the memory of Grandma’s face. Though the comparison with computer memory was appealing, it was thought to be too simplistic and incorrect. Now, more researchers in different academic disciplines are assuming […]
18 Aug Modeling Positive and Negative Activation
Humans learn from both positive and negative experiences. The electrical flow between neurons can be positive (excitatory), propagating electrical potential flow along neural path to create further excitation and a bubbling-up effect, or negative (inhibitory) reducing or stopping the electrical potential flow along a pathway. Remember that a neural pathway is not like a long line, but like […]
02 Aug Artificial Time
Time is omnipresent – you can’t get away from it. It is woven into everything we do and say and understand. It is an inextricable element of context. I was just speaking of how the connections in our brain develop, grow and evolve over time. Representing and handling this “temporal” element is fundamental to any […]