Tag Archives: learning
07 May Pairs of Language Strata
The Paired Model By pairing language strata, we attempt to find or describe symmetrical structures in language, thus helping clarify one of the most abstract phenomena known to man: verbal communication. This pairing of characteristics is also useful in decomposing the problem into smaller chunks to make it easier for computers to deal with. A note […]
06 May Impulse Waves in Layers
Layered Model Just as the brain has areas with three to six distinct layers, a typical artificial neural systems (ANS) also has several layers. The example at right shows a network with three layers that illustrate a neural network‘s distributed architecture. The uniform circles connected by lines are symbolic of the state of an ANS at […]
05 May Learning from Errors
If at first you don’t succeed, try – try again. Humans are pretty good at learning from our mistakes. In fact, some suggest that whatever doesn’t kill you makes you stronger. Today I’d like to riff on that theme a bit, and talk about ways in which machines can implement learning from errors. Error Minimization […]
02 May Linguistic Building Blocks
Linguistic Building Blocks While languages are infinite, each has a finite number of structures, functions and attributes. Functions and attributes are the building blocks of a grammar. Grammars or languages are categorized as regular, context-free (CF), context-sensitive (CS), recursive, and recursively enumerable. A context-sensitive grammar is a powerful formalism that describes the language in terms of […]
30 Apr Exceptional Logic
Exceptions to the Rules In natural language, exceptions to rules of grammar and other characteristics are frequent, and exhibit little consistency or predictability. They may multiply in discourse and in situations where the speaker/writer’s competence is limited. Idioms and irregular verbs are common exceptions which can be quite difficult to categorize or describe using formal descriptive grammar. Further exceptions […]
29 Apr The Multiple Meanings of Polysemy
Polysemy and Constraints Perhaps the most difficult task in Natural Language (NL) understanding is the resolution of polysemy or multiple meanings. Many words in every language do not exhibit polysemy and require no disambiguation. Most words, however, can be interpreted in at least a few different ways. This makes disambiguating NL text a non-trivial task. Each different meaning and shade […]
26 Apr Continuity of Learning
Production and Comprehension We know that comprehension and language production occur in different areas of the brain and occupy opposite ends of the continuum in the communicative model. The relative independence of the production and comprehension centers suggests one of three possibilities: Syntactic and lexical data are replicated in both the production and comprehension centers of […]
25 Apr Conceptual Paradigms
Conceptual Structure The different functions of language are acquired at different stages. As described by Sowa, these functions show why semantics can be considered a guide to how we learn syntax: “First, children associate words with concrete concepts used in perceiving the world and acting upon it. Next, they learn syntactic rules for mapping concepts […]
24 Apr What Was That Word?
Learning Stages From a cognitive perspective, we have reason to believe that, for most ordinary communication, words are more important to successful communication than sentences. As the complexity rises, so rises the importance of well-formed phrases and sentences. At an early age, kids begin to communicate using sounds. They progress from there to the single-word […]
23 Apr Form and Substance in Communication
Form vs. Substance If the substance is H2O, the form may be solid ice, liquid water or gaseous steam. What about language? We’ve talked about different language phenomena, including spoken, written and digitally stored language. Is the medium the form and the content the substance of language, or is there more? Saussure, a founder of the European flavor of structural […]