linkedin facebook twitter rss

03 May Up from Words to Sentences

Crossword Puzzle

Words and Sentences The game of Scrabble is completely about words. Crossword puzzles go from sentence or phrase to word. Our analytical approach begins with the word, but doesn’t stop there. From both the cognitive and computational perspectives, the sentence exhibits far more complexity and changeability than the word. At any given moment, the structure of […]

02 May Linguistic Building Blocks

Scrabble Blocks

Linguistic Building Blocks While languages are infinite, each has a finite number of structures, functions and attributes. Functions and attributes are the building blocks of a grammar. Grammars or languages are categorized as regular, context-free (CF), context-sensitive (CS), recursive, and recursively enumerable. A context-sensitive grammar is a powerful formalism that describes the language in terms of […]

01 May Traditional Grammar from the Top Down

Top Down is Not Magic

What is Traditional Grammar Grammars provide the knowledge and rules necessary to understand or disambiguate the often ambiguous strings of words that constitute language. People disambiguate by searching available knowledge (Nirenburg, 1987). Because a traditional grammar specifies a finite set of rules or patterns which attempt to capture the regularities of a language (Grosz, 1986), it […]

29 Apr The Multiple Meanings of Polysemy

Polysemy and Constraints Perhaps the most difficult task in Natural Language (NL) understanding is the resolution of polysemy or multiple meanings. Many words in every language do not exhibit polysemy and require no disambiguation. Most words, however, can be interpreted in at least a few different ways. This makes disambiguating NL text a non-trivial task. Each different meaning and shade […]

28 Apr Mosaic of Concepts

Stereo Vision

KR Mosaic On our way to knowledge representation (KR), we’ve looked at concepts and logical propositions and words and taxonomies. I know this can all be a bit confusing, but please bear with me a little longer. Word relations are more than a two-dimensional mosaic of related concepts – they form a deep hierarchy with multiple […]

25 Apr Conceptual Paradigms

Broken Egg

Conceptual Structure The different functions of language are acquired at different stages. As described by Sowa, these functions show why semantics can be considered a guide to how we learn syntax: “First, children associate words with concrete concepts used in perceiving the world and acting upon it. Next, they learn syntactic rules for mapping concepts […]

24 Apr What Was That Word?

Language Learning Stages

Learning Stages From a cognitive perspective, we have reason to believe that, for most ordinary communication, words are more important to successful communication than sentences. As the complexity rises, so rises the importance of well-formed phrases and sentences. At an early age, kids begin to communicate using sounds. They progress from there to the single-word […]

23 Apr Form and Substance in Communication

Substance and Form

Form vs. Substance If the substance is H2O, the form may be solid ice, liquid water or gaseous steam. What about language? We’ve talked about different language phenomena, including spoken, written and digitally stored language. Is the medium the form and the content the substance of language, or is there more? Saussure, a founder of the European flavor of structural […]

22 Apr Breaking Down Language Structure and Function

Communication Functions

Grammar Acquisition Some experts suggest that a correctly formulated adult grammar is acquired by children on the basis of sentences they hear in their first few years (Pinker, 1984, p. 5). The proponents of this theory assume that a young child perceives sentence structure or is able to detect elements of grammatical structure – a […]

21 Apr Language Inherited

Innate Grammar

Language Acquisition How do children acquire language? How do they learn about grammar and productively apply its general rules to creating new utterances? Some attempts to explain this phenomenon have suggested that a set of grammar rules is innate. Advocates of this theory (Chomsky 1968) point to grammatical similarities, or universals, across languages and aver that a […]