Saul Hansell wrote an interesting post on the NY Times blog entitled “Google and the Real Search for Meaning on the Web.”
We joined the conversation with this comment (link) because people still don’t understand how critical a vast and complete Semantic Map of the English language is to true understanding of text:
This is a great discussion! However, what we don’t see anyone talking about is what we believe is the key to making Natural Language Processing successful – the Semantic Map.
To advance NLP beyond its current limitations is a very difficult problem because you have to unravel the complexity of language. In particular, individual words have multiple meanings, and at the same time, a given concept or meaning can be referred to by multiple words. To understand which meaning of a word is correct requires an understanding of context, but in order to fully understand context requires that words and meanings be analyzed or “curated” one at a time into a vast Semantic Map.
Cognition’s Semantic Map of the English language, which has been built over the past 23 years, is complete, robust and unique, and represents the key market differentiator for the company and its technology.
Utilizing a Semantic Map differs from Google’s algorithms in that Google relies primarily on string pattern-matching, and does not try to interpret the meaning of the words within context. With a Semantic Map, it is possible to determine word meanings and therefore understand meanings rather than simple string pattern recognition. For example, in Wikipedia, in response to a query “strike oil in California”, Google returns documents about “strike commander” (a flight simulator), striking workers, hunger strikes, etc., in their top 5 results. With a Semantic Map, the most precise and complete retrievals about discovering oil in California are returned, because the meaning of “strike” in context is interpreted as “discover”, as opposed to “attack militarily” or “walk out”.
Cognition Technologies has changed the NLP paradigm through its unique and complete combination of a complete Semantic Map and linguistic elements to optimize semantic understanding:
Morphology
• The various forms of word, e.g. singular, plural, tense
Syntax
• The grammatical structure, e.g. verbs, nouns
Semantics
• Word and sentence meaning, augmented by synonymy and taxonomy
Spelling
• The various ways words are spelled (or misspelled)
We encourage you to try it for yourself at www.cognition.com.