Semantic Entailment: Nathaniel Story Ginger Buckbee Greg Lorge Billy Dean
Semantic Entailment: Nathaniel Story Ginger Buckbee Greg Lorge Billy Dean
What is it?
Given sentence A, can you infer sentence B?
iTunes software has seen Strong sales for strong sales in Europe. iTunes in Europe
True
Kerry hit Cheney hard on Kerry shot Cheney. his conduct on the war in Iraq.
False
Challenges
Juiciness
Paraphrasing Example
There is a cat on the table. A cat is on the table. Different structurally, but infers same meaning
Negation
I am lazy I am not lazy Im not unhappy (Double negation) Im happy Its not unnecessary Its necessary
Pre-Suppositions
Bob doesnt think its raining Bob doesnt know its raining Conversational Pragmatics
Contextual knowledge
World Knowledge
Japan is the only country that currently has an emperor. Columbia doesnt have an emperor. First sentence entails second, but you need to know that Columbia is a country.
Approach
Tools:
Stemmer Parser from Dan Bikels site MALLET (maxEnt classifier) Wordnet (synset)
Focusing on Comparable Document task Start with simple features like word matching, synonym matching Add in more complicated functions like phrase structure comparisons Test the system out, see how it works. Continue adding features to improve performance.
Data
Evaluation
International Competition Best 60% accuracy Strive for >52% accuracy Comparing against annotated test set Improvement: Print out incorrect ones, then look for mistakes.
The End