A Simple Method for Commonsense Reasoning Trieu and Quoc - PowerPoint PPT Presentation

A Simple Method for Commonsense Reasoning Trieu and Quoc

Google AI Residency Program | g.co/airesidency

● The trophy cannot fit in the suitcase because it is too big. Google AI Residency Program | g.co/airesidency

?? ● The trophy cannot fit in the suitcase because it is too big. Google AI Residency Program | g.co/airesidency

?? ● The trophy cannot fit in the suitcase because it is too big. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. Winograd Coreference Schema Resolution Challenge Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge The racecar zoomed by the school bus because [it] was going so fast. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge The racecar zoomed by the school bus because [it] was going so fast. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge The racecar zoomed by the school bus because [it] was going so fast. Frank was pleased when Bill said [he] was the winner of the competition. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. Winograd Coreference Schema Resolution Challenge Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. Winograd Expensive to construct Coreference Schema commonsensereasoning.org Resolution Challenge < 300 samples. Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. Human: Human: ~90% ~90% Random Random Guess: Guess: ~50% ~50% Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: ~53% ~53% ~90% ~90% Random Random Guess: Guess: ~50% ~50% Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: Rule-based reasoning, ~53% ~53% ~90% ~90% Random Random Hand-crafted features. Guess: Guess: Wordnet(1995) ~50% ~50% ConceptNet(2004)-17m Cyc(1984) Google Search API Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: Word2Vec ~53% ~53% ~90% ~90% Random Random Guess: Guess: Wordnet(1995) ~50% ~50% ConceptNet(2004)-17m Cyc(1984) Google Search API Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: Word2Vec + ~53% ~53% ~90% ~90% Random Random Supervised DeepNN Guess: Guess: Wordnet(1995) ~50% ~50% ConceptNet(2004)-17m Cyc(1984) Google Search API Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: Word2Vec + ~53% ~53% ~90% ~90% Random Random Supervised DeepNN Guess: Guess: Wordnet(1995) ~50% ~50% ConceptNet(2004)-17m Cyc(1984) Google Search API Google AI Residency Program | g.co/airesidency

Winograd Schema Challenge ?? ● The trophy cannot fit in the suitcase because it is too big. SOTA: SOTA: Human: Human: Ours LM: ~53% ~53% ~90% ~90% Random Random ~64% Guess: Guess: ~50% ~50% Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. The trophy cannot fit in the suitcase because the trophy is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. More probable ? The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. More probable ? The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. More probable ? The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. More probable ? The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . Google AI Residency Program | g.co/airesidency

Method ● The trophy cannot fit in the suitcase because it is too big. Language Model The trophy cannot fit in the suitcase because the trophy is too big . The trophy cannot fit in the suitcase because the suitcase is too big . = 0.0 1.0 ∞ Google AI Residency Program | g.co/airesidency