Social Interaction QA; Social IQA

Creators:
Sap, Maarten; Rashkin, Hannah; Chen, Derek; Le Bras, Ronan; Choi, Yejin
Publication Date:
2019
Data Category:
Digital Media and Entertainment
Dataset Description:

Social Interaction QA, a new question-answering benchmark for testing social commonsense intelligence. Contrary to many prior benchmarks that focus on physical or taxonomic knowledge, Social IQa focuses on reasoning about people’s actions and their social implications. For example, given an action like “Jesse saw a concert” and a question like “Why did Jesse do this?”, humans can easily infer that Jesse wanted “to see their favorite performer” or “to enjoy the music”, and not “to see what’s happening inside” or “to see if it works”. The actions in Social IQa span a wide variety of social situations, and answer candidates contain both human-curated answers and adversarially-filtered machine-generated candidates. Social IQa contains over 37,000 QA pairs for evaluating models’ abilities to reason about the social implications of everyday events and situations.

Variables:
Name Description
context A context describing a sitation
question A question probing commonsense reasoning about motivation, emotional reactions etc.
answerA The first answer choice
answerB The second answer choice
answerC The third answer choice
Publisher:
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing
Companies:
Paul G. Allen School of Computer Science & Engineering, Seattle, WA, USA
Size:
0.01
Formats:
JSON
Custom License:
Undefined

Sign In

Register

Reset Password

Please enter your username or email address, you will receive a link to create a new password via email.