Back

Social-IQ

A Question Answering Benchmark for Artificial Social Intelligence

Social-IQ

Human language offers a unique unconstrained approach to probe through questions and reason through answers about social situations. This unconstrained approach extends previous attempts to model social intelligence through numeric supervision (e.g. sentiment and emotions labels). Social-IQ, is an unconstrained benchmark designed to train and evaluate socially intelligent technologies. By providing a rich source of open-ended questions and answers, Social-IQ opens the door to explainable social intelligence. The dataset contains rigorously annotated and validated videos, questions and answers, as well as annotations for the complexity level of each question and answer. Social-IQ contains 1,250 natural in-the-wild social situations, 7,500 questions and 52,500 correct and incorrect answers. Although humans can reason about social situations with very high accuracy (95.08%), existing state-of-the-art computational models struggle on this task.

View this Dataset
->
Carnegie Mellon University, School of Computer Sciences.
View author website
Task
Visual Question Answering
Annotation Types
Semantic Segmentation
Items
Classes
Labels
Models using this dataset
Last updated on 
January 20, 2022
Licensed under 
Unknown