Dataset Card for "ai2_arc"

  Dataset Summary

A new dataset of 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset is partitioned into a Challenge Set and an Easy Set, where the former contains only questions answered incorrectly by both a retrieval-based algorithm and a word co-occurrence algorithm. We are also including a corpus of over 14 million science sentences relevant to… See the full description on the dataset page: https://huggingface.co/datasets/allenai/ai2_arc.

A new dataset of 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset is partitioned into a Challenge Set and an Easy Set, where the former contains only questions answered incorrectly by both a retrieval-based algorithm and a word co-occurrence algorithm. We are also including a corpus of over 14 million science sentences relevant to the task, and an implementation of three neural baseline models for this dataset. We pose ARC as a challenge to the community.

Compared to the original dataset, this adds context sentences obtained through information retrieval in the same way as UnifiedQA (see: https://arxiv.org/abs/2005.00700 ).

To use this dataset:

import tensorflow_datasets as tfds

ds = tfds.load('ai2_arc_with_ir', split='train')
for ex in ds.take(4):
 print(ex)

See the guide for more informations on tensorflow_datasets.