Stanford Question Answering Dataset (SQuAD)
Questions posed by crowdworkers on a set of Wikipedia articles
@kaggle.thedevastator_the_stanford_question_answering_dataset
Questions posed by crowdworkers on a set of Wikipedia articles
@kaggle.thedevastator_the_stanford_question_answering_dataset
SQuAD is a reading comprehension dataset consisting of questions posed by crowdworkers on a set of Wikipedia articles. The answers to the questions are span of text, or segments, from the corresponding reading passages. The data fields in this dataset are the same across all splits
The SQuAD dataset is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage. The data fields are the same among all splits
Columns:context,question,answers
To use this dataset, simply download one of the split files (train.csv or validation.csv) and load it into your preferred data analysis tool. Each row in the file corresponds to a single question-answer pair. The context column contains the full text of the corresponding Wikipedia article, while the question and answers columns contain the question posed by the crowdworker and its corresponding answer(s)
- Learning to answer multiple choice questions by extracting text spans from source materials
- Developing Reading Comprehension models that can answer open-ended questions about passages of text
- Building systems that can generate large training datasets for Reading Comprehension models by creating synthetic questions from existing passages
Thank you to the Stanford Natural Language Inference group and the creators of the SQuAD dataset for providing this data
License
License: CC0 1.0 Universal (CC0 1.0) - Public Domain Dedication
No Copyright - You can copy, modify, distribute and perform the work, even for commercial purposes, all without asking permission. See Other Information.
File: validation.csv
| Column name | Description |
|---|---|
| title | The title of the Wikipedia article. (String) |
| context | The full text of the article. (String) |
| question | The question posed by the crowdworker. (String) |
| answers | The answer to the question, as a string of text spans. (List of strings) |
File: train.csv
| Column name | Description |
|---|---|
| title | The title of the Wikipedia article. (String) |
| context | The full text of the article. (String) |
| question | The question posed by the crowdworker. (String) |
| answers | The answer to the question, as a string of text spans. (List of strings) |
CREATE TABLE train (
"id" VARCHAR,
"title" VARCHAR,
"context" VARCHAR,
"question" VARCHAR,
"answers" VARCHAR
);CREATE TABLE validation (
"id" VARCHAR,
"title" VARCHAR,
"context" VARCHAR,
"question" VARCHAR,
"answers" VARCHAR
);Anyone who has the link will be able to view this.