ANLI - (Adversarial NLI Benchmark)
@kaggle.thedevastator_anli_a_large_scale_nli_benchmark_dataset
Loading...
Loading...
Loading...
Loading...
The Adversarial Natural Language Inference (ANLI, Nie et al.)
Dataset Description
ANLI - (Adversarial NLI Benchmark)
The Adversarial Natural Language Inference (ANLI, Nie et al.)
Source
Paper: link
About this dataset
The ANLI Adversarial Natural Language Inference dataset is a new, large-scale NLI benchmark dataset. The dataset is collected via an iterative, adversarial human-and-model-in-the-loop procedure. ANLI is much more difficult than its predecessors such as SNLI and MNLI. It contains three rounds. Each round has train/dev/test splits. The data fields are the same among all splits.
ANLI provides a unique challenge for natural language understanding models. The dataset is collected via an iterative, adversarial human-and-model-in-the loop procedure that makes it much more difficult than its predecessors such as SNLI and MNLI. This makes ANLI a great benchmark to assess the progress of NLI models
How to use the dataset
To use the ANLI dataset, you will need to download the train_r1.csv file. This file contains the data for the first round of training data for the ANLI dataset. Next, you will need to download the dev_r1.csv file. This file contains the data for the first round of development data for the ANLI dataset. Finally, you will need to download the test_r1.csv file. This file contains the data for the first round of testing in the ANLI dataset
Research Ideas
- The ANLI Adversarial Natural Language Inference dataset can be used to train models to better understand natural language.
- The dataset can be used to develop models that are more robust to adversarial examples.
- The dataset can be used to improve the accuracy of NLI systems
Acknowledgements
The dataset was originally published on Huggingface Hub
License
> License: CC0 1.0 Universal (CC0 1.0) - Public Domain Dedication
> No Copyright - You can copy, modify, distribute and perform the work, even for commercial purposes, all without asking permission. See Other Information.
Columns
File: dev_r2.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: test_r2.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: train_r3.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: dev_r3.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: test_r3.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: train_r2.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: train_r1.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: test_r1.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
File: dev_r1.csv
| Column name | Description |
|---|---|
| premise | The premise of the sentence. (String) |
| hypothesis | The hypothesis of the sentence. (String) |
| label | The label of the sentence. (String) |
| reason | The reason for the label. (String) |
Related Datasets
-
Dummy Monster
@owid