contrast-sets

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #llm #deep-learning #nodejs #cli #awesome-list #pytorch #security #mcp #ios

(★ 60)

No description available.

contrast-sets Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Contrast Sets

This repo stores the data and evaluation scripts for the contrast sets paper.

| Dataset | Contrast Sets | Type of NLP Task |
| ------- | ------------- |  --------------- |
| [BoolQ (Clark et al., 2019)](https://www.semanticscholar.org/paper/BoolQ%3A-Exploring-the-Surprising-Difficulty-of-Clark-Lee/9770fff7379a7ab9006b48939462354dda9a2053) | [Data](https://github.com/allenai/contrast-sets/tree/master/BoolQ) | Reading Comprehension |
| [DROP (Dua et al., 2019)](https://www.semanticscholar.org/paper/DROP%3A-A-Reading-Comprehension-Benchmark-Requiring-Dua-Wang/dda6fb309f62e2557a071522354d8c2c897a2805) | [Data](https://github.com/allenai/contrast-sets/tree/master/DROP) | Reading Comprehension |
| [MC-TACO (Zhou et al., 2019)](https://www.semanticscholar.org/paper/%22Going-on-a-vacation%22-takes-longer-than-%22Going-for-Zhou-Khashabi/81b4920ad488affaee27389ff9540b7fea90a4ce) | [Data](https://github.com/allenai/contrast-sets/tree/master/MCTACO) | Reading Comprehension |
| [ROPES (Lin et al., 2019)](https://www.semanticscholar.org/paper/Reasoning-Over-Paragraph-Effects-in-Situations-Lin-Tafjord/2ebb01d08022a52c1025302379873dedb5100035) | [Data](https://github.com/allenai/contrast-sets/tree/master/ropes) | Reading Comprehension |
| [Quoref (Dasigi et al., 2019)](https://www.semanticscholar.org/paper/Quoref%3A-A-Reading-Comprehension-Dataset-with-Dasigi-Liu/3838387ea8dd1bb8c2306be5a63c1c120075c5a2) | [Data](https://github.com/allenai/contrast-sets/tree/master/quoref) | Reading Comprehension |
| [IMDb Sentiment Analysis (Maas et al., 2011)](https://www.semanticscholar.org/paper/Learning-Word-Vectors-for-Sentiment-Analysis-Maas-Daly/649d03490ef72c5274e3bccd03d7a299d2f8da91) | [Data](https://github.com/allenai/contrast-sets/tree/master/IMDb) | Classification |
| [MATRES (Ning et al., 2018)](https://www.semanticscholar.org/paper/A-Multi-Axis-Annotation-Scheme-for-Event-Temporal-Ning-Wu/bff8ae9e28323d217b9ad5a7321e58f79607f557) | [Data](https://github.com/allenai/contrast-sets/tree/master/MATRES)	| Classification | 
| [NLVR2 (Suhr et al., 2019)](https://www.semanticscholar.org/paper/A-Corpus-for-Reasoning-About-Natural-Language-in-Suhr-Zhou/cf336d272a30d6ad6141db67faa64deb8791cd61) | [Data](https://github.com/allenai/contrast-sets/tree/master/nlvr2) | Classification | 
| [PERSPECTRUM (Chen et al., 2019)](https://www.semanticscholar.org/paper/Seeing-Things-from-a-Different-Angle%3A-Discovering-Chen-Khashabi/3e9cfcf73c6b8000d6724650fdc48d5f1a5802b1) | [Data](https://github.com/allenai/contrast-sets/tree/master/perspectrum) | Classification | 
| [UD English (Nivre et al., 2016)](https://www.semanticscholar.org/paper/Universal-Dependencies-v1%3A-A-Multilingual-Treebank-Nivre-Marneffe/d115eceab7153d2a1dc6fbf6b99c3bdf1b0cdd46) | [Data](https://github.com/allenai/contrast-sets/tree/master/UD_English) | Parsing |

contrast-sets

contrast-sets Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

contrast-sets

contrast-sets Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README