| Dynabench: Rethinking benchmarking in NLP D Kiela, M Bartolo, Y Nie, D Kaushik, A Geiger, Z Wu, B Vidgen, G Prasad, ... NAACL, 2021 | 152 | 2021 |
| Bloom: A 176b-parameter open-access multilingual language model TL Scao, A Fan, C Akiki, E Pavlick, S Ilić, D Hesslow, R Castagné, ... arXiv preprint arXiv:2211.05100, 2022 | 70 | 2022 |
| Learning from the worst: Dynamically generated datasets to improve online hate detection B Vidgen, T Thrush, Z Waseem, D Kiela ACL, 2021 | 63 | 2021 |
| Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality T Thrush*, R Jiang, M Bartolo, A Singh, A Williams, D Kiela, C Ross* CVPR, 2022 | 52 | 2022 |
| Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation M Bartolo, T Thrush, R Jia, S Riedel, P Stenetorp, D Kiela EMNLP, 2021 | 36 | 2021 |
| Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking Z Ma*, K Ethayarajh*, T Thrush*, S Jain, L Wu, R Jia, C Potts, A Williams, ... NeurIPS, 2021 | 27 | 2021 |
| Human-adversarial visual question answering S Sheng, A Singh, V Goswami, JAL Magana, T Thrush, W Galuba, ... NeurIPS, 2021 | 23 | 2021 |
| Anlizing the adversarial natural language inference dataset A Williams, T Thrush, D Kiela SCiL, 2022 | 22 | 2022 |
| Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate HR Kirk, B Vidgen, P Röttger, T Thrush, SA Hale NAACL, 2022 | 16 | 2022 |
| DataPerf: Benchmarks for Data-Centric AI Development M Mazumder, C Banbury, X Yao, B Karlaš, WG Rojas, S Diamos, ... White Paper, 2022 | 14 | 2022 |
| Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants M Bartolo, T Thrush, S Riedel, P Stenetorp, R Jia, D Kiela NAACL, 2022 | 11 | 2022 |
| Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation G Wenzek, V Chaudhary, A Fan, S Gomez, N Goyal, S Jain, D Kiela, ... WMT at EMNLP, 2021 | 8 | 2021 |
| The BigScience ROOTS Corpus: A 1.6 TB Composite Multilingual Dataset H Laurençon, L Saulnier, T Wang, C Akiki, AV del Moral, T Le Scao, ... NeurIPS Datasets and Benchmarks, 2022 | 7 | 2022 |
| Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization T Thrush, E Wilcox, R Levy BlackboxNLP at EMNLP, 2020 | 7 | 2020 |
| Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks T Thrush, K Tirumala, A Gupta, M Bartolo, P Rodriguez, T Kane, ... ACL System Demos, 2022 | 5 | 2022 |
| Rover relocalization for mars sample return by virtual template synthesis and matching TH Pham, W Seto, S Daftry, B Ridge, J Hansen, T Thrush, ... IEEE Robotics and Automation Letters 6 (2), 4009-4016, 2021 | 4 | 2021 |
| The partial mental state inducer: Learning intuition with few training examples and K-line theory T Thrush, P Winston Advances in Cognitive Systems, 2018 | 3 | 2018 |
| Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurement L von Werra, L Tunstall, A Thakur, AS Luccioni, T Thrush, A Piktus, ... EMNLP System Demos, 2022 | 2 | 2022 |
| Dataperf: Benchmarking data for better ml P Mattson, C Coleman, C Zhang, P Paritosh, VJ Reddi, D Kiela, G Diamos, ... Forthcoming, 2022 | 2 | 2022 |
| Measuring Data M Mitchell, AS Luccioni, N Lambert, M Gerchick, A McMillan-Major, ... arXiv preprint arXiv:2212.05129, 2022 | 1 | 2022 |
Douwe KielaStanford UniversityVerified email at stanford.edu
