Research

What Artificial Neural Networks Can Tell Us About Human Language Acquisition. Alex Warstadt, Samuel R. Bowman. In Review.
[paper]

NOPE: A Corpus of Naturally-Occurring Presuppositions in English. {Alicia Parrish, Sebastian Schuster, Alex Warstadt}, Omar Agha, Soo-Hwan Lee, Zhuoye Zhao, Samuel R. Bowman, Tal Linzen. Proceedings of CONLL. 2021.
[paper] \\ [data] \\ [code]

What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks? Nikita Nangia, Saku Sugawara, Harsh Trivedi, Alex Warstadt, Clara Vania, Samuel R. Bowman. Proceedings of ACL. 2021.
[paper] \\ [data] \\ [code]

Does Putting a Linguist in the Loop Improve NLU Data Collection? Alicia Parrish, William Huang, Omar Agha, Soo-Hwan Lee, Nikita Nangia, Alex Warstadt, Karmanya Aggarwal, Emily Allaway, Tal Linzen, Samuel R. Bowman. Findings of EMNLP. 2021.
[paper] \\ [data] \\ [code]

CLiMP: A Benchmark for Chinese Language Model Evaluation. Beilei Xiang, Changbing Yang, Yu Li, Alex Warstadt, Katharina Kann. Proceedings of EACL. 2021.
[paper] \\ [data]

When Do You Need Billions of Words of Pretraining Data? {Yian Zhang, Alex Warstadt}, Xiaocheng Li, Samuel R. Bowman. Proceedings of ACL. 2020.
[paper] \\ [miniBERTas] \\ [code]

Learning which features matter: RoBERTa acquires a preference for linguistic generalizations (eventually). Alex Warstadt, Yian Zhang, Xiaocheng Li, Haokun Liu, Samuel R. Bowman. Proceedings of EMNLP. 2020.
[paper] \\ [data] \\ [miniBERTas] \\ [code] \\ [talk]

“Just” don’t ask: Exclusives and potential questions. Alex Warstadt. Proceedings of Sinn und Bedeutung 24. 2020.
[paper]

Non-resolving responses to polar questions: A revision to the QUD theory of relevance. {Omar Agha, Alex Warstadt}. Proceedings of Sinn und Bedeutung 24. 2020.
[paper]

Can neural networks acquire a structural bias from raw linguistic data? Alex Warstadt, Samuel R. Bowman. Proceedings of the Annual Meeting of the Cognitive Science Society. 2020.
[paper]

Are natural language inference models IMPPRESsive? Learning IMPlicature and PRESupposition. {Paloma Jeretič, Alex Warstadt}, Suvrat Bhooshan, Adina Williams. Proceedings of ACL. 2020.
[paper] \\ [data] \\ [code] \\ [results] \\ [talk]

BLiMP: The Benchmark of Minimal Pairs for English. Alex Warstadt, Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, Samuel R Bowman. Transactions of the Association for Computational Linguistics (TACL). 2020.
[paper] \\ [data] \\ [code]

Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs. {Alex Warstadt, Yu Cao, Ioana Grosu, Wei Peng, Hagen Blix, Yining Nie, Anna Alsop, Shikha Bordia, Haokun Liu, Alicia Parrish, Sheng-Fu Wang, Jason Phang, Anhad Mohananey, Phu Mon Htut, Paloma Jeretič}, and Samuel R. Bowman. Proceedings of EMNLP. 2019.
[paper] \\ [data] \\ [code]

Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments. Alex Warstadt, Samuel R. Bowman. ArXiv preprint. 2019.
[paper] \\ [data] \\ [website]

Verb Argument Structure Alternations in Word and Sentence Embeddings. {Katharina Kann, Alex Warstadt, Adina Williams}, Samuel R. Bowman. Proceedings of SCiL 2. 2019.
[paper] \\ [data]

Neural Network Acceptability Judgments. Alex Warstadt, Amanpreet Singh and Samuel R. Bowman. Transactions of the Association for Computational Linguistics (TACL). 2019. [link] \\ [data] \\ [code] \\ [website]

Excluding Imperatives. Unpublished manuscript. 2018.
[paper]

2015 Right-node wrapping: A combinatory account. In Proceedings for ESSLLI 2015, Workshop ‘Empirical Advances in Categorial Grammar’. 2015.
[paper]

Right-Node Wrapping. Undergraduate Thesis. 2015.
[paper]

The Syntax of Coordination and Discontinuity in a Combinatory Categorial Grammar. Presented at Tri-College Undergraduate Linguistics Conference. 2015.
[paper]

Talks

Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually). Invited talk at Bar Ilan University NLP Group. October 2020.

Learning grammar from raw data: Case studies with acceptability judgments and neural networks. Invited talk at CLingDing, Indiana University Bloomington. September 2020.
[slides]

Can neural networks acquire a structural bias from raw linguistic data? With Samuel R. Bowman. Poster presented at CogSci 42. July 2020.

Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition. With Paloma Jeretic, Suvrat Bhooshan, and Adina Williams. In Talk given at ACL. July 2020.

BLiMP: The Benchmark of Linguistic Minimal Pairs for English. With Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, and Samuel R. Bowman. Talk given at the 3rd meeting of SCiL. January 2020.

Discovering Structure: Can neural networks acquire a bias for structural generalizations? With Samuel R. Bowman. Talk given at NYU Syntax Brown Bag. December 2020.

Investigating BERT’s Knowledge of Grammar: Five Analysis Methods with NPIs. Talk given at EMNLP 2019. November 2019.
[slides]

Neural Network Acceptability Judgments. Talk given at EMNLP 2019. November 2019.
[slides]

Non-Resolving Responses to Polar Questions. With Omar Agha. Poster presented at Sinn und Bedeutung 24. September 2019.
[poster]

Just: Don’t Ask the Question. Talk given at Sinn und Bedeutung 24. September 2019.
[slides]

Verb Argument Structure Alternations in Word and Sentence Embeddings. With Katharina Kann, Adina Williams, Samuel R. Bowman. Poster presented at SCiL 2. 2019.

Non-Resolving Responses to Polar Questions. With Omar Agha. Talk given at SYNC. 2018.

Just Refuses to Answer the QUD. Talk given at NYU Semantics Group. 2018.

Acceptability Judgments from a Neural Network. With Samuel R. Bowman. Talk given at Annual Meeting of the LSA. 2018.

Right-node wrapping: A combinatory account. Talk given at ESSLLI Workshop “Empirical Advances in Categorial Grammar”. 2015.

The Syntax of Coordination and Discontinuity in a Combinatory Categorial Grammar. Talk given at Tri-College Undergraduate Linguistics Conference. 2015.