MotIF: Motion Instruction Fine-Tuning. - Hwang, Minyoung; Hejna, Joey; Sadigh, Dorsa; Bisk, Yonatan (IEEE Robotics Autom. Lett., 2025)

Efficient Hardware Scaling and Diminishing Returns in Large-Scale Training of Language Models. - Fernandez, Jared; Wehrstedt, Luca; Shamis, Leonid; Elhoushi, Mostafa; Saladi, Kalyan; Bisk, Yonatan; Strubell, Emma; Kahn, Jacob (Trans. Mach. Learn. Res., 2025)

Energy Considerations of Large Language Model Inference and Efficiency Optimizations. - Fernandez, Jared; Na, Clara; Tiwari, Vashisth; Bisk, Yonatan; Luccioni, Sasha; Strubell, Emma (2025)

Re-thinking Temporal Search for Long-Form Video Understanding. - Ye, Jinhui; Wang, Zihan; Sun, Haosen; Chandrasegaran, Keshigeyan; Durante, Zane; Eyzaguirre, Cristóbal; Bisk, Yonatan; Niebles, Juan Carlos; Adeli, Ehsan; Fei-Fei, Li; Wu, Jiajun; Li, Manling (2025)

Language Models Need Inductive Biases to Count Inductively. - Chang, Yingshan; Bisk, Yonatan (2025)

Explore Theory of Mind: program-guided adversarial data generation for theory of mind reasoning. - Sclar, Melanie; Dwivedi-Yu, Jane; Fazel-Zarandi, Maryam; Tsvetkov, Yulia; Bisk, Yonatan; Choi, Yejin; Celikyilmaz, Asli (2025)

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward. - Zhang, Ruohong; Gui, Liangke; Sun, Zhiqing; Feng, Yihao; Xu, Keyang; Zhang, Yuanhan; Fu, Di; Li, Chunyuan; Hauptmann, Alexander G.; Bisk, Yonatan; Yang, Yiming (2025)

Model Successor Functions. - Chang, Yingshan; Bisk, Yonatan (CoRR, 2025)

Self-Regulation and Requesting Interventions. - Min, So Yeon; Wu, Yue; Sun, Jimin; Kaufmann, Max; Tajwar, Fahim; Bisk, Yonatan; Salakhutdinov, Ruslan (CoRR, 2025)

Re-thinking Temporal Search for Long-Form Video Understanding. - Ye, Jinhui; Wang, Zihan; Sun, Haosen; Chandrasegaran, Keshigeyan; Durante, Zane; Eyzaguirre, Cristóbal; Bisk, Yonatan; Niebles, Juan Carlos; Adeli, Ehsan; Fei-Fei, Li; Wu, Jiajun; Li, Manling (CoRR, 2025)

Looking beyond the next token. - Thankaraj, Abitha; Jiang, Yiding; Kolter, J. Zico; Bisk, Yonatan (CoRR, 2025)

Energy Considerations of Large Language Model Inference and Efficiency Optimizations. - Fernandez, Jared; Na, Clara; Tiwari, Vashisth; Bisk, Yonatan; Luccioni, Sasha; Strubell, Emma (CoRR, 2025)

FieldWorkArena: Agentic AI Benchmark for Real Field Work Tasks. - Moteki, Atsunori; Masui, Shoichi; Yang, Fan; Song, Yueqi; Bisk, Yonatan; Neubig, Graham; Kusajima, Ikuo; Watanabe, Yasuto; Ishida, Hiroyuki; Takahashi, Jun; Jiang, Shan (CoRR, 2025)

Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models. - Liu, Huihan; Shah, Rutav; Liu, Shuijing; Pittenger, Jack; Seo, Mingyo; Cui, Yuchen; Bisk, Yonatan; Martín-Martín, Roberto; Zhu, Yuke (CoRR, 2025)

VISREAS: Complex Visual Reasoning with Unanswerable Questions. - Akter, Syeda Nahida; Lee, Sangwu; Chang, Yingshan; Bisk, Yonatan; Nyberg, Eric (2024)

SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents. - Wang, Ruiyi; Yu, Haofei; Zhang, Wenxin; Qi, Zhengyang; Sap, Maarten; Bisk, Yonatan; Neubig, Graham; Zhu, Hao (2024)

ANAVI: Audio Noise Awareness using Visual of Indoor environments for NAVIgation. - Jain, Vidhi; Veerapaneni, Rishi; Bisk, Yonatan (2024)

OpenEQA: Embodied Question Answering in the Era of Foundation Models. - Majumdar, Arjun; Ajay, Anurag; Zhang, Xiaohan; Putta, Pranav; Yenamandra, Sriram; Henaff, Mikael; Silwal, Sneha; McVay, Paul; Maksymets, Oleksandr; Arnaud, Sergio; Yadav, Karmesh; Li, Qiyang; et al. (2024)

Situated Instruction Following. - Min, So Yeon; Puig, Xavier; Chaplot, Devendra Singh; Yang, Tsung-Yen; Rai, Akshara; Parashar, Priyam; Salakhutdinov, Ruslan; Bisk, Yonatan; Mottaghi, Roozbeh (2024)

Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation. - Chang, Yingshan; Zhang, Yasi; Fang, Zhiyuan; Wu, Ying Nian; Bisk, Yonatan; Gao, Feng (2024)

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models. - Lee, Jaeyoung; Lu, Ximing; Hessel, Jack; Brahman, Faeze; Yu, Youngjae; Bisk, Yonatan; Choi, Yejin; Gabriel, Saadia (2024)

Tools Fail: Detecting Silent Errors in Faulty Tools. - Sun, Jimin; Min, So Yeon; Chang, Yingshan; Bisk, Yonatan (2024)

Gradient Localization Improves Lifelong Pretraining of Language Models. - Fernandez, Jared; Bisk, Yonatan; Strubell, Emma (2024)

SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents. - Zhou, Xuhui; Zhu, Hao; Mathur, Leena; Zhang, Ruohong; Yu, Haofei; Qi, Zhengyang; Morency, Louis-Philippe; Bisk, Yonatan; Fried, Daniel; Neubig, Graham; Sap, Maarten (2024)

WebArena: A Realistic Web Environment for Building Autonomous Agents. - Zhou, Shuyan; Xu, Frank F.; Zhu, Hao; Zhou, Xuhui; Lo, Robert; Sridhar, Abishek; Cheng, Xianyi; Ou, Tianyue; Bisk, Yonatan; Fried, Daniel; Alon, Uri; Neubig, Graham (2024)

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration. - O'Neill, Abby; Rehman, Abdul; Maddukuri, Abhiram; Gupta, Abhishek; Padalkar, Abhishek; Lee, Abraham; Pooley, Acorn; Gupta, Agrim; Mandlekar, Ajay; Jain, Ajinkya; Tung, Albert; Bewley, Alex; et al. (2024)

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception. - Tatiya, Gyan; Francis, Jonathan; Wu, Ho-Hsiang; Bisk, Yonatan; Sinapov, Jivko (2024)

Diffusion PID: Interpreting Diffusion via Partial Information Decomposition. - Dewan, Shaurya; Zawar, Rushikesh; Saxena, Prakanshul; Chang, Yingshan; Luo, Andrew F.; Bisk, Yonatan (2024)

Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers. - Jain, Vidhi; Attarian, Maria; Joshi, Nikhil J.; Wahid, Ayzaan; Driess, Danny; Vuong, Quan; Sanketi, Pannag R.; Sermanet, Pierre; Welker, Stefan; Chan, Christine; Gilitschenski, Igor; Bisk, Yonatan; et al. (2024)

SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents. - Wang, Ruiyi; Yu, Haofei; Zhang, Wenxin; Qi, Zhengyang; Sap, Maarten; Neubig, Graham; Bisk, Yonatan; Zhu, Hao (CoRR, 2024)

VISREAS: Complex Visual Reasoning with Unanswerable Questions. - Akter, Syeda Nahida; Lee, Sangwu; Chang, Yingshan; Bisk, Yonatan; Nyberg, Eric (CoRR, 2024)

Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers. - Jain, Vidhi; Attarian, Maria; Joshi, Nikhil J.; Wahid, Ayzaan; Driess, Danny; Vuong, Quan; Sanketi, Pannag R.; Sermanet, Pierre; Welker, Stefan; Chan, Christine; Gilitschenski, Igor; Bisk, Yonatan; et al. (CoRR, 2024)

Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation. - Chang, Yingshan; Zhang, Yasi; Fang, Zhiyuan; Wu, Yingnian; Bisk, Yonatan; Gao, Feng (CoRR, 2024)

Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community. - Kennington, Casey; Alikhani, Malihe; Pon-Barry, Heather; Atwell, Katherine; Bisk, Yonatan; Fried, Daniel; Gervits, Felix; Han, Zhao; Inan, Mert; Johnston, Michael; Korpan, Raj; Litman, Diane J.; et al. (CoRR, 2024)

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward. - Zhang, Ruohong; Gui, Liangke; Sun, Zhiqing; Feng, Yihao; Xu, Keyang; Zhang, Yuanhan; Fu, Di; Li, Chunyuan; Hauptmann, Alexander; Bisk, Yonatan; Yang, Yiming (CoRR, 2024)

AgentKit: Flow Engineering with Graphs, not Coding. - Wu, Yue; Fan, Yewen; Min, So Yeon; Prabhumoye, Shrimai; McAleer, Stephen; Bisk, Yonatan; Salakhutdinov, Ruslan; Li, Yuanzhi; Mitchell, Tom M. (CoRR, 2024)

Language Models Need Inductive Biases to Count Inductively. - Chang, Yingshan; Bisk, Yonatan (CoRR, 2024)

DiffusionPID: Interpreting Diffusion via Partial Information Decomposition. - Dewan, Shaurya; Zawar, Rushikesh; Saxena, Prakanshul; Chang, Yingshan; Luo, Andrew F.; Bisk, Yonatan (CoRR, 2024)

Tools Fail: Detecting Silent Errors in Faulty Tools. - Sun, Jimin; Min, So Yeon; Chang, Yingshan; Bisk, Yonatan (CoRR, 2024)

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models. - Lee, Jaeyoung; Lu, Ximing; Hessel, Jack; Brahman, Faeze; Yu, Youngjae; Bisk, Yonatan; Choi, Yejin; Gabriel, Saadia (CoRR, 2024)

Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge. - Yenamandra, Sriram; Ramachandran, Arun; Khanna, Mukul; Yadav, Karmesh; Vakil, Jay; Melnik, Andrew; Büttner, Michael; Harz, Leon; Brown, Lyon; Nandi, Gora Chand; S, Arjun P.; Yadav, Gaurav Kumar; et al. (CoRR, 2024)

DegustaBot: Zero-Shot Visual Preference Estimation for Personalized Multi-Object Rearrangement. - Newman, Benjamin A.; Gupta, Pranay; Kitani, Kris; Bisk, Yonatan; Admoni, Henny; Paxton, Christopher Jason (CoRR, 2024)

Situated Instruction Following. - Min, So Yeon; Puig, Xavier; Chaplot, Devendra Singh; Yang, Tsung-Yen; Rai, Akshara; Parashar, Priyam; Salakhutdinov, Ruslan; Bisk, Yonatan; Mottaghi, Roozbeh (CoRR, 2024)

MotIF: Motion Instruction Fine-tuning. - Hwang, Minyoung; Hejna, Joey; Sadigh, Dorsa; Bisk, Yonatan (CoRR, 2024)

Embodied-RAG: General non-parametric Embodied Memory for Retrieval and Generation. - Xie, Quanting; Min, So Yeon; Zhang, Tianyi; Bajaj, Aarav; Salakhutdinov, Ruslan; Johnson-Roberson, Matthew; Bisk, Yonatan (CoRR, 2024)

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation. - Jain, Vidhi; Veerapaneni, Rishi; Bisk, Yonatan (CoRR, 2024)

Gradient Localization Improves Lifelong Pretraining of Language Models. - Fernandez, Jared; Bisk, Yonatan; Strubell, Emma (CoRR, 2024)

Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training. - Fernandez, Jared; Wehrstedt, Luca; Shamis, Leonid; Elhoushi, Mostafa; Saladi, Kalyan; Bisk, Yonatan; Strubell, Emma; Kahn, Jacob (CoRR, 2024)

Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoning. - Sclar, Melanie; Yu, Jane A.; Fazel-Zarandi, Maryam; Tsvetkov, Yulia; Bisk, Yonatan; Choi, Yejin; Celikyilmaz, Asli (CoRR, 2024)

Training Vision-Language Transformers from Captions. - Gui, Liangke; Chang, Yingshan; Huang, Qiuyuan; Som, Subhojit; Hauptmann, Alexander G.; Gao, Jianfeng; Bisk, Yonatan (Trans. Mach. Learn. Res., 2023)

HomeRobot: Open-Vocabulary Mobile Manipulation. - Yenamandra, Sriram; Ramachandran, Arun; Yadav, Karmesh; Wang, Austin S.; Khanna, Mukul; Gervet, Théophile; Yang, Tsung-Yen; Jain, Vidhi; Clegg, Alexander; Turner, John M.; Kira, Zsolt; Savva, Manolis; et al. (2023)

SLAP: Spatial-Language Attention Policies. - Parashar, Priyam; Jain, Vidhi; Zhang, Xiaohan; Vakil, Jay; Powers, Sam; Bisk, Yonatan; Paxton, Chris (2023)

EXCALIBUR: Encouraging and Evaluating Embodied Exploration. - Zhu, Hao; Kapoor, Raghav; Min, So Yeon; Han, Winson; Li, Jiatai; Geng, Kaiwen; Neubig, Graham; Bisk, Yonatan; Kembhavi, Aniruddha; Weihs, Luca (2023)

The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment. - Fernandez, Jared; Kahn, Jacob; Na, Clara; Bisk, Yonatan; Strubell, Emma (2023)

Computational Language Acquisition with Theory of Mind. - Liu, Andy; Zhu, Hao; Liu, Emmy; Bisk, Yonatan; Neubig, Graham (2023)

Self-Supervised Object Goal Navigation with In-Situ Finetuning. - Min, So Yeon; Tsai, Yao-Hung Hubert; Ding, Wei; Farhadi, Ali; Salakhutdinov, Ruslan; Bisk, Yonatan; Zhang, Jian (2023)

SPRING: Studying Papers and Reasoning to play Games. - Wu, Yue; Min, So Yeon; Prabhumoye, Shrimai; Bisk, Yonatan; Salakhutdinov, Russ; Azaria, Amos; Mitchell, Tom M.; Li, Yuanzhi (2023)

SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs. - Yu, Lijun; Cheng, Yong; Wang, Zhiruo; Kumar, Vivek; Macherey, Wolfgang; Huang, Yanping; Ross, David A.; Essa, Irfan; Bisk, Yonatan; Yang, Ming-Hsuan; Murphy, Kevin P.; Hauptmann, Alexander G.; et al. (2023)

The Framework Tax: Disparities Between Inference Efficiency in Research and Deployment. - Fernandez, Jared; Kahn, Jacob; Na, Clara; Bisk, Yonatan; Strubell, Emma (CoRR, 2023)

Computational Language Acquisition with Theory of Mind. - Liu, Andy; Zhu, Hao; Liu, Emmy; Bisk, Yonatan; Neubig, Graham (CoRR, 2023)

Plan, Eliminate, and Track - Language Models are Good Teachers for Embodied Agents. - Wu, Yue; Min, So Yeon; Bisk, Yonatan; Salakhutdinov, Ruslan; Azaria, Amos; Li, Yuanzhi; Mitchell, Tom M.; Prabhumoye, Shrimai (CoRR, 2023)

SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning. - Wu, Yue; Prabhumoye, Shrimai; Min, So Yeon; Bisk, Yonatan; Salakhutdinov, Ruslan; Azaria, Amos; Mitchell, Tom M.; Li, Yuanzhi (CoRR, 2023)

HomeRobot: Open-Vocabulary Mobile Manipulation. - Yenamandra, Sriram; Ramachandran, Arun; Yadav, Karmesh; Wang, Austin S.; Khanna, Mukul; Gervet, Théophile; Yang, Tsung-Yen; Jain, Vidhi; Clegg, Alexander William; Turner, John M.; Kira, Zsolt; Savva, Manolis; et al. (CoRR, 2023)

SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs. - Yu, Lijun; Cheng, Yong; Wang, Zhiruo; Kumar, Vivek; Macherey, Wolfgang; Huang, Yanping; Ross, David A.; Essa, Irfan; Bisk, Yonatan; Yang, Ming-Hsuan; Murphy, Kevin; Hauptmann, Alexander G.; et al. (CoRR, 2023)

MAEA: Multimodal Attribution for Embodied AI. - Jain, Vidhi; Tamarapalli, Jayant Sravan; Yerramilli, Sahiti; Bisk, Yonatan (CoRR, 2023)

WebArena: A Realistic Web Environment for Building Autonomous Agents. - Zhou, Shuyan; Xu, Frank F.; Zhu, Hao; Zhou, Xuhui; Lo, Robert; Sridhar, Abishek; Cheng, Xianyi; Bisk, Yonatan; Fried, Daniel; Alon, Uri; Neubig, Graham (CoRR, 2023)

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Perception. - Tatiya, Gyan; Francis, Jonathan; Wu, Ho-Hsiang; Bisk, Yonatan; Sinapov, Jivko (CoRR, 2023)

Reasoning about the Unseen for Efficient Outdoor Object Navigation. - Xie, Quanting; Zhang, Tianyi; Xu, Kedi; Johnson-Roberson, Matthew; Bisk, Yonatan (CoRR, 2023)

SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents. - Zhou, Xuhui; Zhu, Hao; Mathur, Leena; Zhang, Ruohong; Yu, Haofei; Qi, Zhengyang; Morency, Louis-Philippe; Bisk, Yonatan; Fried, Daniel; Neubig, Graham; Sap, Maarten (CoRR, 2023)

Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis. - Hu, Yafei; Xie, Quanting; Jain, Vidhi; Francis, Jonathan; Patrikar, Jay; Keetha, Nikhil Varma; Kim, Seungchan; Xie, Yaqi; Zhang, Tianyi; Zhao, Shibo; Chong, Yu Quan; Wang, Chen; et al. (CoRR, 2023)

Language Learning from Communicative Goals and Linguistic Input. - Zhu, Hao; Bisk, Yonatan; Neubig, Graham (2022)

Transformers Are Adaptable Task Planners. - Jain, Vidhi; Lin, Yixin; Undersander, Eric; Bisk, Yonatan; Rai, Akshara (2022)

WebQA: Multihop and Multimodal QA. - Chang, Yingshan; Cao, Guihong; Narang, Mridu; Gao, Jianfeng; Suzuki, Hisami; Bisk, Yonatan (2022)

EvEntS ReaLM: Event Reasoning of Entity States via Language Models. - Spiliopoulou, Evangelia; Pagnoni, Artidoro; Bisk, Yonatan; Hovy, Eduard H. (2022)

On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. - Palaskar, Shruti; Bhagia, Akshita; Bisk, Yonatan; Metze, Florian; Black, Alan W.; Marasovic, Ana (2022)

Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue. - Min, So Yeon; Zhu, Hao; Salakhutdinov, Ruslan; Bisk, Yonatan (2022)

FILM: Following Instructions in Language with Modular Methods. - Min, So Yeon; Chaplot, Devendra Singh; Ravikumar, Pradeep Kumar; Bisk, Yonatan; Salakhutdinov, Ruslan (2022)

A Framework for Learning to Request Rich and Contextually Useful Information from Humans. - Nguyen, Khanh X.; Bisk, Yonatan; Daumé, Hal, III (2022)

Symmetric Machine Theory of Mind. - Sclar, Melanie; Neubig, Graham; Bisk, Yonatan (2022)

KAT: A Knowledge Augmented Transformer for Vision-and-Language. - Gui, Liangke; Wang, Borui; Huang, Qiuyuan; Hauptmann, Alexander; Bisk, Yonatan; Gao, Jianfeng (2022)

HEAR 2021: Holistic Evaluation of Audio Representations. - Turian, Joseph; Shier, Jordie; Khan, Humair Raj; Raj, Bhiksha; Schuller, Björn W.; Steinmetz, Christian J.; Malloy, Colin; Tzanetakis, George; Velarde, Gissel; McNally, Kirk; Henry, Max; Pinto, Nicolas; et al. (CoRR, 2022)

Training Vision-Language Transformers from Captions Alone. - Gui, Liangke; Huang, Qiuyuan; Hauptmann, Alex; Bisk, Yonatan; Gao, Jianfeng (CoRR, 2022)

On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. - Palaskar, Shruti; Bhagia, Akshita; Bisk, Yonatan; Metze, Florian; Black, Alan W.; Marasovic, Ana (CoRR, 2022)

Transformers are Adaptable Task Planners. - Jain, Vidhi; Lin, Yixin; Undersander, Eric; Bisk, Yonatan; Rai, Akshara (CoRR, 2022)

Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue. - Min, So Yeon; Zhu, Hao; Salakhutdinov, Ruslan; Bisk, Yonatan (CoRR, 2022)

Retrospectives on the Embodied AI Workshop. - Deitke, Matt; Batra, Dhruv; Bisk, Yonatan; Campari, Tommaso; Chang, Angel X.; Chaplot, Devendra Singh; Chen, Changan; Pérez-D'Arpino, Claudia; Ehsani, Kiana; Farhadi, Ali; Fei-Fei, Li; Francis, Anthony G.; et al. (CoRR, 2022)

EvEntS ReaLM: Event Reasoning of Entity States via Language Models. - Spiliopoulou, Evangelia; Pagnoni, Artidoro; Bisk, Yonatan; Hovy, Eduard H. (CoRR, 2022)

Object Goal Navigation with End-to-End Self-Supervision. - Min, So Yeon; Tsai, Yao-Hung Hubert; Ding, Wei; Farhadi, Ali; Salakhutdinov, Ruslan; Bisk, Yonatan; Zhang, Jian (CoRR, 2022)

Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering. - Ma, Kaixin; Ilievski, Filip; Francis, Jonathan; Bisk, Yonatan; Nyberg, Eric; Oltramari, Alessandro (2021)

Grounding 'Grounding' in NLP. - Chandu, Khyathi Raghavi; Bisk, Yonatan; Black, Alan W. (2021)

Dependency Induction Through the Lens of Visual Perception. - Su, Ruisi; Rijhwani, Shruti; Zhu, Hao; He, Junxian; Wang, Xinyu; Bisk, Yonatan; Neubig, Graham (2021)

Language Grounding with 3D Objects. - Thomason, Jesse; Shridhar, Mohit; Bisk, Yonatan; Paxton, Chris; Zettlemoyer, Luke (2021)

An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games. - Suglia, Alessandro; Bisk, Yonatan; Konstas, Ioannis; Vergari, Antonio; Bastianelli, Emanuele; Vanzo, Andrea; Lemon, Oliver (2021)

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment. - Yang, Jianwei; Bisk, Yonatan; Gao, Jianfeng (2021)

ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. - Shridhar, Mohit; Yuan, Xingdi; Côté, Marc-Alexandre; Bisk, Yonatan; Trischler, Adam; Hausknecht, Matthew J. (2021)

Few-shot Language Coordination by Modeling Theory of Mind. - Zhu, Hao; Neubig, Graham; Bisk, Yonatan (2021)

HEAR: Holistic Evaluation of Audio Representations. - Turian, Joseph; Shier, Jordie; Khan, Humair Raj; Raj, Bhiksha; Schuller, Björn W.; Steinmetz, Christian J.; Malloy, Colin; Tzanetakis, George; Velarde, Gissel; McNally, Kirk; Henry, Max; Pinto, Nicolas; et al. (2021)

WebQA: A Multimodal Multihop NeurIPS Challenge. - Chang, Yingshan; Bisk, Yonatan (2021)

An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games. - Suglia, Alessandro; Bisk, Yonatan; Konstas, Ioannis; Vergari, Antonio; Bastianelli, Emanuele; Vanzo, Andrea; Lemon, Oliver (CoRR, 2021)

Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models. - Srinivasan, Tejas; Bisk, Yonatan (CoRR, 2021)

Grounding 'Grounding' in NLP. - Chandu, Khyathi Raghavi; Bisk, Yonatan; Black, Alan W. (CoRR, 2021)

Few-shot Language Coordination by Modeling Theory of Mind. - Zhu, Hao; Neubig, Graham; Bisk, Yonatan (CoRR, 2021)

Language Grounding with 3D Objects. - Thomason, Jesse; Shridhar, Mohit; Bisk, Yonatan; Paxton, Chris; Zettlemoyer, Luke (CoRR, 2021)

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment. - Yang, Jianwei; Bisk, Yonatan; Gao, Jianfeng (CoRR, 2021)

WebQA: Multihop and Multimodal QA. - Chang, Yingshan; Narang, Mridu; Suzuki, Hisami; Cao, Guihong; Gao, Jianfeng; Bisk, Yonatan (CoRR, 2021)

Dependency Induction Through the Lens of Visual Perception. - Su, Ruisi; Rijhwani, Shruti; Zhu, Hao; He, Junxian; Wang, Xinyu; Bisk, Yonatan; Neubig, Graham (CoRR, 2021)

FILM: Following Instructions in Language with Modular Methods. - Min, So Yeon; Chaplot, Devendra Singh; Ravikumar, Pradeep; Bisk, Yonatan; Salakhutdinov, Ruslan (CoRR, 2021)

Learning When and What to Ask: a Hierarchical Reinforcement Learning Framework. - Nguyen, Khanh; Bisk, Yonatan; Daumé, Hal, III (CoRR, 2021)

KAT: A Knowledge Augmented Transformer for Vision-and-Language. - Gui, Liangke; Wang, Borui; Huang, Qiuyuan; Hauptmann, Alex; Bisk, Yonatan; Gao, Jianfeng (CoRR, 2021)

It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process. - Hecht, Brent J.; Wilcox, Lauren; Bigham, Jeffrey P.; Schöning, Johannes; Hoque, Ehsan; Ernst, Jason; Bisk, Yonatan; Russis, Luigi De; Yarosh, Lana; Anjum, Bushra; Contractor, Danish; Wu, Cathy (CoRR, 2021)

The Return of Lexical Dependencies: Neural Lexicalized PCFGs. - Zhu, Hao; Bisk, Yonatan; Neubig, Graham (Trans. Assoc. Comput. Linguistics, 2020)

PIQA: Reasoning about Physical Commonsense in Natural Language. - Bisk, Yonatan; Zellers, Rowan; Bras, Ronan Le; Gao, Jianfeng; Choi, Yejin (2020)

Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games. - Suglia, Alessandro; Vergari, Antonio; Konstas, Ioannis; Bisk, Yonatan; Bastianelli, Emanuele; Vanzo, Andrea; Lemon, Oliver (2020)

ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. - Shridhar, Mohit; Thomason, Jesse; Gordon, Daniel; Bisk, Yonatan; Han, Winson; Mottaghi, Roozbeh; Zettlemoyer, Luke; Fox, Dieter (2020)

RMM: A Recursive Mental Model for Dialog Navigation. - Roman, Homero Roman; Bisk, Yonatan; Thomason, Jesse; Celikyilmaz, Asli; Gao, Jianfeng (2020)

Experience Grounds Language. - Bisk, Yonatan; Holtzman, Ari; Thomason, Jesse; Andreas, Jacob; Bengio, Yoshua; Chai, Joyce; Lapata, Mirella; Lazaridou, Angeliki; May, Jonathan; Nisnevich, Aleksandr; Pinto, Nicolas; Turian, Joseph P. (2020)

Multi-View Learning for Vision-and-Language Navigation. - Xia, Qiaolin; Li, Xiujun; Li, Chunyuan; Bisk, Yonatan; Sui, Zhifang; Gao, Jianfeng; Choi, Yejin; Smith, Noah A. (CoRR, 2020)

Experience Grounds Language. - Bisk, Yonatan; Holtzman, Ari; Thomason, Jesse; Andreas, Jacob; Bengio, Yoshua; Chai, Joyce; Lapata, Mirella; Lazaridou, Angeliki; May, Jonathan; Nisnevich, Aleksandr; Pinto, Nicolas; Turian, Joseph P. (CoRR, 2020)

A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos. - Xu, Frank F.; Ji, Lei; Shi, Botian; Du, Junyi; Neubig, Graham; Bisk, Yonatan; Duan, Nan (CoRR, 2020)

RMM: A Recursive Mental Model for Dialog Navigation. - Roman, Homero Roman; Bisk, Yonatan; Thomason, Jesse; Celikyilmaz, Asli; Gao, Jianfeng (CoRR, 2020)

The Return of Lexical Dependencies: Neural Lexicalized PCFGs. - Zhu, Hao; Bisk, Yonatan; Neubig, Graham (CoRR, 2020)

ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. - Shridhar, Mohit; Yuan, Xingdi; Côté, Marc-Alexandre; Bisk, Yonatan; Trischler, Adam; Hausknecht, Matthew J. (CoRR, 2020)

Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games. - Suglia, Alessandro; Vergari, Antonio; Konstas, Ioannis; Bisk, Yonatan; Bastianelli, Emanuele; Vanzo, Andrea; Lemon, Oliver (CoRR, 2020)

Knowledge-driven Self-supervision for Zero-shot Commonsense Question Answering. - Ma, Kaixin; Ilievski, Filip; Francis, Jonathan; Bisk, Yonatan; Nyberg, Eric; Oltramari, Alessandro (CoRR, 2020)

HellaSwag: Can a Machine Really Finish Your Sentence? - Zellers, Rowan; Holtzman, Ari; Bisk, Yonatan; Farhadi, Ali; Choi, Yejin (2019)

Character-based Surprisal as a Model of Reading Difficulty in the Presence of Errors. - Hahn, Michael; Keller, Frank; Bisk, Yonatan; Belinkov, Yonatan (2019)

From Recognition to Cognition: Visual Commonsense Reasoning. - Zellers, Rowan; Bisk, Yonatan; Farhadi, Ali; Choi, Yejin (2019)

Tactical Rewind: Self-Correction via Backtracking in Vision-And-Language Navigation. - Ke, Liyiming; Li, Xiujun; Bisk, Yonatan; Holtzman, Ari; Gan, Zhe; Liu, Jingjing; Gao, Jianfeng; Choi, Yejin; Srinivasa, Siddhartha S. (2019)

Robust Navigation with Language Pretraining and Stochastic Sampling. - Li, Xiujun; Li, Chunyuan; Xia, Qiaolin; Bisk, Yonatan; Celikyilmaz, Asli; Gao, Jianfeng; Smith, Noah A.; Choi, Yejin (2019)

Prospection: Interpretable plans from language by predicting the future. - Paxton, Chris; Bisk, Yonatan; Thomason, Jesse; Byravan, Arunkumar; Fox, Dieter (2019)

EARLY FUSION for Goal Directed Robotic Vision. - Walsman, Aaron; Bisk, Yonatan; Gabriel, Saadia; Misra, Dipendra; Artzi, Yoav; Choi, Yejin; Fox, Dieter (2019)

Improving Robot Success Detection using Static Object Data. - Scalise, Rosario; Thomason, Jesse; Bisk, Yonatan; Srinivasa, Siddhartha S. (2019)

Shifting the Baseline: Single Modality Performance on Visual Navigation & QA. - Thomason, Jesse; Gordon, Daniel; Bisk, Yonatan (2019)

Benchmarking Hierarchical Script Knowledge. - Bisk, Yonatan; Buys, Jan; Pichotta, Karl; Choi, Yejin (2019)

Defending Against Neural Fake News. - Zellers, Rowan; Holtzman, Ari; Rashkin, Hannah; Bisk, Yonatan; Farhadi, Ali; Roesner, Franziska; Choi, Yejin (2019)

Character-based Surprisal as a Model of Human Reading in the Presence of Errors. - Hahn, Michael; Keller, Frank; Bisk, Yonatan; Belinkov, Yonatan (CoRR, 2019)

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation. - Ke, Liyiming; Li, Xiujun; Bisk, Yonatan; Holtzman, Ari; Gan, Zhe; Liu, Jingjing; Gao, Jianfeng; Choi, Yejin; Srinivasa, Siddhartha S. (CoRR, 2019)

Prospection: Interpretable Plans From Language By Predicting the Future. - Paxton, Chris; Bisk, Yonatan; Thomason, Jesse; Byravan, Arunkumar; Fox, Dieter (CoRR, 2019)

Improving Robot Success Detection using Static Object Data. - Scalise, Rosario; Thomason, Jesse; Bisk, Yonatan; Srinivasa, Siddhartha S. (CoRR, 2019)

HellaSwag: Can a Machine Really Finish Your Sentence? - Zellers, Rowan; Holtzman, Ari; Bisk, Yonatan; Farhadi, Ali; Choi, Yejin (CoRR, 2019)

Defending Against Neural Fake News. - Zellers, Rowan; Holtzman, Ari; Rashkin, Hannah; Bisk, Yonatan; Farhadi, Ali; Roesner, Franziska; Choi, Yejin (CoRR, 2019)

Robust Navigation with Language Pretraining and Stochastic Sampling. - Li, Xiujun; Li, Chunyuan; Xia, Qiaolin; Bisk, Yonatan; Celikyilmaz, Asli; Gao, Jianfeng; Smith, Noah A.; Choi, Yejin (CoRR, 2019)

PIQA: Reasoning about Physical Commonsense in Natural Language. - Bisk, Yonatan; Zellers, Rowan; Bras, Ronan Le; Gao, Jianfeng; Choi, Yejin (CoRR, 2019)

ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. - Shridhar, Mohit; Thomason, Jesse; Gordon, Daniel; Bisk, Yonatan; Han, Winson; Mottaghi, Roozbeh; Zettlemoyer, Luke; Fox, Dieter (CoRR, 2019)

Learning Interpretable Spatial Operations in a Rich 3D Blocks World. - Bisk, Yonatan; Shih, Kevin J.; Choi, Yejin; Marcu, Daniel (2018)

Inducing Grammars with and for Neural Machine Translation. - Bisk, Yonatan; Tran, Ke M. (2018)

SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference. - Zellers, Rowan; Bisk, Yonatan; Schwartz, Roy; Choi, Yejin (2018)

Synthetic and Natural Noise Both Break Neural Machine Translation. - Belinkov, Yonatan; Bisk, Yonatan (2018)

CHALET: Cornell House Agent Learning Environment. - Yan, Claudia; Misra, Dipendra Kumar; Bennett, Andrew; Walsman, Aaron; Bisk, Yonatan; Artzi, Yoav (CoRR, 2018)

Balancing Shared Autonomy with Human-Robot Communication. - Scalise, Rosario; Bisk, Yonatan; Forbes, Maxwell; Yi, Daqing; Choi, Yejin; Srinivasa, Siddhartha S. (CoRR, 2018)

Inducing Grammars with and for Neural Machine Translation. - Tran, Ke M.; Bisk, Yonatan (CoRR, 2018)

SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference. - Zellers, Rowan; Bisk, Yonatan; Schwartz, Roy; Choi, Yejin (CoRR, 2018)

Shifting the Baseline: Single Modality Performance on Visual Navigation & QA. - Thomason, Jesse; Gordon, Daniel; Bisk, Yonatan (CoRR, 2018)

Early Fusion for Goal Directed Robotic Vision. - Walsman, Aaron; Bisk, Yonatan; Gabriel, Saadia; Misra, Dipendra Kumar; Artzi, Yoav; Choi, Yejin; Fox, Dieter (CoRR, 2018)

From Recognition to Cognition: Visual Commonsense Reasoning. - Zellers, Rowan; Bisk, Yonatan; Farhadi, Ali; Choi, Yejin (CoRR, 2018)

Natural Language Inference from Multiple Premises. - Lai, Alice; Bisk, Yonatan; Hockenmaier, Julia (2017)

Proceedings of the First Workshop on Language Grounding for Robotics, RoboNLP@ACL 2017, Vancouver, Canada, August 3, 2017 (Association for Computational Linguistics, 2017)

Natural Language Inference from Multiple Premises. - Lai, Alice; Bisk, Yonatan; Hockenmaier, Julia (CoRR, 2017)

Synthetic and Natural Noise Both Break Neural Machine Translation. - Belinkov, Yonatan; Bisk, Yonatan (CoRR, 2017)

Learning Interpretable Spatial Operations in a Rich 3D Blocks World. - Bisk, Yonatan; Shih, Kevin J.; Choi, Yejin; Marcu, Daniel (CoRR, 2017)

Towards a Dataset for Human Computer Communication via Grounded Language Acquisition. - Bisk, Yonatan; Marcu, Daniel; Wong, William (2016)

Unsupervised Neural Hidden Markov Models. - Tran, Ke M.; Bisk, Yonatan; Vaswani, Ashish; Marcu, Daniel; Knight, Kevin (2016)

Evaluating Induced CCG Parsers on Grounded Semantic Parsing. - Bisk, Yonatan; Reddy, Siva; Blitzer, John; Hockenmaier, Julia; Steedman, Mark (2016)

Supertagging With LSTMs. - Vaswani, Ashish; Bisk, Yonatan; Sagae, Kenji; Musa, Ryan (2016)

Natural Language Communication with Robots. - Bisk, Yonatan; Yuret, Deniz; Marcu, Daniel (2016)

Unsupervised Neural Hidden Markov Models. - Tran, Ke M.; Bisk, Yonatan; Vaswani, Ashish; Marcu, Daniel; Knight, Kevin (CoRR, 2016)

Evaluating Induced CCG Parsers on Grounded Semantic Parsing. - Bisk, Yonatan; Reddy, Siva; Blitzer, John; Hockenmaier, Julia; Steedman, Mark (CoRR, 2016)

Unsupervised grammar induction with Combinatory Categorial Grammars - Bisk, Yonatan (2015)

Labeled Grammar Induction with Minimal Supervision. - Bisk, Yonatan; Christodoulopoulos, Christos; Hockenmaier, Julia (2015)

Probing the Linguistic Strengths and Limitations of Unsupervised Grammar Induction. - Bisk, Yonatan; Hockenmaier, Julia (2015)

An HDP Model for Inducing Combinatory Categorial Grammars. - Bisk, Yonatan; Hockenmaier, Julia (Trans. Assoc. Comput. Linguistics, 2013)

Simple Robust Grammar Induction with Combinatory Categorial Grammars. - Bisk, Yonatan; Hockenmaier, Julia (2012)

Document-topic hierarchies from document graphs. - Weninger, Tim; Bisk, Yonatan; Han, Jiawei (2012)

Normal-form parsing for Combinatory Categorial Grammars with generalized composition and type-raising. - Hockenmaier, Julia; Bisk, Yonatan (2010)